[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:20:20.815322 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:38031
I20260709 12:20:20.817081 30271 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:20:20.818178 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:20.836208 30278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:20.836243 30280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:20.837102 30277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:20.838084 30271 server_base.cc:1061] running on GCE node
I20260709 12:20:22.068645 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.068939 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.069165 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599622069148 us; error 0 us; skew 500 ppm
I20260709 12:20:22.069974 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.075920 30271 webserver.cc:533] Webserver started at http://127.29.143.254:40191/ using document root <none> and password file <none>
I20260709 12:20:22.076752 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.076951 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.077335 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.083189 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "1428b4ffa211408a9b63a9a2dbadd95a"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.091053 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:20:22.097014 30286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.098428 30271 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:20:22.098805 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "1428b4ffa211408a9b63a9a2dbadd95a"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.099162 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.173038 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.174572 30271 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:20:22.175019 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.250310 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:38031
I20260709 12:20:22.250391 30337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:38031 every 8 connection(s)
I20260709 12:20:22.258519 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:22.282037 30338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: Bootstrap starting.
I20260709 12:20:22.287961 30338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:22.289808 30338 log.cc:826] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: Log is configured to *not* fsync() on all Append() calls
I20260709 12:20:22.294293 30338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: No bootstrap required, opened a new log
I20260709 12:20:22.315668 30338 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER }
I20260709 12:20:22.316236 30338 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:22.316438 30338 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1428b4ffa211408a9b63a9a2dbadd95a, State: Initialized, Role: FOLLOWER
I20260709 12:20:22.317241 30338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER }
I20260709 12:20:22.317706 30338 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:22.317943 30338 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:22.318220 30338 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:22.323452 30338 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER }
I20260709 12:20:22.324164 30338 leader_election.cc:304] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1428b4ffa211408a9b63a9a2dbadd95a; no voters: 
I20260709 12:20:22.325821 30338 leader_election.cc:290] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:22.326207 30341 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:22.328490 30341 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 1 LEADER]: Becoming Leader. State: Replica: 1428b4ffa211408a9b63a9a2dbadd95a, State: Running, Role: LEADER
I20260709 12:20:22.329481 30341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER }
I20260709 12:20:22.330498 30338 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:22.341938 30343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1428b4ffa211408a9b63a9a2dbadd95a. Latest consensus state: current_term: 1 leader_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER } }
I20260709 12:20:22.341761 30342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1428b4ffa211408a9b63a9a2dbadd95a" member_type: VOTER } }
I20260709 12:20:22.342599 30343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:22.342648 30342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:22.345556 30351 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:22.361030 30351 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:22.363399 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:22.377915 30351 catalog_manager.cc:1383] Generated new cluster ID: 70fc78597717482eac1654fd1fcdc52d
I20260709 12:20:22.378233 30351 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:22.419453 30351 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:22.421124 30351 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:22.442718 30351 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: Generated new TSK 0
I20260709 12:20:22.443810 30351 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:22.495810 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.506044 30360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.507133 30361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.512074 30363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.512956 30271 server_base.cc:1061] running on GCE node
I20260709 12:20:22.513746 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.513962 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.514148 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599622514132 us; error 0 us; skew 500 ppm
I20260709 12:20:22.514858 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.519456 30271 webserver.cc:533] Webserver started at http://127.29.143.193:43241/ using document root <none> and password file <none>
I20260709 12:20:22.520047 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.520277 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.520576 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.521682 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "ef0035ae97f8417b8ac0de994031392b"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.527763 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:20:22.532788 30368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.533686 30271 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:22.533994 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "ef0035ae97f8417b8ac0de994031392b"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.534257 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.571336 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.572926 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.576125 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.581269 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.581481 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.581797 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.581947 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.698673 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:42493
I20260709 12:20:22.698794 30430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:42493 every 8 connection(s)
I20260709 12:20:22.705976 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.715448 30435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.717578 30437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.731096 30271 server_base.cc:1061] running on GCE node
W20260709 12:20:22.733079 30439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.734570 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.734867 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.735083 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599622735066 us; error 0 us; skew 500 ppm
I20260709 12:20:22.735931 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.739226 30271 webserver.cc:533] Webserver started at http://127.29.143.194:45305/ using document root <none> and password file <none>
I20260709 12:20:22.739866 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.740103 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.740404 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.741310 30431 heartbeater.cc:344] Connected to a master server at 127.29.143.254:38031
I20260709 12:20:22.741775 30431 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:22.742085 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.743081 30431 heartbeater.cc:507] Master 127.29.143.254:38031 requested a full tablet report, sending...
I20260709 12:20:22.747011 30303 ts_manager.cc:194] Registered new tserver with Master: ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493)
I20260709 12:20:22.748986 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:20:22.749783 30303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44702
I20260709 12:20:22.754339 30444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.755882 30271 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:20:22.756215 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.756572 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.793036 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.794729 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.796357 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.799973 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.800225 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.800509 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.800714 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.893127 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:40815
I20260709 12:20:22.893296 30506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:40815 every 8 connection(s)
I20260709 12:20:22.901657 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:22.912858 30511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.915328 30510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:22.917879 30514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:22.917997 30271 server_base.cc:1061] running on GCE node
I20260709 12:20:22.920045 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:22.920275 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:22.920461 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599622920444 us; error 0 us; skew 500 ppm
I20260709 12:20:22.921020 30507 heartbeater.cc:344] Connected to a master server at 127.29.143.254:38031
I20260709 12:20:22.921216 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:22.921413 30507 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:22.922382 30507 heartbeater.cc:507] Master 127.29.143.254:38031 requested a full tablet report, sending...
I20260709 12:20:22.924109 30271 webserver.cc:533] Webserver started at http://127.29.143.195:34877/ using document root <none> and password file <none>
I20260709 12:20:22.924734 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:22.924724 30303 ts_manager.cc:194] Registered new tserver with Master: 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:22.925084 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:22.925405 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:22.926504 30303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44704
I20260709 12:20:22.926756 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.931640 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:20:22.935177 30518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.936151 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:20:22.936489 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
format_stamp: "Formatted at 2026-07-09 12:20:22 on dist-test-slave-9k85"
I20260709 12:20:22.936882 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:22.959497 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:22.960762 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:22.962236 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:22.964659 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:22.964834 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:22.965137 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:22.965309 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:23.073907 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:39817
I20260709 12:20:23.074419 30581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:39817 every 8 connection(s)
I20260709 12:20:23.090227 30582 heartbeater.cc:344] Connected to a master server at 127.29.143.254:38031
I20260709 12:20:23.090596 30582 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:23.091447 30582 heartbeater.cc:507] Master 127.29.143.254:38031 requested a full tablet report, sending...
I20260709 12:20:23.093721 30303 ts_manager.cc:194] Registered new tserver with Master: e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:23.094735 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015789641s
I20260709 12:20:23.095659 30303 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44718
I20260709 12:20:23.149515 30303 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44724:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:23.153390 30303 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:23.256035 30547 tablet_service.cc:1511] Processing CreateTablet for tablet b79fc19904e24779a3c46e332331cc7f (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:23.257833 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79fc19904e24779a3c46e332331cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.260391 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 9b44fd2d602b4c76bf80f73d72f555d7 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:23.261806 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b44fd2d602b4c76bf80f73d72f555d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.278486 30396 tablet_service.cc:1511] Processing CreateTablet for tablet b79fc19904e24779a3c46e332331cc7f (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:23.277354 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 9b44fd2d602b4c76bf80f73d72f555d7 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:23.279222 30394 tablet_service.cc:1511] Processing CreateTablet for tablet a692a4a875df469a8c59d94abb8b7652 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:23.281023 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79fc19904e24779a3c46e332331cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.284505 30545 tablet_service.cc:1511] Processing CreateTablet for tablet a692a4a875df469a8c59d94abb8b7652 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:23.285826 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a692a4a875df469a8c59d94abb8b7652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.288074 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b44fd2d602b4c76bf80f73d72f555d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.292759 30394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a692a4a875df469a8c59d94abb8b7652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.292073 30393 tablet_service.cc:1511] Processing CreateTablet for tablet ac4777204d1f426282e7b3fd406b4c78 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:23.294946 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4777204d1f426282e7b3fd406b4c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.300891 30544 tablet_service.cc:1511] Processing CreateTablet for tablet ac4777204d1f426282e7b3fd406b4c78 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:23.304859 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4777204d1f426282e7b3fd406b4c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.306349 30392 tablet_service.cc:1511] Processing CreateTablet for tablet d8adbaf9bea14f449015cf925ed25bdb (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:23.312964 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8adbaf9bea14f449015cf925ed25bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.320604 30543 tablet_service.cc:1511] Processing CreateTablet for tablet d8adbaf9bea14f449015cf925ed25bdb (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:23.323652 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8adbaf9bea14f449015cf925ed25bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.340497 30600 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
W20260709 12:20:23.351948 30350 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:23.349236 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0a12f954d4e2baf27897ea6348915 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:23.358394 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0a12f954d4e2baf27897ea6348915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.366138 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0a12f954d4e2baf27897ea6348915 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:23.370201 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 9b44fd2d602b4c76bf80f73d72f555d7 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:23.375502 30469 tablet_service.cc:1511] Processing CreateTablet for tablet ac4777204d1f426282e7b3fd406b4c78 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:23.374125 30470 tablet_service.cc:1511] Processing CreateTablet for tablet a692a4a875df469a8c59d94abb8b7652 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:23.382444 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4777204d1f426282e7b3fd406b4c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.379139 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0a12f954d4e2baf27897ea6348915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.371075 30472 tablet_service.cc:1511] Processing CreateTablet for tablet b79fc19904e24779a3c46e332331cc7f (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:23.391265 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 9fd0a12f954d4e2baf27897ea6348915 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:23.391124 30390 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8227b27d046b896164dba2d2e6950 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:23.395833 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b44fd2d602b4c76bf80f73d72f555d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.398020 30390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8227b27d046b896164dba2d2e6950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.395138 30468 tablet_service.cc:1511] Processing CreateTablet for tablet d8adbaf9bea14f449015cf925ed25bdb (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:23.398104 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79fc19904e24779a3c46e332331cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.405447 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a692a4a875df469a8c59d94abb8b7652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.411044 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fd0a12f954d4e2baf27897ea6348915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.411046 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8227b27d046b896164dba2d2e6950 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:23.415563 30600 tablet_bootstrap.cc:654] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.420011 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8adbaf9bea14f449015cf925ed25bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.422852 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8227b27d046b896164dba2d2e6950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.466962 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 58d75b9b494f4c5a9f131d90ef07a972 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:23.469385 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 58d75b9b494f4c5a9f131d90ef07a972 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:23.471746 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d75b9b494f4c5a9f131d90ef07a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.469342 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d75b9b494f4c5a9f131d90ef07a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.503583 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 95b8227b27d046b896164dba2d2e6950 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:23.504494 30601 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:23.509344 30600 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.510452 30600 ts_tablet_manager.cc:1403] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.182s	user 0.003s	sys 0.021s
I20260709 12:20:23.512161 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b8227b27d046b896164dba2d2e6950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.517354 30543 tablet_service.cc:1511] Processing CreateTablet for tablet 58d75b9b494f4c5a9f131d90ef07a972 (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:23.526348 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d75b9b494f4c5a9f131d90ef07a972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.528505 30600 raft_consensus.cc:359] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.529424 30600 raft_consensus.cc:385] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.543449 30600 raft_consensus.cc:740] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.545284 30603 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.546254 30600 consensus_queue.cc:260] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.552434 30396 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9e7664c914241a93647ba8d536c6c (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:23.556329 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9e7664c914241a93647ba8d536c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.557804 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9e7664c914241a93647ba8d536c6c (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:23.559091 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9e7664c914241a93647ba8d536c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.565254 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9e7664c914241a93647ba8d536c6c (DEFAULT_TABLE table=test-workload [id=ffdf078cc0364a90b0a5d1e0718ff33a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:23.566474 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9e7664c914241a93647ba8d536c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:23.570022 30582 heartbeater.cc:499] Master 127.29.143.254:38031 was elected leader, sending a full tablet report...
I20260709 12:20:23.577891 30601 tablet_bootstrap.cc:654] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.578917 30600 ts_tablet_manager.cc:1434] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 12:20:23.580619 30600 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
W20260709 12:20:23.581454 30583 tablet.cc:2406] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:23.590332 30603 tablet_bootstrap.cc:654] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.589064 30600 tablet_bootstrap.cc:654] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.603333 30600 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.603507 30601 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:23.603791 30600 ts_tablet_manager.cc:1403] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 12:20:23.604125 30601 ts_tablet_manager.cc:1403] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.145s	user 0.006s	sys 0.019s
I20260709 12:20:23.607735 30601 raft_consensus.cc:359] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.608516 30601 raft_consensus.cc:385] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.608860 30601 raft_consensus.cc:740] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.609622 30601 consensus_queue.cc:260] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.617311 30600 raft_consensus.cc:359] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.618474 30600 raft_consensus.cc:385] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.620416 30600 raft_consensus.cc:740] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.621521 30603 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:23.621340 30600 consensus_queue.cc:260] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.621958 30603 ts_tablet_manager.cc:1403] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.012s
I20260709 12:20:23.625021 30603 raft_consensus.cc:359] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.625720 30603 raft_consensus.cc:385] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.626001 30603 raft_consensus.cc:740] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.626760 30603 consensus_queue.cc:260] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.631213 30600 ts_tablet_manager.cc:1434] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:20:23.635188 30507 heartbeater.cc:499] Master 127.29.143.254:38031 was elected leader, sending a full tablet report...
I20260709 12:20:23.635890 30603 ts_tablet_manager.cc:1434] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.009s
I20260709 12:20:23.637403 30603 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.643921 30600 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:23.643970 30603 tablet_bootstrap.cc:654] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.645292 30431 heartbeater.cc:499] Master 127.29.143.254:38031 was elected leader, sending a full tablet report...
I20260709 12:20:23.654693 30600 tablet_bootstrap.cc:654] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.661360 30601 ts_tablet_manager.cc:1434] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.057s	user 0.021s	sys 0.016s
I20260709 12:20:23.662499 30601 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:23.672890 30603 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:23.674712 30603 ts_tablet_manager.cc:1403] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.014s
I20260709 12:20:23.679647 30601 tablet_bootstrap.cc:654] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.681586 30600 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.682113 30600 ts_tablet_manager.cc:1403] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.009s
I20260709 12:20:23.682654 30603 raft_consensus.cc:359] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.683547 30603 raft_consensus.cc:385] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.683907 30603 raft_consensus.cc:740] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.684689 30603 consensus_queue.cc:260] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.688557 30603 ts_tablet_manager.cc:1434] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:20:23.689666 30603 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.700438 30603 tablet_bootstrap.cc:654] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.702419 30601 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:23.702392 30600 raft_consensus.cc:359] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.703150 30601 ts_tablet_manager.cc:1403] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.015s
I20260709 12:20:23.703438 30600 raft_consensus.cc:385] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.704114 30600 raft_consensus.cc:740] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.705056 30600 consensus_queue.cc:260] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.707455 30600 ts_tablet_manager.cc:1434] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:20:23.707608 30601 raft_consensus.cc:359] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.708285 30601 raft_consensus.cc:385] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.708583 30601 raft_consensus.cc:740] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.708886 30600 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:23.709481 30601 consensus_queue.cc:260] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.713739 30603 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:23.714242 30603 ts_tablet_manager.cc:1403] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:20:23.717365 30600 tablet_bootstrap.cc:654] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.717549 30603 raft_consensus.cc:359] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.718369 30603 raft_consensus.cc:385] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.720258 30603 raft_consensus.cc:740] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.720991 30603 consensus_queue.cc:260] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.723495 30603 ts_tablet_manager.cc:1434] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 12:20:23.724466 30603 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.725312 30601 ts_tablet_manager.cc:1434] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:20:23.726617 30601 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:23.729791 30600 tablet_bootstrap.cc:492] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.730444 30600 ts_tablet_manager.cc:1403] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:20:23.731324 30603 tablet_bootstrap.cc:654] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.733834 30601 tablet_bootstrap.cc:654] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.733628 30600 raft_consensus.cc:359] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.734462 30600 raft_consensus.cc:385] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.734833 30600 raft_consensus.cc:740] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.735623 30600 consensus_queue.cc:260] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.739638 30600 ts_tablet_manager.cc:1434] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:20:23.744069 30600 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:23.750337 30603 tablet_bootstrap.cc:492] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:23.750888 30603 ts_tablet_manager.cc:1403] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.010s
I20260709 12:20:23.752002 30604 raft_consensus.cc:493] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.752583 30604 raft_consensus.cc:515] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.757752 30604 leader_election.cc:290] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:23.765820 30603 raft_consensus.cc:359] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.766585 30603 raft_consensus.cc:385] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.766948 30600 tablet_bootstrap.cc:654] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.766918 30603 raft_consensus.cc:740] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.770588 30603 consensus_queue.cc:260] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.774623 30603 ts_tablet_manager.cc:1434] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:20:23.777375 30603 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.781265 30601 tablet_bootstrap.cc:492] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:23.782449 30601 ts_tablet_manager.cc:1403] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.016s
I20260709 12:20:23.785378 30600 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.785830 30600 ts_tablet_manager.cc:1403] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.017s
I20260709 12:20:23.788630 30600 raft_consensus.cc:359] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.789407 30604 raft_consensus.cc:493] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.795408 30600 raft_consensus.cc:385] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.795742 30600 raft_consensus.cc:740] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.796460 30600 consensus_queue.cc:260] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.798107 30603 tablet_bootstrap.cc:654] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.798454 30604 raft_consensus.cc:515] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.801342 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:23.802532 30604 leader_election.cc:290] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:23.808063 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:23.809111 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:23.809381 30600 ts_tablet_manager.cc:1434] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 12:20:23.810423 30600 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
W20260709 12:20:23.812007 30520 leader_election.cc:343] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.802124 30482 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:23.807147 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:23.816835 30600 tablet_bootstrap.cc:654] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:23.820009 30522 leader_election.cc:343] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.825505 30522 leader_election.cc:304] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:23.828405 30604 raft_consensus.cc:2749] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:23.829288 30620 raft_consensus.cc:493] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.827504 30522 leader_election.cc:304] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:23.829861 30620 raft_consensus.cc:515] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.830492 30604 raft_consensus.cc:2804] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.830884 30604 raft_consensus.cc:493] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.831231 30604 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.832286 30620 leader_election.cc:290] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:23.833015 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:23.833474 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:23.834074 30482 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
W20260709 12:20:23.834563 30520 leader_election.cc:343] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.835251 30522 leader_election.cc:304] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:23.835983 30620 raft_consensus.cc:2804] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:23.836404 30620 raft_consensus.cc:493] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.836938 30620 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.838510 30604 raft_consensus.cc:515] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.840716 30604 leader_election.cc:290] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:23.793839 30601 raft_consensus.cc:359] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.841451 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:23.841706 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:23.842229 30482 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.843603 30600 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.843952 30603 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:23.841446 30601 raft_consensus.cc:385] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.845712 30600 ts_tablet_manager.cc:1403] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 12:20:23.846153 30601 raft_consensus.cc:740] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.847070 30601 consensus_queue.cc:260] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.848412 30620 raft_consensus.cc:515] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.852560 30406 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:23.854033 30601 ts_tablet_manager.cc:1434] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:20:23.854856 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:23.855099 30601 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:23.856118 30620 leader_election.cc:290] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:23.848973 30600 raft_consensus.cc:359] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.856716 30600 raft_consensus.cc:385] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.857020 30600 raft_consensus.cc:740] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.850934 30603 ts_tablet_manager.cc:1403] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.016s
I20260709 12:20:23.860042 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:23.860669 30481 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:23.861801 30601 tablet_bootstrap.cc:654] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.861454 30603 raft_consensus.cc:359] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.862397 30603 raft_consensus.cc:385] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.857867 30600 consensus_queue.cc:260] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.865003 30600 ts_tablet_manager.cc:1434] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:20:23.865890 30600 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:23.862704 30603 raft_consensus.cc:740] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
W20260709 12:20:23.871276 30520 leader_election.cc:343] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:23.871789 30603 consensus_queue.cc:260] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.873342 30601 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:23.873844 30601 ts_tablet_manager.cc:1403] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:20:23.874256 30603 ts_tablet_manager.cc:1434] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:20:23.875216 30603 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:23.876894 30601 raft_consensus.cc:359] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.877622 30601 raft_consensus.cc:385] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.877928 30601 raft_consensus.cc:740] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.878966 30601 consensus_queue.cc:260] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.881870 30603 tablet_bootstrap.cc:654] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.882100 30601 ts_tablet_manager.cc:1434] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:23.883126 30601 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:23.884207 30600 tablet_bootstrap.cc:654] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.889953 30601 tablet_bootstrap.cc:654] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.896636 30600 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:23.897157 30600 ts_tablet_manager.cc:1403] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:20:23.900398 30600 raft_consensus.cc:359] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.901237 30600 raft_consensus.cc:385] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.901556 30600 raft_consensus.cc:740] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.902308 30600 consensus_queue.cc:260] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.904639 30600 ts_tablet_manager.cc:1434] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:23.905581 30600 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:23.911732 30481 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
I20260709 12:20:23.912047 30601 tablet_bootstrap.cc:492] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:23.919618 30601 ts_tablet_manager.cc:1403] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.003s
I20260709 12:20:23.918140 30600 tablet_bootstrap.cc:654] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:23.851222 30482 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
I20260709 12:20:23.924557 30522 leader_election.cc:304] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:23.925364 30620 raft_consensus.cc:2804] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.926194 30620 raft_consensus.cc:697] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:23.925938 30522 leader_election.cc:304] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:23.922904 30601 raft_consensus.cc:359] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.928063 30601 raft_consensus.cc:385] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:23.928702 30604 raft_consensus.cc:2804] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:23.929075 30601 raft_consensus.cc:740] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:23.930753 30620 consensus_queue.cc:237] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.932122 30601 consensus_queue.cc:260] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:23.935693 30608 raft_consensus.cc:493] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.936960 30608 raft_consensus.cc:515] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:23.956801 30604 raft_consensus.cc:697] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:23.971413 30601 ts_tablet_manager.cc:1434] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.008s
I20260709 12:20:23.986773 30609 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.987528 30609 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.001857 30609 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.003163 30603 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:24.006057 30603 ts_tablet_manager.cc:1403] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.035s
I20260709 12:20:24.011168 30601 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:24.007318 30608 leader_election.cc:290] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.019398 30600 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:24.020372 30600 ts_tablet_manager.cc:1403] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.007s
I20260709 12:20:24.019012 30604 consensus_queue.cc:237] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.019549 30629 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.033211 30600 raft_consensus.cc:359] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.033282 30629 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.034801 30600 raft_consensus.cc:385] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.035121 30600 raft_consensus.cc:740] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.035966 30600 consensus_queue.cc:260] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.036142 30603 raft_consensus.cc:359] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.037034 30603 raft_consensus.cc:385] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.037065 30628 raft_consensus.cc:493] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.037427 30603 raft_consensus.cc:740] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.038143 30600 ts_tablet_manager.cc:1434] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:20:24.037642 30628 raft_consensus.cc:515] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.044243 30629 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.053463 30600 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: Bootstrap starting.
I20260709 12:20:24.056514 30628 leader_election.cc:290] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.041002 30603 consensus_queue.cc:260] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.059441 30603 ts_tablet_manager.cc:1434] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:20:24.060365 30603 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:24.057564 30628 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.074661 30628 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.077666 30628 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.113305 30600 tablet_bootstrap.cc:654] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.122732 30601 tablet_bootstrap.cc:654] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.129609 30603 tablet_bootstrap.cc:654] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.157141 30600 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: No bootstrap required, opened a new log
I20260709 12:20:24.157632 30600 ts_tablet_manager.cc:1403] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.007s
I20260709 12:20:24.158551 30629 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.158700 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.159384 30481 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.159103 30629 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.161264 30629 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.164153 30302 catalog_manager.cc:5697] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.175549 30620 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.176365 30620 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.183956 30600 raft_consensus.cc:359] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.184801 30600 raft_consensus.cc:385] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.185141 30600 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.179284 30620 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.190893 30600 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.195964 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.204690 30609 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.206817 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.208104 30600 ts_tablet_manager.cc:1434] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.006s
I20260709 12:20:24.204909 30522 leader_election.cc:304] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:24.207173 30609 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.209511 30620 raft_consensus.cc:493] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.203106 30405 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.212563 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.215305 30406 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.215902 30603 tablet_bootstrap.cc:492] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:24.216365 30603 ts_tablet_manager.cc:1403] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.008s
I20260709 12:20:24.215307 30634 raft_consensus.cc:2804] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.211984 30620 raft_consensus.cc:515] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.223793 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.226356 30601 tablet_bootstrap.cc:492] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:24.213287 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.226944 30634 raft_consensus.cc:493] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.234118 30634 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.234871 30480 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.224514 30481 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.243697 30522 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:24.226104 30404 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.314558 30603 raft_consensus.cc:359] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:24.337039 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.338093 30603 raft_consensus.cc:385] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.338217 30620 leader_election.cc:290] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.338294 30480 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.338428 30603 raft_consensus.cc:740] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.320240 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.339493 30603 consensus_queue.cc:260] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:24.340127 30372 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.317891 30609 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.304791 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
W20260709 12:20:24.340824 30522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40815, user_credentials={real_user=slave}} blocked reactor thread for 97186.1us
I20260709 12:20:24.341038 30609 raft_consensus.cc:493] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.341488 30556 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.341564 30609 raft_consensus.cc:515] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.342551 30620 raft_consensus.cc:2804] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.296876 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.343017 30620 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.343255 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.342324 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.343430 30620 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.343425 30557 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.344174 30480 raft_consensus.cc:2468] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
I20260709 12:20:24.274490 30601 ts_tablet_manager.cc:1403] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.010s
I20260709 12:20:24.322434 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.346087 30369 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.346486 30481 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.346984 30608 raft_consensus.cc:2804] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.315393 30555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.347405 30608 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.347843 30608 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.349628 30601 raft_consensus.cc:359] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.322853 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.252576 30520 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.351184 30629 raft_consensus.cc:2804] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.353868 30604 raft_consensus.cc:2804] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.354295 30604 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.354705 30604 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.344045 30609 leader_election.cc:290] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.356293 30629 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.356678 30629 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.357775 30608 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.305045 30634 raft_consensus.cc:515] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.352290 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.244004 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.362071 30482 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.363071 30603 ts_tablet_manager.cc:1434] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.146s	user 0.023s	sys 0.030s
I20260709 12:20:24.363763 30604 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
W20260709 12:20:24.353786 30520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:42493, user_credentials={real_user=slave}} blocked reactor thread for 101366us
I20260709 12:20:24.362303 30522 leader_election.cc:304] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:24.369185 30634 leader_election.cc:290] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.369223 30372 leader_election.cc:304] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.370869 30640 raft_consensus.cc:2804] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.372215 30630 raft_consensus.cc:2804] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.372777 30630 raft_consensus.cc:493] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.373235 30630 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.366106 30601 raft_consensus.cc:385] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.367000 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.375054 30405 raft_consensus.cc:2393] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in current term 1: Already voted for candidate ef0035ae97f8417b8ac0de994031392b in this term.
I20260709 12:20:24.376675 30640 raft_consensus.cc:493] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.375522 30601 raft_consensus.cc:740] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.379439 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.380702 30604 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.379313 30608 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.386842 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.387030 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.389127 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.390297 30481 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.390118 30482 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.390179 30403 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.381273 30640 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.391501 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:24.391428 30402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.386461 30634 raft_consensus.cc:493] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.385102 30404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.374841 30620 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.398653 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.402271 30554 raft_consensus.cc:2393] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in current term 1: Already voted for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in this term.
I20260709 12:20:24.401036 30556 raft_consensus.cc:2393] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in current term 1: Already voted for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in this term.
I20260709 12:20:24.396724 30634 raft_consensus.cc:515] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.399953 30629 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.408640 30603 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:24.397181 30601 consensus_queue.cc:260] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.420322 30482 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 1.
I20260709 12:20:24.423622 30603 tablet_bootstrap.cc:654] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.423398 30406 raft_consensus.cc:2468] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 0.
W20260709 12:20:24.424041 30350 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:24.427062 30446 leader_election.cc:304] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.427402 30604 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.428397 30645 raft_consensus.cc:2804] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.428807 30645 raft_consensus.cc:493] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.429597 30645 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.428368 30445 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3; no voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.434213 30647 raft_consensus.cc:2749] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.440119 30620 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.443313 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.444571 30480 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.444192 30645 raft_consensus.cc:515] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.446491 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
W20260709 12:20:24.453135 30522 leader_election.cc:343] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.453423 30645 leader_election.cc:290] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.453639 30603 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:24.454167 30603 ts_tablet_manager.cc:1403] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 12:20:24.454098 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.454355 30481 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
I20260709 12:20:24.454195 30629 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.447084 30634 leader_election.cc:290] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.455292 30406 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.445973 30445 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3; no voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.456765 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:24.461198 30554 raft_consensus.cc:2393] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0035ae97f8417b8ac0de994031392b in current term 1: Already voted for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in this term.
I20260709 12:20:24.461771 30372 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:24.462791 30629 raft_consensus.cc:2804] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.463254 30629 raft_consensus.cc:697] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:24.464260 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.464064 30629 consensus_queue.cc:237] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.465811 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:24.457962 30403 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
W20260709 12:20:24.458613 30646 log.cc:927] Time spent T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:20:24.458619 30480 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
I20260709 12:20:24.458889 30522 leader_election.cc:304] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:24.441917 30640 raft_consensus.cc:515] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.467621 30372 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0035ae97f8417b8ac0de994031392b; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:24.468150 30620 raft_consensus.cc:2804] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.468994 30553 raft_consensus.cc:2393] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in current term 1: Already voted for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in this term.
I20260709 12:20:24.468680 30620 raft_consensus.cc:697] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:24.469597 30608 raft_consensus.cc:2749] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.469883 30620 consensus_queue.cc:237] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.459806 30630 raft_consensus.cc:515] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:24.470894 30640 leader_election.cc:290] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.471681 30645 raft_consensus.cc:2749] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.477293 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.478046 30480 raft_consensus.cc:2393] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c4dbf53ae4abd9b0f4ee03715d080 in current term 1: Already voted for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in this term.
I20260709 12:20:24.478989 30522 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:24.479925 30634 raft_consensus.cc:2804] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.480557 30634 raft_consensus.cc:697] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:24.481577 30603 raft_consensus.cc:359] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.482477 30603 raft_consensus.cc:385] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.482841 30603 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.483696 30603 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.480893 30520 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.467619 30406 raft_consensus.cc:2468] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 1.
I20260709 12:20:24.484995 30634 consensus_queue.cc:237] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.504071 30630 leader_election.cc:290] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Requested vote from peers e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.504870 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:24.505019 30446 leader_election.cc:304] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:24.505704 30553 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.507853 30603 ts_tablet_manager.cc:1434] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:20:24.508502 30603 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: Bootstrap starting.
I20260709 12:20:24.510165 30609 raft_consensus.cc:2804] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.509240 30601 ts_tablet_manager.cc:1434] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.162s	user 0.015s	sys 0.004s
I20260709 12:20:24.511082 30604 raft_consensus.cc:2749] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.512354 30609 raft_consensus.cc:697] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
W20260709 12:20:24.512389 30520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:42493, user_credentials={real_user=slave}} blocked reactor thread for 92923.2us
I20260709 12:20:24.520023 30601 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:24.520540 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.520598 30609 consensus_queue.cc:237] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.524021 30480 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.529656 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.535187 30640 consensus_queue.cc:1048] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:24.540351 30406 raft_consensus.cc:2393] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c4dbf53ae4abd9b0f4ee03715d080 in current term 1: Already voted for candidate ef0035ae97f8417b8ac0de994031392b in this term.
I20260709 12:20:24.547264 30640 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.548133 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.548007 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.549440 30403 raft_consensus.cc:2393] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e19c4dbf53ae4abd9b0f4ee03715d080 in current term 1: Already voted for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in this term.
I20260709 12:20:24.548590 30640 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.552107 30640 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.553442 30403 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.556140 30603 tablet_bootstrap.cc:654] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.562315 30603 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: No bootstrap required, opened a new log
I20260709 12:20:24.562896 30603 ts_tablet_manager.cc:1403] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 12:20:24.561492 30480 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 1.
I20260709 12:20:24.566408 30372 leader_election.cc:304] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
W20260709 12:20:24.566994 30520 leader_election.cc:343] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.567250 30630 raft_consensus.cc:2804] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.567425 30520 leader_election.cc:304] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.567708 30630 raft_consensus.cc:697] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:24.568533 30520 leader_election.cc:304] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.568504 30630 consensus_queue.cc:237] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:24.570336 30604 raft_consensus.cc:2749] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.575018 30620 raft_consensus.cc:2749] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.575165 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.577253 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b" is_pre_election: true
I20260709 12:20:24.577646 30481 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 0.
W20260709 12:20:24.583923 30520 leader_election.cc:343] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.614446 30603 raft_consensus.cc:359] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.616164 30603 raft_consensus.cc:385] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.616554 30603 raft_consensus.cc:740] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.617286 30603 consensus_queue.cc:260] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.615682 30553 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 1.
I20260709 12:20:24.618036 30601 tablet_bootstrap.cc:654] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.615520 30522 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.618877 30634 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.619333 30634 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.619720 30634 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:24.623005 30520 consensus_peers.cc:597] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 -> Peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Couldn't send request to peer ef0035ae97f8417b8ac0de994031392b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:24.623847 30640 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.627995 30634 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.628495 30301 catalog_manager.cc:5697] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.630501 30603 ts_tablet_manager.cc:1434] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.009s
I20260709 12:20:24.633092 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:24.633289 30634 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:24.632618 30301 catalog_manager.cc:5697] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.632781 30302 catalog_manager.cc:5697] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:24.634260 30520 leader_election.cc:343] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:24.634814 30301 catalog_manager.cc:5697] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.635061 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.639166 30480 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.659200 30303 catalog_manager.cc:5697] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.668736 30601 tablet_bootstrap.cc:492] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:24.669257 30601 ts_tablet_manager.cc:1403] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.023s
I20260709 12:20:24.671650 30480 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 1.
I20260709 12:20:24.672698 30601 raft_consensus.cc:359] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.672947 30522 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:24.673439 30601 raft_consensus.cc:385] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.673733 30601 raft_consensus.cc:740] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.674062 30634 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.674541 30634 raft_consensus.cc:697] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:24.674453 30601 consensus_queue.cc:260] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.675408 30634 consensus_queue.cc:237] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.678437 30301 catalog_manager.cc:5697] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.687047 30601 ts_tablet_manager.cc:1434] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:20:24.688383 30601 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:24.699463 30601 tablet_bootstrap.cc:654] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.703912 30601 tablet_bootstrap.cc:492] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:24.704349 30601 ts_tablet_manager.cc:1403] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:20:24.704507 30301 catalog_manager.cc:5697] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.706912 30601 raft_consensus.cc:359] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.707590 30601 raft_consensus.cc:385] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.707861 30601 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.708559 30601 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.710429 30601 ts_tablet_manager.cc:1434] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:24.711246 30601 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: Bootstrap starting.
I20260709 12:20:24.716717 30601 tablet_bootstrap.cc:654] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:24.720858 30601 tablet_bootstrap.cc:492] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: No bootstrap required, opened a new log
I20260709 12:20:24.721287 30601 ts_tablet_manager.cc:1403] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:20:24.723313 30601 raft_consensus.cc:359] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.723803 30601 raft_consensus.cc:385] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:24.724028 30601 raft_consensus.cc:740] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Initialized, Role: FOLLOWER
I20260709 12:20:24.724550 30601 consensus_queue.cc:260] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.726058 30601 ts_tablet_manager.cc:1434] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:20:24.782831 30630 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.782965 30629 raft_consensus.cc:493] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.783399 30630 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.783617 30629 raft_consensus.cc:515] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.785440 30630 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.785655 30629 leader_election.cc:290] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.787117 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.787364 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.787024 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.787835 30481 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.788483 30480 raft_consensus.cc:2393] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0035ae97f8417b8ac0de994031392b in current term 1: Already voted for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in this term.
I20260709 12:20:24.788681 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.789291 30554 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 0.
I20260709 12:20:24.789253 30372 leader_election.cc:304] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.790335 30629 raft_consensus.cc:2804] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:24.790433 30372 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0035ae97f8417b8ac0de994031392b; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:24.790853 30629 raft_consensus.cc:493] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.791306 30629 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.791365 30630 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.796571 30629 raft_consensus.cc:515] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.798120 30630 raft_consensus.cc:2749] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.798583 30629 leader_election.cc:290] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.799475 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:24.799678 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:24.800153 30480 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.800242 30554 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:24.804847 30480 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 1.
I20260709 12:20:24.806142 30372 leader_election.cc:304] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:24.806829 30554 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 1.
I20260709 12:20:24.806972 30630 raft_consensus.cc:2804] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:24.807513 30630 raft_consensus.cc:697] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:24.808703 30630 consensus_queue.cc:237] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.816679 30302 catalog_manager.cc:5697] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:24.859297 30630 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.868530 30630 raft_consensus.cc:493] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.869055 30630 raft_consensus.cc:515] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:24.871977 30630 leader_election.cc:290] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:24.872098 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" is_pre_election: true
I20260709 12:20:24.876700 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" is_pre_election: true
I20260709 12:20:24.876616 30629 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.878264 30369 leader_election.cc:304] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0035ae97f8417b8ac0de994031392b; no voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:24.879793 30630 raft_consensus.cc:2749] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:24.910099 30634 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.922317 30620 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:24.992147 30609 consensus_queue.cc:1048] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.003809 30647 consensus_queue.cc:1048] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.048565 30620 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.061925 30604 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.081027 30629 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.094851 30608 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.097959 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:25.098640 30553 raft_consensus.cc:606] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Received request to transfer leadership to TS ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:25.101534 30640 raft_consensus.cc:993] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:25.101960 30640 raft_consensus.cc:1081] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Signalling peer ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:25.103842 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52556
I20260709 12:20:25.104391 30403 raft_consensus.cc:493] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.104753 30403 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.111914 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:25.112507 30553 raft_consensus.cc:606] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Received request to transfer leadership to TS ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:25.122452 30403 raft_consensus.cc:515] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.124231 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:25.124809 30553 raft_consensus.cc:606] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:25.125051 30403 leader_election.cc:290] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:25.127063 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:25.127355 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:25.127616 30553 raft_consensus.cc:3055] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.127995 30553 raft_consensus.cc:740] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.128072 30480 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.128839 30553 consensus_queue.cc:260] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.130151 30553 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.130897 30554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:25.131445 30554 raft_consensus.cc:606] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:25.135069 30480 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:25.136319 30372 leader_election.cc:304] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:25.136857 30553 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:25.137142 30608 raft_consensus.cc:2804] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.137603 30608 raft_consensus.cc:697] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:25.138370 30608 consensus_queue.cc:237] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.141026 30553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:25.141646 30553 raft_consensus.cc:606] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:25.146744 30604 raft_consensus.cc:993] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.145989 30302 catalog_manager.cc:5697] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 1 to 2, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.147184 30620 raft_consensus.cc:1081] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.147969 30640 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.156358 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52086
I20260709 12:20:25.157531 30480 raft_consensus.cc:493] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.158488 30480 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.167058 30480 raft_consensus.cc:515] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.168983 30480 leader_election.cc:290] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:25.169139 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
mode: GRACEFUL
new_leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:52570
I20260709 12:20:25.169700 30403 raft_consensus.cc:606] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Received request to transfer leadership to TS e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:25.172181 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:25.172796 30403 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.171780 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:25.181108 30553 raft_consensus.cc:3055] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.181452 30553 raft_consensus.cc:740] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.182269 30553 consensus_queue.cc:260] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.183562 30553 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.180609 30640 raft_consensus.cc:993] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.185257 30620 raft_consensus.cc:1081] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.187273 30481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52086
I20260709 12:20:25.187888 30481 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.187937 30403 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:25.188427 30481 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.189641 30446 leader_election.cc:304] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:25.191031 30647 raft_consensus.cc:2804] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.191577 30647 raft_consensus.cc:697] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:25.192401 30647 consensus_queue.cc:237] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.193631 30553 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:25.202491 30620 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.203981 30481 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.206848 30303 catalog_manager.cc:5697] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 1 to 2, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.208953 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:25.209766 30481 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:25.209893 30553 raft_consensus.cc:3055] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.210484 30405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:25.211182 30553 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.212114 30553 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.213172 30553 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.220003 30553 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:25.221163 30445 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:25.222615 30647 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.223093 30647 raft_consensus.cc:697] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:25.223881 30647 consensus_queue.cc:237] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.231560 30630 consensus_queue.cc:1048] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:25.233719 30302 catalog_manager.cc:5697] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 1 to 2, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.247707 30629 consensus_queue.cc:1048] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.258519 30608 raft_consensus.cc:993] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: : Instructing follower e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:25.259119 30629 raft_consensus.cc:1081] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Signalling peer e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:25.260865 30553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:60792
I20260709 12:20:25.261410 30553 raft_consensus.cc:493] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.261775 30553 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.266291 30553 raft_consensus.cc:515] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.268815 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:25.269013 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da9e7664c914241a93647ba8d536c6c" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:25.269407 30406 raft_consensus.cc:3055] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.269515 30481 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.269770 30406 raft_consensus.cc:740] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:25.270571 30406 consensus_queue.cc:260] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.271646 30406 raft_consensus.cc:3060] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.275629 30553 leader_election.cc:290] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:25.276291 30481 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 2.
I20260709 12:20:25.277751 30522 leader_election.cc:304] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:25.278436 30620 raft_consensus.cc:2804] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.278908 30620 raft_consensus.cc:697] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.279618 30620 consensus_queue.cc:237] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.280162 30406 raft_consensus.cc:2468] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 2.
I20260709 12:20:25.285648 30303 catalog_manager.cc:5697] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 1 to 2, leader changed from ef0035ae97f8417b8ac0de994031392b (127.29.143.193) to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.444463 30640 raft_consensus.cc:993] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:25.444988 30640 raft_consensus.cc:1081] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Signalling peer ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:25.446468 30406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52556
I20260709 12:20:25.447043 30406 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.447505 30406 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.454807 30406 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.457127 30406 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:25.458267 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:25.458249 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:25.458979 30481 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.459044 30553 raft_consensus.cc:3055] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.459564 30553 raft_consensus.cc:740] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.460376 30553 consensus_queue.cc:260] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.461530 30553 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.465739 30481 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:25.466945 30372 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:25.467738 30629 raft_consensus.cc:2804] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.468142 30553 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:25.468230 30629 raft_consensus.cc:697] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:25.469144 30629 consensus_queue.cc:237] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.476133 30303 catalog_manager.cc:5697] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 1 to 2, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.488956 30604 raft_consensus.cc:993] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.489416 30640 raft_consensus.cc:1081] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:25.491245 30481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52086
I20260709 12:20:25.491928 30481 raft_consensus.cc:493] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:25.492380 30481 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.497714 30481 raft_consensus.cc:515] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.500193 30481 leader_election.cc:290] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:25.500792 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:25.501447 30406 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.501870 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:25.502408 30553 raft_consensus.cc:3055] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:25.502714 30553 raft_consensus.cc:740] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:25.503458 30553 consensus_queue.cc:260] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.504551 30553 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.509655 30553 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:25.509649 30406 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:25.510982 30445 leader_election.cc:304] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:25.511842 30647 raft_consensus.cc:2804] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:25.512323 30647 raft_consensus.cc:697] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:25.513157 30647 consensus_queue.cc:237] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:25.521786 30302 catalog_manager.cc:5697] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 1 to 2, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:25.607424 30481 raft_consensus.cc:1275] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.608649 30630 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.617093 30553 raft_consensus.cc:1275] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.619159 30608 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.670269 30406 raft_consensus.cc:1275] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.671671 30640 consensus_queue.cc:1048] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.680505 30481 raft_consensus.cc:1275] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.681969 30640 consensus_queue.cc:1048] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.727144 30553 raft_consensus.cc:1275] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.728336 30686 consensus_queue.cc:1048] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.737650 30406 raft_consensus.cc:1275] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.738919 30686 consensus_queue.cc:1048] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:25.756960 30553 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.758174 30686 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.763998 30406 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:25.771195 30406 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.772400 30691 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.962633 30553 raft_consensus.cc:1275] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.964155 30608 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:25.972260 30481 raft_consensus.cc:1275] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:25.973734 30629 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:26.028658 30406 raft_consensus.cc:1275] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.029901 30691 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:26.037429 30553 raft_consensus.cc:1275] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:26.039297 30647 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:28.210312 30271 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:20:28.211069 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:28.226936 30481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:28.227389 30481 raft_consensus.cc:606] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Received request to transfer leadership to TS e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:28.238240 30403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
mode: GRACEFUL
new_leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:52584
I20260709 12:20:28.238768 30403 raft_consensus.cc:606] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Received request to transfer leadership to TS e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:28.239986 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:28.240392 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:28.275966 30698 raft_consensus.cc:993] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: : Instructing follower e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:28.276441 30698 raft_consensus.cc:1081] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Signalling peer e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:28.277853 30554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:60792
I20260709 12:20:28.278339 30554 raft_consensus.cc:493] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.278652 30554 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.282960 30554 raft_consensus.cc:515] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:28.284627 30554 leader_election.cc:290] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:28.285410 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:28.285753 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:28.285971 30403 raft_consensus.cc:3055] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:28.286301 30481 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.286309 30403 raft_consensus.cc:740] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:28.287199 30403 consensus_queue.cc:260] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:28.288066 30403 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:28.290864 30481 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 2.
I20260709 12:20:28.291869 30522 leader_election.cc:304] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:28.292333 30403 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 2.
I20260709 12:20:28.292531 30640 raft_consensus.cc:2804] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:28.293762 30640 raft_consensus.cc:697] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:28.294612 30640 consensus_queue.cc:237] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:28.301388 30303 catalog_manager.cc:5697] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 1 to 2, leader changed from ef0035ae97f8417b8ac0de994031392b (127.29.143.193) to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.678188 30705 raft_consensus.cc:993] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:28.678795 30647 raft_consensus.cc:1081] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Signalling peer e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:28.680670 30554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:60786
I20260709 12:20:28.681246 30554 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:28.681636 30554 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.687103 30554 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:28.688591 30554 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:28.689487 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:28.689576 30481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:28.690096 30403 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.690132 30481 raft_consensus.cc:3055] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:28.690622 30481 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:28.691433 30481 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:28.692581 30481 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:28.696738 30403 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:28.697806 30520 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:28.698559 30640 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:28.699040 30640 raft_consensus.cc:697] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:28.699100 30481 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:28.699810 30640 consensus_queue.cc:237] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:28.706905 30303 catalog_manager.cc:5697] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 2 to 3, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.767204 30403 raft_consensus.cc:1275] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.768422 30640 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:28.777560 30481 raft_consensus.cc:1275] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:28.779048 30640 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:29.203622 30403 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:29.204777 30709 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:29.214251 30481 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:29.215560 30699 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:29.241420 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.247135 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:29.247478 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:30.248325 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.253068 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:30.253386 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:31.254455 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.260171 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:31.260535 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:32.261485 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:32.266120 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:32.266443 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:33.267405 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:33.272938 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:33.273329 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:34.274611 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.279800 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:34.280265 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:35.281304 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:35.286536 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:35.286954 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:36.287863 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:36.292543 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:36.292958 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.293830 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.298455 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:37.298894 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:38.326654 30271 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:20:38.331394 30554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:38.332041 30554 raft_consensus.cc:606] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:38.336984 30406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52570
I20260709 12:20:38.337684 30406 raft_consensus.cc:606] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:38.342519 30406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52570
I20260709 12:20:38.342976 30406 raft_consensus.cc:606] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:38.347257 30406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52570
I20260709 12:20:38.347651 30406 raft_consensus.cc:606] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:38.351645 30698 raft_consensus.cc:993] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.352212 30719 raft_consensus.cc:1081] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.354000 30481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52102
I20260709 12:20:38.354521 30481 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.354925 30481 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.360622 30554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
mode: GRACEFUL
new_leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:60802
I20260709 12:20:38.361099 30554 raft_consensus.cc:606] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Received request to transfer leadership to TS 518c11d7b6dc4299a6ee25c1e71c14d3
I20260709 12:20:38.361974 30481 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.363461 30720 raft_consensus.cc:993] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.364187 30699 raft_consensus.cc:1081] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.365157 30481 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:38.365625 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:38.366019 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:38.366336 30406 raft_consensus.cc:3055] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:38.366528 30554 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.366641 30406 raft_consensus.cc:740] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:38.367410 30406 consensus_queue.cc:260] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.368196 30406 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:38.370972 30554 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:38.371812 30481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52086
I20260709 12:20:38.372354 30481 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.372649 30406 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 2.
I20260709 12:20:38.372709 30481 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.372712 30445 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:38.373778 30718 raft_consensus.cc:2804] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:38.374716 30718 raft_consensus.cc:697] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:38.375622 30718 consensus_queue.cc:237] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.379076 30481 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.380831 30481 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 4 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:38.381635 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:38.381691 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:38.382205 30554 raft_consensus.cc:3055] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:38.382264 30406 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.382586 30554 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:38.383400 30554 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.384634 30554 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:38.383953 30302 catalog_manager.cc:5697] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 1 to 2, leader changed from ef0035ae97f8417b8ac0de994031392b (127.29.143.193) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.388265 30406 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 4.
I20260709 12:20:38.390534 30446 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:38.391451 30718 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:38.391850 30554 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 4.
I20260709 12:20:38.391908 30718 raft_consensus.cc:697] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:38.393411 30698 raft_consensus.cc:993] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.393759 30698 raft_consensus.cc:1081] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.392994 30718 consensus_queue.cc:237] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.395325 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52102
I20260709 12:20:38.395828 30480 raft_consensus.cc:493] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.396227 30480 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.399063 30698 raft_consensus.cc:993] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.399454 30698 raft_consensus.cc:1081] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.401149 30481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52102
I20260709 12:20:38.401700 30481 raft_consensus.cc:493] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.402096 30481 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.403319 30480 raft_consensus.cc:515] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.405987 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:38.406487 30406 raft_consensus.cc:3055] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.406774 30406 raft_consensus.cc:740] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:38.407538 30406 consensus_queue.cc:260] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.408339 30481 raft_consensus.cc:515] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.408622 30406 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.410616 30481 leader_election.cc:290] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:38.411250 30554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:38.411778 30554 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.411978 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a692a4a875df469a8c59d94abb8b7652" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:38.412950 30403 raft_consensus.cc:3055] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.413242 30403 raft_consensus.cc:740] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:38.413904 30403 consensus_queue.cc:260] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.415114 30403 raft_consensus.cc:3060] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.416381 30406 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.418052 30480 leader_election.cc:290] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:38.418068 30446 leader_election.cc:304] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:38.418782 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b44fd2d602b4c76bf80f73d72f555d7" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:38.419324 30553 raft_consensus.cc:3060] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.419448 30718 raft_consensus.cc:2804] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:38.419960 30718 raft_consensus.cc:697] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:38.420360 30554 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.420809 30718 consensus_queue.cc:237] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.421343 30445 leader_election.cc:304] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, e19c4dbf53ae4abd9b0f4ee03715d080; no voters: 
I20260709 12:20:38.423998 30403 raft_consensus.cc:2468] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.424464 30721 raft_consensus.cc:2804] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:38.424883 30721 raft_consensus.cc:697] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:38.425855 30721 consensus_queue.cc:237] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:38.427162 30553 raft_consensus.cc:2468] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.441421 30302 catalog_manager.cc:5697] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 3 to 4, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.442636 30302 catalog_manager.cc:5697] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 2 to 3, leader changed from ef0035ae97f8417b8ac0de994031392b (127.29.143.193) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.443622 30302 catalog_manager.cc:5697] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 2 to 3, leader changed from ef0035ae97f8417b8ac0de994031392b (127.29.143.193) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.755148 30720 raft_consensus.cc:993] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: : Instructing follower 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.755574 30699 raft_consensus.cc:1081] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Signalling peer 518c11d7b6dc4299a6ee25c1e71c14d3 to start an election
I20260709 12:20:38.757031 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
 from {username='slave'} at 127.0.0.1:52086
I20260709 12:20:38.757505 30480 raft_consensus.cc:493] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.757771 30480 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.762756 30480 raft_consensus.cc:515] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:38.764282 30480 leader_election.cc:290] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:38.765080 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:38.765508 30553 raft_consensus.cc:3055] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:38.765408 30403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79fc19904e24779a3c46e332331cc7f" candidate_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:38.765770 30553 raft_consensus.cc:740] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:38.765990 30403 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.766422 30553 consensus_queue.cc:260] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:38.767295 30553 raft_consensus.cc:3060] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:38.771761 30403 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.772004 30553 raft_consensus.cc:2468] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c11d7b6dc4299a6ee25c1e71c14d3 in term 3.
I20260709 12:20:38.772949 30446 leader_election.cc:304] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c11d7b6dc4299a6ee25c1e71c14d3, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:38.774109 30727 raft_consensus.cc:2804] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:38.774796 30727 raft_consensus.cc:697] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Becoming Leader. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:38.775789 30727 consensus_queue.cc:237] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } }
I20260709 12:20:38.779137 30553 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 4 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:38.781050 30721 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:38.784410 30403 raft_consensus.cc:1275] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:38.784255 30303 catalog_manager.cc:5697] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 reported cstate change: term changed from 2 to 3, leader changed from e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195) to 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.786185 30721 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:38.798022 30406 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 4 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:38.799556 30736 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:38.810799 30553 raft_consensus.cc:1275] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:38.812599 30736 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:38.940255 30553 raft_consensus.cc:1275] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.941434 30736 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:38.949826 30406 raft_consensus.cc:1275] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.951185 30718 consensus_queue.cc:1048] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:38.980036 30403 raft_consensus.cc:1275] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.981197 30718 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:38.989502 30553 raft_consensus.cc:1275] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:38.991241 30721 consensus_queue.cc:1048] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.369445 30553 raft_consensus.cc:1275] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:39.370520 30727 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:39.379448 30403 raft_consensus.cc:1275] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer 518c11d7b6dc4299a6ee25c1e71c14d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:39.380860 30727 consensus_queue.cc:1048] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:41.405085 30271 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:20:41.405846 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:41.412405 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:41.413056 30480 raft_consensus.cc:606] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 LEADER]: Received request to transfer leadership to TS ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:41.415709 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:41.416155 30480 raft_consensus.cc:606] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 LEADER]: Received request to transfer leadership to TS ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:41.418246 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:41.418746 30480 raft_consensus.cc:606] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Received request to transfer leadership to TS e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:41.421048 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:41.421447 30480 raft_consensus.cc:606] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Received request to transfer leadership to TS ef0035ae97f8417b8ac0de994031392b
I20260709 12:20:41.423688 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb"
dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
mode: GRACEFUL
new_leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:52110
I20260709 12:20:41.424088 30480 raft_consensus.cc:606] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Received request to transfer leadership to TS e19c4dbf53ae4abd9b0f4ee03715d080
I20260709 12:20:41.425042 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:41.425417 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:41.515487 30727 raft_consensus.cc:993] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.516136 30749 raft_consensus.cc:1081] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 LEADER]: Signalling peer ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.517711 30406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52558
I20260709 12:20:41.518208 30406 raft_consensus.cc:493] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.518524 30406 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.523921 30406 raft_consensus.cc:515] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.525983 30406 leader_election.cc:290] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 5 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:41.526860 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:41.527045 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58d75b9b494f4c5a9f131d90ef07a972" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:41.527537 30553 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.528012 30480 raft_consensus.cc:3055] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:41.528304 30480 raft_consensus.cc:740] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:41.529103 30480 consensus_queue.cc:260] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.530110 30480 raft_consensus.cc:3060] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:41.531919 30553 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 5.
I20260709 12:20:41.533042 30369 leader_election.cc:304] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:41.534521 30750 raft_consensus.cc:2804] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:41.535229 30480 raft_consensus.cc:2468] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 5.
I20260709 12:20:41.535504 30750 raft_consensus.cc:697] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 5 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:41.536577 30750 consensus_queue.cc:237] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.543184 30303 catalog_manager.cc:5697] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 4 to 5, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 5 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.548748 30727 raft_consensus.cc:993] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:41.549254 30749 raft_consensus.cc:1081] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Signalling peer e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:41.550782 30553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:60786
I20260709 12:20:41.551311 30553 raft_consensus.cc:493] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.551723 30553 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.557437 30553 raft_consensus.cc:515] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.559340 30553 leader_election.cc:290] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:41.560106 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:41.560407 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fd0a12f954d4e2baf27897ea6348915" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:41.560655 30406 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.561005 30480 raft_consensus.cc:3055] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.561357 30480 raft_consensus.cc:740] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:41.562130 30480 consensus_queue.cc:260] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.563046 30480 raft_consensus.cc:3060] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.565050 30406 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:41.566401 30520 leader_election.cc:304] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:41.567378 30699 raft_consensus.cc:2804] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:41.568581 30699 raft_consensus.cc:697] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:41.569439 30699 consensus_queue.cc:237] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.569785 30480 raft_consensus.cc:2468] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:41.576426 30303 catalog_manager.cc:5697] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 2 to 3, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.692685 30727 raft_consensus.cc:993] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:41.693122 30749 raft_consensus.cc:1081] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Signalling peer e19c4dbf53ae4abd9b0f4ee03715d080 to start an election
I20260709 12:20:41.694386 30553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb"
dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
 from {username='slave'} at 127.0.0.1:60786
I20260709 12:20:41.694890 30553 raft_consensus.cc:493] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.695163 30553 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.699116 30553 raft_consensus.cc:515] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.700703 30553 leader_election.cc:290] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Requested vote from peers ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493), 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815)
I20260709 12:20:41.701428 30406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
I20260709 12:20:41.702049 30406 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.701974 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8adbaf9bea14f449015cf925ed25bdb" candidate_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:41.702766 30480 raft_consensus.cc:3055] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.703163 30480 raft_consensus.cc:740] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:41.704008 30480 consensus_queue.cc:260] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.705108 30727 raft_consensus.cc:993] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.705287 30480 raft_consensus.cc:3060] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.705581 30749 raft_consensus.cc:1081] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Signalling peer ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.707299 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52558
I20260709 12:20:41.707764 30403 raft_consensus.cc:493] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.708073 30403 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.708576 30406 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:41.709633 30520 leader_election.cc:304] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:41.710436 30699 raft_consensus.cc:2804] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:41.710834 30480 raft_consensus.cc:2468] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19c4dbf53ae4abd9b0f4ee03715d080 in term 3.
I20260709 12:20:41.710968 30699 raft_consensus.cc:697] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Becoming Leader. State: Replica: e19c4dbf53ae4abd9b0f4ee03715d080, State: Running, Role: LEADER
I20260709 12:20:41.711946 30699 consensus_queue.cc:237] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.713491 30403 raft_consensus.cc:515] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.715906 30403 leader_election.cc:290] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 3 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:41.716778 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:41.717074 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4777204d1f426282e7b3fd406b4c78" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:41.717336 30553 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.717751 30480 raft_consensus.cc:3055] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:41.718113 30480 raft_consensus.cc:740] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:41.718926 30480 consensus_queue.cc:260] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.719813 30480 raft_consensus.cc:3060] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:41.719300 30303 catalog_manager.cc:5697] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 reported cstate change: term changed from 2 to 3, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:41.722961 30553 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 3.
I20260709 12:20:41.723834 30369 leader_election.cc:304] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:41.724587 30750 raft_consensus.cc:2804] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:41.725062 30750 raft_consensus.cc:697] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 3 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:41.725005 30480 raft_consensus.cc:2468] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 3.
I20260709 12:20:41.725888 30750 consensus_queue.cc:237] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.732558 30303 catalog_manager.cc:5697] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 2 to 3, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 3 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.848694 30727 raft_consensus.cc:993] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: : Instructing follower ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.849102 30749 raft_consensus.cc:1081] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 LEADER]: Signalling peer ef0035ae97f8417b8ac0de994031392b to start an election
I20260709 12:20:41.850314 30403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950"
dest_uuid: "ef0035ae97f8417b8ac0de994031392b"
 from {username='slave'} at 127.0.0.1:52558
I20260709 12:20:41.850778 30403 raft_consensus.cc:493] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.851027 30403 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.854913 30403 raft_consensus.cc:515] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.856271 30403 leader_election.cc:290] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Requested vote from peers 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194:40815), e19c4dbf53ae4abd9b0f4ee03715d080 (127.29.143.195:39817)
I20260709 12:20:41.857152 30553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080"
I20260709 12:20:41.857216 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95b8227b27d046b896164dba2d2e6950" candidate_uuid: "ef0035ae97f8417b8ac0de994031392b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3"
I20260709 12:20:41.857735 30553 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.857759 30480 raft_consensus.cc:3055] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:41.858183 30480 raft_consensus.cc:740] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 518c11d7b6dc4299a6ee25c1e71c14d3, State: Running, Role: LEADER
I20260709 12:20:41.858871 30480 consensus_queue.cc:260] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.859714 30480 raft_consensus.cc:3060] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:41.862149 30553 raft_consensus.cc:2468] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:41.863111 30369 leader_election.cc:304] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e19c4dbf53ae4abd9b0f4ee03715d080, ef0035ae97f8417b8ac0de994031392b; no voters: 
I20260709 12:20:41.863448 30480 raft_consensus.cc:2468] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0035ae97f8417b8ac0de994031392b in term 2.
I20260709 12:20:41.863705 30750 raft_consensus.cc:2804] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:41.864198 30750 raft_consensus.cc:697] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Becoming Leader. State: Replica: ef0035ae97f8417b8ac0de994031392b, State: Running, Role: LEADER
I20260709 12:20:41.865077 30750 consensus_queue.cc:237] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } }
I20260709 12:20:41.871507 30303 catalog_manager.cc:5697] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b reported cstate change: term changed from 1 to 2, leader changed from 518c11d7b6dc4299a6ee25c1e71c14d3 (127.29.143.194) to ef0035ae97f8417b8ac0de994031392b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "ef0035ae97f8417b8ac0de994031392b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:41.997699 30403 raft_consensus.cc:1275] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:41.998955 30699 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.009747 30480 raft_consensus.cc:1275] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.012145 30757 consensus_queue.cc:1048] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:42.113664 30480 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 5 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:42.115048 30750 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:42.121055 30553 raft_consensus.cc:1275] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 5 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:42.122581 30751 consensus_queue.cc:1048] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:42.144723 30480 raft_consensus.cc:1275] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.146005 30757 consensus_queue.cc:1048] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.154877 30403 raft_consensus.cc:1275] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Refusing update from remote peer e19c4dbf53ae4abd9b0f4ee03715d080: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.156399 30764 consensus_queue.cc:1048] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0035ae97f8417b8ac0de994031392b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.173884 30553 raft_consensus.cc:1275] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.175432 30751 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:42.184202 30480 raft_consensus.cc:1275] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:42.185573 30769 consensus_queue.cc:1048] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:42.311086 30480 raft_consensus.cc:1275] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:42.312549 30750 consensus_queue.cc:1048] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c11d7b6dc4299a6ee25c1e71c14d3" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:42.321805 30553 raft_consensus.cc:1275] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Refusing update from remote peer ef0035ae97f8417b8ac0de994031392b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:42.325872 30769 consensus_queue.cc:1048] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c4dbf53ae4abd9b0f4ee03715d080" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:42.426601 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.431349 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:42.431676 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:43.432711 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.439081 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:43.439462 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.440367 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.444898 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.445386 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:45.446465 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:45.452086 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:45.452517 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:46.453667 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.459208 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:46.459637 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:47.460762 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.466005 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:47.466383 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:48.661505 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.666354 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:48.666805 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:48.789276 30427 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 30274
W20260709 12:20:48.790041 30427 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 30337
W20260709 12:20:48.790911 30427 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1900 after lost signal to thread 30430
W20260709 12:20:48.791904 30427 debug-util.cc:398] Leaking SignalData structure 0x7b08001f06c0 after lost signal to thread 30506
W20260709 12:20:48.792629 30427 debug-util.cc:398] Leaking SignalData structure 0x7b0800173360 after lost signal to thread 30581
I20260709 12:20:49.667728 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:49.672784 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:49.673203 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:50.674286 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:50.679534 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:50.679952 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:51.710958 30271 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:20:51.711525 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
I20260709 12:20:51.746165 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:51.746994 30271 tablet_replica.cc:333] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.747694 30271 raft_consensus.cc:2243] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.748343 30271 raft_consensus.cc:2272] T 5da9e7664c914241a93647ba8d536c6c P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.750734 30271 tablet_replica.cc:333] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.751291 30271 raft_consensus.cc:2243] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.751753 30271 raft_consensus.cc:2272] T 9fd0a12f954d4e2baf27897ea6348915 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.753432 30271 tablet_replica.cc:333] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.753947 30271 raft_consensus.cc:2243] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.754395 30271 raft_consensus.cc:2272] T d8adbaf9bea14f449015cf925ed25bdb P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.756136 30271 tablet_replica.cc:333] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.756618 30271 raft_consensus.cc:2243] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.757369 30271 raft_consensus.cc:2272] T 95b8227b27d046b896164dba2d2e6950 P ef0035ae97f8417b8ac0de994031392b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.759040 30271 tablet_replica.cc:333] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.759562 30271 raft_consensus.cc:2243] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.759989 30271 raft_consensus.cc:2272] T b79fc19904e24779a3c46e332331cc7f P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.761585 30271 tablet_replica.cc:333] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.762092 30271 raft_consensus.cc:2243] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.762517 30271 raft_consensus.cc:2272] T 9b44fd2d602b4c76bf80f73d72f555d7 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.764127 30271 tablet_replica.cc:333] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.764580 30271 raft_consensus.cc:2243] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.765321 30271 raft_consensus.cc:2272] T 58d75b9b494f4c5a9f131d90ef07a972 P ef0035ae97f8417b8ac0de994031392b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.766924 30271 tablet_replica.cc:333] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.767383 30271 raft_consensus.cc:2243] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.767783 30271 raft_consensus.cc:2272] T a692a4a875df469a8c59d94abb8b7652 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.769423 30271 tablet_replica.cc:333] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b: stopping tablet replica
I20260709 12:20:51.770035 30271 raft_consensus.cc:2243] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.770835 30271 raft_consensus.cc:2272] T ac4777204d1f426282e7b3fd406b4c78 P ef0035ae97f8417b8ac0de994031392b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:51.857249 30446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42493: connect: Connection refused (error 111)
W20260709 12:20:51.862164 30446 consensus_peers.cc:597] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 -> Peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Couldn't send request to peer ef0035ae97f8417b8ac0de994031392b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.864543 30520 consensus_peers.cc:597] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 -> Peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Couldn't send request to peer ef0035ae97f8417b8ac0de994031392b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.866760 30446 consensus_peers.cc:597] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 -> Peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Couldn't send request to peer ef0035ae97f8417b8ac0de994031392b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.883193 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
I20260709 12:20:51.902746 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
W20260709 12:20:51.929490 30446 consensus_peers.cc:597] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 -> Peer ef0035ae97f8417b8ac0de994031392b (127.29.143.193:42493): Couldn't send request to peer ef0035ae97f8417b8ac0de994031392b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.931633 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:51.932447 30271 tablet_replica.cc:333] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.933528 30271 raft_consensus.cc:2243] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.934134 30271 raft_consensus.cc:2272] T 5da9e7664c914241a93647ba8d536c6c P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.936157 30271 tablet_replica.cc:333] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.936638 30271 raft_consensus.cc:2243] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.937122 30271 raft_consensus.cc:2272] T 9fd0a12f954d4e2baf27897ea6348915 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.938810 30271 tablet_replica.cc:333] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.939500 30271 raft_consensus.cc:2243] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.939873 30271 raft_consensus.cc:2272] T 58d75b9b494f4c5a9f131d90ef07a972 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.941363 30271 tablet_replica.cc:333] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.941784 30271 raft_consensus.cc:2243] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.942471 30271 raft_consensus.cc:2272] T a692a4a875df469a8c59d94abb8b7652 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.944043 30271 tablet_replica.cc:333] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.944463 30271 raft_consensus.cc:2243] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.945314 30271 raft_consensus.cc:2272] T 9b44fd2d602b4c76bf80f73d72f555d7 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.946887 30271 tablet_replica.cc:333] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.947366 30271 raft_consensus.cc:2243] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:51.948083 30271 raft_consensus.cc:2272] T b79fc19904e24779a3c46e332331cc7f P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.949671 30271 tablet_replica.cc:333] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.950146 30271 raft_consensus.cc:2243] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.950546 30271 raft_consensus.cc:2272] T 95b8227b27d046b896164dba2d2e6950 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.952298 30271 tablet_replica.cc:333] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.952771 30271 raft_consensus.cc:2243] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.953181 30271 raft_consensus.cc:2272] T d8adbaf9bea14f449015cf925ed25bdb P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.954789 30271 tablet_replica.cc:333] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3: stopping tablet replica
I20260709 12:20:51.955235 30271 raft_consensus.cc:2243] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:51.955634 30271 raft_consensus.cc:2272] T ac4777204d1f426282e7b3fd406b4c78 P 518c11d7b6dc4299a6ee25c1e71c14d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:51.984126 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
I20260709 12:20:52.001715 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
I20260709 12:20:52.027760 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:52.028523 30271 tablet_replica.cc:333] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.029146 30271 raft_consensus.cc:2243] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:52.029955 30271 raft_consensus.cc:2272] T 5da9e7664c914241a93647ba8d536c6c P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.031833 30271 tablet_replica.cc:333] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.032437 30271 raft_consensus.cc:2243] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:52.033169 30271 raft_consensus.cc:2272] T 9fd0a12f954d4e2baf27897ea6348915 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.034853 30271 tablet_replica.cc:333] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.035306 30271 raft_consensus.cc:2243] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.035691 30271 raft_consensus.cc:2272] T 95b8227b27d046b896164dba2d2e6950 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.037288 30271 tablet_replica.cc:333] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.037797 30271 raft_consensus.cc:2243] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.038235 30271 raft_consensus.cc:2272] T b79fc19904e24779a3c46e332331cc7f P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.040056 30271 tablet_replica.cc:333] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.040529 30271 raft_consensus.cc:2243] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:52.041220 30271 raft_consensus.cc:2272] T d8adbaf9bea14f449015cf925ed25bdb P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.042856 30271 tablet_replica.cc:333] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.043288 30271 raft_consensus.cc:2243] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.043684 30271 raft_consensus.cc:2272] T ac4777204d1f426282e7b3fd406b4c78 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.045289 30271 tablet_replica.cc:333] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.045720 30271 raft_consensus.cc:2243] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.046125 30271 raft_consensus.cc:2272] T 58d75b9b494f4c5a9f131d90ef07a972 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.047874 30271 tablet_replica.cc:333] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.048333 30271 raft_consensus.cc:2243] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.048760 30271 raft_consensus.cc:2272] T a692a4a875df469a8c59d94abb8b7652 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.050359 30271 tablet_replica.cc:333] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080: stopping tablet replica
I20260709 12:20:52.050874 30271 raft_consensus.cc:2243] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:52.051291 30271 raft_consensus.cc:2272] T 9b44fd2d602b4c76bf80f73d72f555d7 P e19c4dbf53ae4abd9b0f4ee03715d080 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.076702 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:20:52.093943 30271 master.cc:562] Master@127.29.143.254:38031 shutting down...
I20260709 12:20:52.233530 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:52.234266 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:52.234609 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1428b4ffa211408a9b63a9a2dbadd95a: stopping tablet replica
I20260709 12:20:52.254789 30271 master.cc:584] Master@127.29.143.254:38031 shutdown complete.
518c11d7b6dc4299a6ee25c1e71c14d3  4
e19c4dbf53ae4abd9b0f4ee03715d080  1
ef0035ae97f8417b8ac0de994031392b  4
518c11d7b6dc4299a6ee25c1e71c14d3  3
e19c4dbf53ae4abd9b0f4ee03715d080  3
ef0035ae97f8417b8ac0de994031392b  3
518c11d7b6dc4299a6ee25c1e71c14d3  8
e19c4dbf53ae4abd9b0f4ee03715d080  1
ef0035ae97f8417b8ac0de994031392b  0
518c11d7b6dc4299a6ee25c1e71c14d3  3
e19c4dbf53ae4abd9b0f4ee03715d080  3
ef0035ae97f8417b8ac0de994031392b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31484 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:20:52.297812 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:41629
I20260709 12:20:52.299414 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:52.306310 30787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.306334 30788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.307372 30790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.308156 30271 server_base.cc:1061] running on GCE node
I20260709 12:20:52.309106 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:52.309338 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:52.309554 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599652309532 us; error 0 us; skew 500 ppm
I20260709 12:20:52.310117 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:52.312546 30271 webserver.cc:533] Webserver started at http://127.29.143.254:34681/ using document root <none> and password file <none>
I20260709 12:20:52.313058 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:52.313261 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:52.313539 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:52.314944 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "b757764137d54bdb948465d1235b83aa"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.319298 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:52.322851 30796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.323657 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:52.323939 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "b757764137d54bdb948465d1235b83aa"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.324239 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:52.343699 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:52.344885 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:52.383424 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:41629
I20260709 12:20:52.383536 30847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:41629 every 8 connection(s)
I20260709 12:20:52.387481 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.396736 30848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa: Bootstrap starting.
I20260709 12:20:52.401306 30848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.405633 30848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa: No bootstrap required, opened a new log
I20260709 12:20:52.407713 30848 raft_consensus.cc:359] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER }
I20260709 12:20:52.408139 30848 raft_consensus.cc:385] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.408327 30848 raft_consensus.cc:740] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b757764137d54bdb948465d1235b83aa, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.408789 30848 consensus_queue.cc:260] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER }
I20260709 12:20:52.409192 30848 raft_consensus.cc:399] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:52.409379 30848 raft_consensus.cc:493] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:52.409570 30848 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.413743 30848 raft_consensus.cc:515] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER }
I20260709 12:20:52.414220 30848 leader_election.cc:304] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b757764137d54bdb948465d1235b83aa; no voters: 
I20260709 12:20:52.415294 30848 leader_election.cc:290] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:52.415719 30851 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.417896 30851 raft_consensus.cc:697] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 1 LEADER]: Becoming Leader. State: Replica: b757764137d54bdb948465d1235b83aa, State: Running, Role: LEADER
I20260709 12:20:52.418505 30848 sys_catalog.cc:565] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:52.418623 30851 consensus_queue.cc:237] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER }
I20260709 12:20:52.423866 30852 sys_catalog.cc:455] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b757764137d54bdb948465d1235b83aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER } }
I20260709 12:20:52.424023 30853 sys_catalog.cc:455] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b757764137d54bdb948465d1235b83aa. Latest consensus state: current_term: 1 leader_uuid: "b757764137d54bdb948465d1235b83aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b757764137d54bdb948465d1235b83aa" member_type: VOTER } }
I20260709 12:20:52.424567 30852 sys_catalog.cc:458] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:52.424582 30853 sys_catalog.cc:458] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:52.427968 30860 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:52.432891 30860 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:52.434504 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:52.441596 30860 catalog_manager.cc:1383] Generated new cluster ID: afdf6494e640448eb8fc78aca9a1f257
I20260709 12:20:52.441946 30860 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:52.462196 30860 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:52.463485 30860 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:52.476756 30860 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa: Generated new TSK 0
I20260709 12:20:52.477409 30860 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:52.501123 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:52.507042 30869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.508333 30870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.509928 30872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.510495 30271 server_base.cc:1061] running on GCE node
I20260709 12:20:52.511420 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:52.511674 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:52.511847 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599652511823 us; error 0 us; skew 500 ppm
I20260709 12:20:52.512364 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:52.514724 30271 webserver.cc:533] Webserver started at http://127.29.143.193:42347/ using document root <none> and password file <none>
I20260709 12:20:52.515229 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:52.515442 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:52.515707 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:52.516729 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "4c22594ca07447e9a7783aad0dd7be00"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.521737 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:52.525146 30877 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.526036 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:52.526413 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "4c22594ca07447e9a7783aad0dd7be00"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.526865 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:52.547175 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:52.548570 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:52.550165 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:52.552786 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:52.553071 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.553360 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:52.553540 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.596752 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:43187
I20260709 12:20:52.597036 30940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:43187 every 8 connection(s)
I20260709 12:20:52.602355 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:52.609879 30945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.610359 30946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.618181 30941 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41629
I20260709 12:20:52.618628 30941 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:52.619267 30271 server_base.cc:1061] running on GCE node
W20260709 12:20:52.619357 30948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.619596 30941 heartbeater.cc:507] Master 127.29.143.254:41629 requested a full tablet report, sending...
I20260709 12:20:52.620487 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:52.620713 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:52.620898 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599652620881 us; error 0 us; skew 500 ppm
I20260709 12:20:52.621452 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:52.621882 30813 ts_manager.cc:194] Registered new tserver with Master: 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187)
I20260709 12:20:52.624058 30813 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54266
I20260709 12:20:52.624059 30271 webserver.cc:533] Webserver started at http://127.29.143.194:32977/ using document root <none> and password file <none>
I20260709 12:20:52.624753 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:52.624966 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:52.625247 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:52.626459 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "926b8e2166b64ab49296e0c78bb3bd78"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.630936 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:20:52.634063 30953 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.634817 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:52.635092 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "926b8e2166b64ab49296e0c78bb3bd78"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.635370 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:52.658383 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:52.659667 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:52.661164 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:52.663277 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:52.663508 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.663748 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:52.663919 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.704988 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:43239
I20260709 12:20:52.705055 31015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:43239 every 8 connection(s)
I20260709 12:20:52.710629 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:52.718447 31019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:52.721275 31020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.724012 30271 server_base.cc:1061] running on GCE node
W20260709 12:20:52.723888 31022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:52.725071 31016 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41629
I20260709 12:20:52.725226 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:52.725495 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:52.725564 31016 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:52.725677 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599652725643 us; error 0 us; skew 500 ppm
I20260709 12:20:52.726462 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:52.726809 31016 heartbeater.cc:507] Master 127.29.143.254:41629 requested a full tablet report, sending...
I20260709 12:20:52.729377 30813 ts_manager.cc:194] Registered new tserver with Master: 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:52.729740 30271 webserver.cc:533] Webserver started at http://127.29.143.195:41505/ using document root <none> and password file <none>
I20260709 12:20:52.730188 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:52.730330 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:52.730523 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:52.730898 30813 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54272
I20260709 12:20:52.731825 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "6ac567053eb34071a10ad609b570120d"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.736438 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:52.740437 31027 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.741302 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:20:52.741621 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "6ac567053eb34071a10ad609b570120d"
format_stamp: "Formatted at 2026-07-09 12:20:52 on dist-test-slave-9k85"
I20260709 12:20:52.741941 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:52.761138 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:52.762370 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:52.763813 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:52.765924 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:52.766152 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.766394 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:52.766570 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:52.807078 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:38929
I20260709 12:20:52.807180 31089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:38929 every 8 connection(s)
I20260709 12:20:52.822232 31090 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41629
I20260709 12:20:52.822644 31090 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:52.823410 31090 heartbeater.cc:507] Master 127.29.143.254:41629 requested a full tablet report, sending...
I20260709 12:20:52.825374 30813 ts_manager.cc:194] Registered new tserver with Master: 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:52.826459 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016161213s
I20260709 12:20:52.827337 30813 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54288
I20260709 12:20:52.853399 30813 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54294:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:52.856256 30813 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:52.939998 31051 tablet_service.cc:1511] Processing CreateTablet for tablet 18fdaec7493648269db0ee05a04934ac (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:52.941654 31051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fdaec7493648269db0ee05a04934ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.941934 31053 tablet_service.cc:1511] Processing CreateTablet for tablet 9637f80d25fb405d965bd80db4f6f529 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:52.940129 31055 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9a1dc8c90c420085238d99a1973e64 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:52.943373 31053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9637f80d25fb405d965bd80db4f6f529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.944891 31055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9a1dc8c90c420085238d99a1973e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.947930 31054 tablet_service.cc:1511] Processing CreateTablet for tablet ffa76427ab2144ec93ab248b141190a1 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:52.949349 31054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa76427ab2144ec93ab248b141190a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.949749 30901 tablet_service.cc:1511] Processing CreateTablet for tablet 18fdaec7493648269db0ee05a04934ac (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:52.950174 30900 tablet_service.cc:1511] Processing CreateTablet for tablet 28d7582840ad4f6983e237779a3bea36 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:52.951197 30901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fdaec7493648269db0ee05a04934ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.951900 31052 tablet_service.cc:1511] Processing CreateTablet for tablet 1398125339354a8c91861630534cd865 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:52.952584 30899 tablet_service.cc:1511] Processing CreateTablet for tablet 37c243fc1455490b9b4374b59a4e7a49 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:52.954279 30899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c243fc1455490b9b4374b59a4e7a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.955236 30981 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9a1dc8c90c420085238d99a1973e64 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:52.955976 30902 tablet_service.cc:1511] Processing CreateTablet for tablet 1398125339354a8c91861630534cd865 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:52.956621 30981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9a1dc8c90c420085238d99a1973e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.957367 30902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1398125339354a8c91861630534cd865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.959066 30900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d7582840ad4f6983e237779a3bea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.959893 30903 tablet_service.cc:1511] Processing CreateTablet for tablet 9637f80d25fb405d965bd80db4f6f529 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:52.960122 30980 tablet_service.cc:1511] Processing CreateTablet for tablet ffa76427ab2144ec93ab248b141190a1 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:52.961274 30903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9637f80d25fb405d965bd80db4f6f529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.961532 30980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa76427ab2144ec93ab248b141190a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.963311 30979 tablet_service.cc:1511] Processing CreateTablet for tablet 9637f80d25fb405d965bd80db4f6f529 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:20:52.964085 30898 tablet_service.cc:1511] Processing CreateTablet for tablet 05ffd7a58b0b44fc84af967fd24cd277 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:52.964778 30979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9637f80d25fb405d965bd80db4f6f529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.963311 30972 tablet_service.cc:1511] Processing CreateTablet for tablet 2e050e565a1e4487aedfbb65714e34fa (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:52.965538 30898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ffd7a58b0b44fc84af967fd24cd277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.965368 30905 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9a1dc8c90c420085238d99a1973e64 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:20:52.966221 30972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e050e565a1e4487aedfbb65714e34fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.966912 30905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9a1dc8c90c420085238d99a1973e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.964082 30904 tablet_service.cc:1511] Processing CreateTablet for tablet ffa76427ab2144ec93ab248b141190a1 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:20:52.968061 30904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa76427ab2144ec93ab248b141190a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.967998 30978 tablet_service.cc:1511] Processing CreateTablet for tablet 1398125339354a8c91861630534cd865 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:20:52.969511 30978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1398125339354a8c91861630534cd865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.976459 30973 tablet_service.cc:1511] Processing CreateTablet for tablet 6da68e716fa7465b87febdac7996df5f (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:52.976709 30974 tablet_service.cc:1511] Processing CreateTablet for tablet 05ffd7a58b0b44fc84af967fd24cd277 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:52.976926 31049 tablet_service.cc:1511] Processing CreateTablet for tablet 37c243fc1455490b9b4374b59a4e7a49 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:52.979025 30975 tablet_service.cc:1511] Processing CreateTablet for tablet 37c243fc1455490b9b4374b59a4e7a49 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:20:52.975173 30976 tablet_service.cc:1511] Processing CreateTablet for tablet 28d7582840ad4f6983e237779a3bea36 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:52.980194 31050 tablet_service.cc:1511] Processing CreateTablet for tablet 28d7582840ad4f6983e237779a3bea36 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:20:52.971998 30896 tablet_service.cc:1511] Processing CreateTablet for tablet 2e050e565a1e4487aedfbb65714e34fa (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:52.980538 30973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da68e716fa7465b87febdac7996df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.983515 30896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e050e565a1e4487aedfbb65714e34fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.983992 30974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ffd7a58b0b44fc84af967fd24cd277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.981448 31048 tablet_service.cc:1511] Processing CreateTablet for tablet 05ffd7a58b0b44fc84af967fd24cd277 (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:20:52.971983 30977 tablet_service.cc:1511] Processing CreateTablet for tablet 18fdaec7493648269db0ee05a04934ac (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:20:52.985747 30977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fdaec7493648269db0ee05a04934ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.983511 31047 tablet_service.cc:1511] Processing CreateTablet for tablet 6da68e716fa7465b87febdac7996df5f (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:52.970659 30897 tablet_service.cc:1511] Processing CreateTablet for tablet 6da68e716fa7465b87febdac7996df5f (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:20:52.988528 30897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da68e716fa7465b87febdac7996df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.991106 30976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d7582840ad4f6983e237779a3bea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.991784 30975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c243fc1455490b9b4374b59a4e7a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.980875 31052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1398125339354a8c91861630534cd865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.995972 31048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ffd7a58b0b44fc84af967fd24cd277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.996519 31046 tablet_service.cc:1511] Processing CreateTablet for tablet 2e050e565a1e4487aedfbb65714e34fa (DEFAULT_TABLE table=test-workload [id=48e6526e75854c6cbf97be4bac1dce57]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:20:52.997731 31046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e050e565a1e4487aedfbb65714e34fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:52.999035 31049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c243fc1455490b9b4374b59a4e7a49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:53.002986 31047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da68e716fa7465b87febdac7996df5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:53.006363 31050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d7582840ad4f6983e237779a3bea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:53.066088 31107 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.066535 31106 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.125914 31105 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.138769 31107 tablet_bootstrap.cc:654] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.140774 31105 tablet_bootstrap.cc:654] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.150939 31106 tablet_bootstrap.cc:654] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.162497 31105 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.163048 31105 ts_tablet_manager.cc:1403] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.011s
I20260709 12:20:53.164917 31107 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.165210 31106 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.165423 31107 ts_tablet_manager.cc:1403] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.007s
I20260709 12:20:53.165673 31106 ts_tablet_manager.cc:1403] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.013s
I20260709 12:20:53.166026 31105 raft_consensus.cc:359] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.166785 31105 raft_consensus.cc:385] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.167102 31105 raft_consensus.cc:740] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.167920 31105 consensus_queue.cc:260] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.168625 31107 raft_consensus.cc:359] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.168819 31106 raft_consensus.cc:359] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.169466 31107 raft_consensus.cc:385] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.169590 31106 raft_consensus.cc:385] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.169843 31107 raft_consensus.cc:740] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.169937 31106 raft_consensus.cc:740] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.170128 31090 heartbeater.cc:499] Master 127.29.143.254:41629 was elected leader, sending a full tablet report...
I20260709 12:20:53.170487 31105 ts_tablet_manager.cc:1434] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:53.170753 31106 consensus_queue.cc:260] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.171446 31105 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.170756 31107 consensus_queue.cc:260] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.178279 31106 ts_tablet_manager.cc:1434] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 12:20:53.177834 30941 heartbeater.cc:499] Master 127.29.143.254:41629 was elected leader, sending a full tablet report...
I20260709 12:20:53.179430 31106 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.181042 31105 tablet_bootstrap.cc:654] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.185837 31106 tablet_bootstrap.cc:654] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.212687 31016 heartbeater.cc:499] Master 127.29.143.254:41629 was elected leader, sending a full tablet report...
I20260709 12:20:53.212947 31107 ts_tablet_manager.cc:1434] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.026s
I20260709 12:20:53.213758 31105 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.214031 31107 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.214219 31105 ts_tablet_manager.cc:1403] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.012s
I20260709 12:20:53.217034 31105 raft_consensus.cc:359] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.217792 31105 raft_consensus.cc:385] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.218091 31105 raft_consensus.cc:740] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.219007 31105 consensus_queue.cc:260] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.220384 31107 tablet_bootstrap.cc:654] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.221236 31105 ts_tablet_manager.cc:1434] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:20:53.223672 31105 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.231458 31105 tablet_bootstrap.cc:654] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.267089 31106 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.267691 31106 ts_tablet_manager.cc:1403] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.088s	user 0.047s	sys 0.038s
I20260709 12:20:53.270470 31106 raft_consensus.cc:359] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.271281 31106 raft_consensus.cc:385] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.271642 31106 raft_consensus.cc:740] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.272392 31111 raft_consensus.cc:493] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.272882 31111 raft_consensus.cc:515] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.275395 31111 leader_election.cc:290] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.284718 31106 consensus_queue.cc:260] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.286938 31107 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.287451 31107 ts_tablet_manager.cc:1403] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.074s	user 0.049s	sys 0.021s
I20260709 12:20:53.292682 31106 ts_tablet_manager.cc:1434] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 12:20:53.292929 31105 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.293376 31105 ts_tablet_manager.cc:1403] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.070s	user 0.033s	sys 0.029s
I20260709 12:20:53.293661 31106 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.296298 31105 raft_consensus.cc:359] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.297010 31105 raft_consensus.cc:385] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.297294 31105 raft_consensus.cc:740] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.297906 31105 consensus_queue.cc:260] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.299971 31105 ts_tablet_manager.cc:1434] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:53.300907 31105 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.290915 31107 raft_consensus.cc:359] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.302034 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.303225 31106 tablet_bootstrap.cc:654] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.303535 31107 raft_consensus.cc:385] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.303889 31107 raft_consensus.cc:740] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
W20260709 12:20:53.304608 31029 leader_election.cc:343] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.304646 31107 consensus_queue.cc:260] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.309477 31105 tablet_bootstrap.cc:654] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.314286 31107 ts_tablet_manager.cc:1434] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:20:53.318522 31107 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.320638 31111 raft_consensus.cc:493] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.321476 31111 raft_consensus.cc:515] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.324370 31111 leader_election.cc:290] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.326717 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
W20260709 12:20:53.328591 31029 leader_election.cc:343] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.333113 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.333811 30991 raft_consensus.cc:2468] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.335131 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.335319 31029 leader_election.cc:304] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:53.335860 30990 raft_consensus.cc:2468] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.336553 31111 raft_consensus.cc:2804] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.336935 31111 raft_consensus.cc:493] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.337301 31105 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.337247 31029 leader_election.cc:304] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:53.337534 31111 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.337752 31106 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.337829 31105 ts_tablet_manager.cc:1403] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.022s
I20260709 12:20:53.338330 31106 ts_tablet_manager.cc:1403] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.019s
I20260709 12:20:53.341337 31105 raft_consensus.cc:359] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.342064 31105 raft_consensus.cc:385] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.342368 31105 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.343030 31106 raft_consensus.cc:359] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.343180 31105 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.344324 31106 raft_consensus.cc:385] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.345201 31106 raft_consensus.cc:740] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.346360 31106 consensus_queue.cc:260] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.347601 31107 tablet_bootstrap.cc:654] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.350010 31111 raft_consensus.cc:515] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.351053 31106 ts_tablet_manager.cc:1434] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:20:53.352012 31106 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.352061 31111 leader_election.cc:290] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.352653 31111 raft_consensus.cc:2804] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.352994 31111 raft_consensus.cc:493] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.353328 31111 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.358851 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.363101 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.363880 30990 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.366132 31106 tablet_bootstrap.cc:654] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.368762 31107 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.369308 31107 ts_tablet_manager.cc:1403] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:20:53.372937 31107 raft_consensus.cc:359] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.373624 30990 raft_consensus.cc:2468] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.373901 31107 raft_consensus.cc:385] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.374378 31107 raft_consensus.cc:740] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.376524 31105 ts_tablet_manager.cc:1434] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.018s
I20260709 12:20:53.376345 31107 consensus_queue.cc:260] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.377565 31105 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.377980 31111 raft_consensus.cc:515] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.380757 31111 leader_election.cc:290] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.384094 31105 tablet_bootstrap.cc:654] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.385504 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.388015 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.388767 30991 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.392005 31107 ts_tablet_manager.cc:1434] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:20:53.399230 31029 leader_election.cc:304] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
W20260709 12:20:53.400544 31029 leader_election.cc:343] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.401825 31029 leader_election.cc:343] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.402954 31111 raft_consensus.cc:2804] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.403635 31111 raft_consensus.cc:697] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.403410 31107 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.404767 31111 consensus_queue.cc:237] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.407893 30991 raft_consensus.cc:2468] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.409739 31029 leader_election.cc:304] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:53.410989 31122 raft_consensus.cc:2804] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.412475 31121 raft_consensus.cc:493] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.413048 31121 raft_consensus.cc:515] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.422989 31122 raft_consensus.cc:697] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.423972 31122 consensus_queue.cc:237] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.424502 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.425369 30915 raft_consensus.cc:2468] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.426815 31029 leader_election.cc:304] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
W20260709 12:20:53.430048 30861 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:53.430446 31106 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.431072 31106 ts_tablet_manager.cc:1403] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.030s
I20260709 12:20:53.429663 30811 catalog_manager.cc:5697] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.433255 31107 tablet_bootstrap.cc:654] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.433493 31111 raft_consensus.cc:2804] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.435531 31121 leader_election.cc:290] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.436733 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.435892 31111 raft_consensus.cc:493] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.437460 31111 raft_consensus.cc:3060] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:53.438175 31029 leader_election.cc:343] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.438305 31106 raft_consensus.cc:359] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.441140 31106 raft_consensus.cc:385] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.441450 31106 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.439298 31105 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.442803 31105 ts_tablet_manager.cc:1403] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.032s
I20260709 12:20:53.442252 31106 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.446346 31105 raft_consensus.cc:359] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.447312 31105 raft_consensus.cc:385] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.447839 31105 raft_consensus.cc:740] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.448673 31105 consensus_queue.cc:260] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.450409 31111 raft_consensus.cc:515] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.453981 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.454551 30915 raft_consensus.cc:3060] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.455356 31106 ts_tablet_manager.cc:1434] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:20:53.456532 31105 ts_tablet_manager.cc:1434] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:20:53.457108 31107 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.457492 31105 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.457587 31107 ts_tablet_manager.cc:1403] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.003s
I20260709 12:20:53.462169 30915 raft_consensus.cc:2468] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.462936 31106 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.463209 31107 raft_consensus.cc:359] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.463492 31029 leader_election.cc:304] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.463976 31105 tablet_bootstrap.cc:654] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.464411 31121 raft_consensus.cc:2804] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.465011 31121 raft_consensus.cc:697] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.463961 31107 raft_consensus.cc:385] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.466099 31121 consensus_queue.cc:237] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.467088 31107 raft_consensus.cc:740] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.468824 31107 consensus_queue.cc:260] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.470479 31106 tablet_bootstrap.cc:654] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.472591 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
W20260709 12:20:53.474066 31029 leader_election.cc:343] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.475274 31111 leader_election.cc:290] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.479779 31107 ts_tablet_manager.cc:1434] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:20:53.483769 31106 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.484263 31106 ts_tablet_manager.cc:1403] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 12:20:53.484549 31107 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.484726 31105 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.485174 31105 ts_tablet_manager.cc:1403] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 12:20:53.487061 31106 raft_consensus.cc:359] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.487787 31106 raft_consensus.cc:385] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.488113 31106 raft_consensus.cc:740] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.487910 31105 raft_consensus.cc:359] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.488647 31105 raft_consensus.cc:385] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.488981 31105 raft_consensus.cc:740] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.489070 31106 consensus_queue.cc:260] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.489861 31105 consensus_queue.cc:260] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.492025 31105 ts_tablet_manager.cc:1434] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:53.492923 31105 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.492977 31106 ts_tablet_manager.cc:1434] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:53.493916 31107 tablet_bootstrap.cc:654] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.493958 31106 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.499439 31105 tablet_bootstrap.cc:654] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.500622 31106 tablet_bootstrap.cc:654] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.507442 31107 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.507929 31107 ts_tablet_manager.cc:1403] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 12:20:53.510182 31106 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.510730 31106 ts_tablet_manager.cc:1403] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:20:53.511025 31107 raft_consensus.cc:359] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.511768 31105 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.511775 31107 raft_consensus.cc:385] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.512310 31105 ts_tablet_manager.cc:1403] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:20:53.512269 31107 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.513301 31107 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.515168 31105 raft_consensus.cc:359] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.515975 31105 raft_consensus.cc:385] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.516258 31105 raft_consensus.cc:740] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.516331 31106 raft_consensus.cc:359] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.517045 31106 raft_consensus.cc:385] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.517340 31106 raft_consensus.cc:740] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.517148 31105 consensus_queue.cc:260] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.518146 31106 consensus_queue.cc:260] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.517935 30812 catalog_manager.cc:5697] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.519696 31105 ts_tablet_manager.cc:1434] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:53.520653 31105 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.521008 30812 catalog_manager.cc:5697] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.522334 31106 ts_tablet_manager.cc:1434] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:20:53.523324 31106 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.525537 31107 ts_tablet_manager.cc:1434] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:20:53.526726 31107 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.529771 31106 tablet_bootstrap.cc:654] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.530900 31105 tablet_bootstrap.cc:654] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.532508 31112 raft_consensus.cc:493] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.532976 31112 raft_consensus.cc:515] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.533749 31107 tablet_bootstrap.cc:654] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.535333 31112 leader_election.cc:290] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.545490 31121 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.546056 31121 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.548153 31121 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.549885 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.550529 30991 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.551868 31029 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.553638 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
W20260709 12:20:53.555306 31029 leader_election.cc:343] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.556368 31121 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.556855 31121 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.557266 31121 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.559012 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
W20260709 12:20:53.560813 30879 leader_election.cc:343] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.561822 31107 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.562270 31107 ts_tablet_manager.cc:1403] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.012s
I20260709 12:20:53.565361 31105 tablet_bootstrap.cc:492] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.565785 31105 ts_tablet_manager.cc:1403] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.015s
I20260709 12:20:53.565457 31107 raft_consensus.cc:359] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.566260 31107 raft_consensus.cc:385] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.566571 31107 raft_consensus.cc:740] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.566752 31121 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.567608 31107 consensus_queue.cc:260] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.568296 31105 raft_consensus.cc:359] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.568951 31105 raft_consensus.cc:385] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.569218 31105 raft_consensus.cc:740] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.569862 31105 consensus_queue.cc:260] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.571172 31106 tablet_bootstrap.cc:492] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.571789 31105 ts_tablet_manager.cc:1434] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:53.571724 31106 ts_tablet_manager.cc:1403] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.008s
I20260709 12:20:53.572721 31105 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.575316 31106 raft_consensus.cc:359] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.576118 31106 raft_consensus.cc:385] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.576503 31106 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.577316 31107 ts_tablet_manager.cc:1434] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:20:53.577416 31106 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.579757 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.580304 30915 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.581333 31106 ts_tablet_manager.cc:1434] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:20:53.583398 31107 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.584028 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d" is_pre_election: true
I20260709 12:20:53.584710 31065 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 0.
I20260709 12:20:53.586108 30878 leader_election.cc:304] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:53.586491 31105 tablet_bootstrap.cc:654] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.587257 31112 raft_consensus.cc:2804] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.587661 31112 raft_consensus.cc:493] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.587986 31112 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.591358 31107 tablet_bootstrap.cc:654] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.594003 31106 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.597858 31105 tablet_bootstrap.cc:492] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.598287 31105 ts_tablet_manager.cc:1403] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 12:20:53.600768 31105 raft_consensus.cc:359] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.601128 30915 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.601444 31105 raft_consensus.cc:385] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.601722 31105 raft_consensus.cc:740] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.602243 31029 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.602593 31105 consensus_queue.cc:260] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.603134 31111 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.603593 31111 raft_consensus.cc:697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.604593 31105 ts_tablet_manager.cc:1434] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:53.604375 31111 consensus_queue.cc:237] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
W20260709 12:20:53.606281 30942 tablet.cc:2406] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:53.607366 31105 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: Bootstrap starting.
I20260709 12:20:53.613291 31105 tablet_bootstrap.cc:654] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.617748 31106 tablet_bootstrap.cc:654] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.618876 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.619679 30991 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.624719 31105 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: No bootstrap required, opened a new log
I20260709 12:20:53.625176 31105 ts_tablet_manager.cc:1403] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:20:53.627759 31105 raft_consensus.cc:359] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.628412 31105 raft_consensus.cc:385] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.628849 31107 tablet_bootstrap.cc:492] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.629446 31107 ts_tablet_manager.cc:1403] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.020s
I20260709 12:20:53.628702 30991 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.629607 31121 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.630700 31105 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.616007 31112 raft_consensus.cc:515] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.631418 31106 tablet_bootstrap.cc:492] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.631826 31106 ts_tablet_manager.cc:1403] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.005s
I20260709 12:20:53.633044 31107 raft_consensus.cc:359] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.633610 31107 raft_consensus.cc:385] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.634231 31107 raft_consensus.cc:740] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.634330 31106 raft_consensus.cc:359] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.635017 31106 raft_consensus.cc:385] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.635529 31106 raft_consensus.cc:740] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.635022 31107 consensus_queue.cc:260] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.636174 31106 consensus_queue.cc:260] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.634795 31105 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.638876 31105 ts_tablet_manager.cc:1434] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:20:53.639117 30813 catalog_manager.cc:5697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.642128 31107 ts_tablet_manager.cc:1434] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:53.643239 31107 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.644330 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
W20260709 12:20:53.645923 30879 leader_election.cc:343] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.648730 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:53.649487 31065 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.649987 31107 tablet_bootstrap.cc:654] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.653940 31112 leader_election.cc:290] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.667929 31112 raft_consensus.cc:493] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.669461 31112 raft_consensus.cc:515] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.668380 31065 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 1.
I20260709 12:20:53.671873 30878 leader_election.cc:304] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:53.673754 31112 leader_election.cc:290] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.674556 31112 raft_consensus.cc:2804] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.675240 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d" is_pre_election: true
I20260709 12:20:53.675241 31112 raft_consensus.cc:697] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:53.675972 31065 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 0.
I20260709 12:20:53.676656 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.676959 31106 ts_tablet_manager.cc:1434] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.045s	user 0.020s	sys 0.021s
I20260709 12:20:53.677230 30991 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 0.
I20260709 12:20:53.677613 30878 leader_election.cc:304] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.679016 31151 raft_consensus.cc:2804] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.679435 31151 raft_consensus.cc:493] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.679778 31151 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.679986 31112 consensus_queue.cc:237] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.681972 31106 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.688187 31106 tablet_bootstrap.cc:654] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.692494 31151 raft_consensus.cc:515] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.696372 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.697012 30991 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.699057 31106 tablet_bootstrap.cc:492] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.699529 31106 ts_tablet_manager.cc:1403] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:20:53.702140 31106 raft_consensus.cc:359] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.702930 31106 raft_consensus.cc:385] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.703190 31106 raft_consensus.cc:740] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.703902 31106 consensus_queue.cc:260] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.705293 30991 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 1.
I20260709 12:20:53.705943 31106 ts_tablet_manager.cc:1434] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:53.706485 30879 leader_election.cc:304] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.706794 31106 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: Bootstrap starting.
I20260709 12:20:53.708912 31150 raft_consensus.cc:2804] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.709461 31150 raft_consensus.cc:697] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:53.710505 31150 consensus_queue.cc:237] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.711356 30813 catalog_manager.cc:5697] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.712291 31111 raft_consensus.cc:493] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.712827 31111 raft_consensus.cc:515] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.713666 31106 tablet_bootstrap.cc:654] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.715334 31111 leader_election.cc:290] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.716099 31107 tablet_bootstrap.cc:492] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.716626 31107 ts_tablet_manager.cc:1403] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.035s
I20260709 12:20:53.718743 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.719583 30915 raft_consensus.cc:2468] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.720131 31107 raft_consensus.cc:359] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.720708 31113 raft_consensus.cc:493] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.721055 31107 raft_consensus.cc:385] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.721493 31107 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.721316 31113 raft_consensus.cc:515] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.722446 31107 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.724972 31113 leader_election.cc:290] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.732544 31121 raft_consensus.cc:493] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.733016 31121 raft_consensus.cc:515] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.734840 31151 leader_election.cc:290] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.735509 31121 leader_election.cc:290] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187)
I20260709 12:20:53.736018 31121 raft_consensus.cc:493] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.736147 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:53.736434 31121 raft_consensus.cc:515] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.736905 31065 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.738423 31121 leader_election.cc:290] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.742023 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.742950 30914 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.744925 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.745734 30915 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.747052 31029 leader_election.cc:304] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.748037 31121 raft_consensus.cc:2804] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.748200 31029 leader_election.cc:304] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.748416 31121 raft_consensus.cc:493] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.748764 31121 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.750258 31029 leader_election.cc:304] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.751137 31111 raft_consensus.cc:2804] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.751479 31111 raft_consensus.cc:493] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.751792 31111 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.755971 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.756126 31121 raft_consensus.cc:515] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.756609 30990 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.758297 31121 leader_election.cc:290] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.748943 31122 raft_consensus.cc:2804] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.758903 31122 raft_consensus.cc:493] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.759254 31122 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.759763 31107 ts_tablet_manager.cc:1434] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.043s	user 0.024s	sys 0.008s
I20260709 12:20:53.760720 31107 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.760783 30989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.761569 30989 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.758245 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.763054 30990 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 0.
I20260709 12:20:53.748668 31065 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 1.
I20260709 12:20:53.769913 30989 raft_consensus.cc:2468] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.772573 31107 tablet_bootstrap.cc:654] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.776561 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.777469 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.777820 30914 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 0.
I20260709 12:20:53.778267 30991 raft_consensus.cc:2376] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1. Re-sending same reply.
I20260709 12:20:53.776194 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.779165 30915 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.780429 30955 leader_election.cc:304] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.781405 31157 raft_consensus.cc:2804] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.781771 31157 raft_consensus.cc:493] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.782106 31157 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.791543 30915 raft_consensus.cc:2468] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.792913 31029 leader_election.cc:304] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.793833 31121 raft_consensus.cc:2804] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.794477 31121 raft_consensus.cc:697] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.795557 31121 consensus_queue.cc:237] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.797283 31122 raft_consensus.cc:515] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.813067 31111 raft_consensus.cc:515] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.816011 31107 tablet_bootstrap.cc:492] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.816627 31107 ts_tablet_manager.cc:1403] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.021s
I20260709 12:20:53.818336 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d" is_pre_election: true
I20260709 12:20:53.818140 31157 raft_consensus.cc:515] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.818994 31065 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 0.
I20260709 12:20:53.825997 31122 leader_election.cc:290] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:53.829067 31111 leader_election.cc:290] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187)
I20260709 12:20:53.828985 30812 catalog_manager.cc:5697] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.831861 30813 catalog_manager.cc:5697] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.835664 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.836397 30915 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.838115 31107 raft_consensus.cc:359] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.841328 31107 raft_consensus.cc:385] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.841653 31107 raft_consensus.cc:740] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.843411 31107 consensus_queue.cc:260] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.845140 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.845609 31107 ts_tablet_manager.cc:1434] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:20:53.845679 30914 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.846048 30989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.846665 31107 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: Bootstrap starting.
I20260709 12:20:53.846843 30915 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.847242 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:53.847779 31065 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.846592 30989 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.849823 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:53.850383 30991 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.854818 30914 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 1.
I20260709 12:20:53.856369 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:53.856817 30955 leader_election.cc:304] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.856915 30989 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.856961 30915 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.857363 31106 tablet_bootstrap.cc:492] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: No bootstrap required, opened a new log
I20260709 12:20:53.857857 31106 ts_tablet_manager.cc:1403] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: Time spent bootstrapping tablet: real 0.151s	user 0.040s	sys 0.037s
I20260709 12:20:53.849262 31157 leader_election.cc:290] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.857714 31113 raft_consensus.cc:2804] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.859983 31107 tablet_bootstrap.cc:654] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.860940 31106 raft_consensus.cc:359] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.862920 31106 raft_consensus.cc:385] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.863209 31106 raft_consensus.cc:740] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.863831 31106 consensus_queue.cc:260] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.865196 30915 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.865653 31106 ts_tablet_manager.cc:1434] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:20:53.874846 31107 tablet_bootstrap.cc:492] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: No bootstrap required, opened a new log
I20260709 12:20:53.875555 31107 ts_tablet_manager.cc:1403] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:20:53.877242 31065 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 1.
I20260709 12:20:53.877545 31113 raft_consensus.cc:697] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:20:53.878448 31113 consensus_queue.cc:237] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.879334 31107 raft_consensus.cc:359] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.868728 31029 leader_election.cc:304] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:20:53.880064 31107 raft_consensus.cc:385] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.880470 31107 raft_consensus.cc:740] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.881045 31111 raft_consensus.cc:2804] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.881522 31111 raft_consensus.cc:697] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.881187 31107 consensus_queue.cc:260] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.882194 31111 consensus_queue.cc:237] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.884181 31107 ts_tablet_manager.cc:1434] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:53.887569 31029 leader_election.cc:304] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:53.889102 31121 raft_consensus.cc:2804] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.889569 31121 raft_consensus.cc:697] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:53.889634 30991 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 1.
I20260709 12:20:53.890391 31121 consensus_queue.cc:237] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:53.892365 30812 catalog_manager.cc:5697] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.898414 31150 raft_consensus.cc:493] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.898929 31150 raft_consensus.cc:515] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.900899 31150 leader_election.cc:290] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.895325 31122 consensus_queue.cc:1048] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.901636 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78" is_pre_election: true
I20260709 12:20:53.902385 30991 raft_consensus.cc:2393] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c22594ca07447e9a7783aad0dd7be00 in current term 1: Already voted for candidate 6ac567053eb34071a10ad609b570120d in this term.
I20260709 12:20:53.902357 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d" is_pre_election: true
I20260709 12:20:53.904232 30878 leader_election.cc:304] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00; no voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:53.905279 31150 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.908175 30811 catalog_manager.cc:5697] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.916694 31113 raft_consensus.cc:493] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.917372 31113 raft_consensus.cc:515] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:53.920720 30915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c22594ca07447e9a7783aad0dd7be00" is_pre_election: true
I20260709 12:20:53.921149 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e050e565a1e4487aedfbb65714e34fa" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ac567053eb34071a10ad609b570120d" is_pre_election: true
I20260709 12:20:53.921520 30915 raft_consensus.cc:2393] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 926b8e2166b64ab49296e0c78bb3bd78 in current term 1: Already voted for candidate 6ac567053eb34071a10ad609b570120d in this term.
I20260709 12:20:53.923000 30955 leader_election.cc:304] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 926b8e2166b64ab49296e0c78bb3bd78; no voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d
I20260709 12:20:53.923816 31162 raft_consensus.cc:3060] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.925388 31122 consensus_queue.cc:1048] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.926280 31113 leader_election.cc:290] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:53.927207 31150 raft_consensus.cc:2749] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.928849 30811 catalog_manager.cc:5697] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 1 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.942960 31162 raft_consensus.cc:2749] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.953420 31121 consensus_queue.cc:1048] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.957093 30914 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.963318 31121 consensus_queue.cc:1048] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:53.975162 31121 consensus_queue.cc:1048] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.983340 31122 consensus_queue.cc:1048] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.075626 30991 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.081207 31150 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.090732 31151 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.119762 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.120451 31065 raft_consensus.cc:606] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:54.125911 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.126447 31065 raft_consensus.cc:606] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:54.131450 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.131951 31065 raft_consensus.cc:606] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:54.139120 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.139562 31065 raft_consensus.cc:606] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:20:54.143925 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.144362 31065 raft_consensus.cc:606] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:54.157302 31111 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.159552 31151 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.160544 30914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:45970
I20260709 12:20:54.161126 30914 raft_consensus.cc:606] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Received request to transfer leadership to TS 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:54.164528 31111 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.168704 31064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:20:54.169490 31064 raft_consensus.cc:606] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Received request to transfer leadership to TS 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:20:54.179003 31126 raft_consensus.cc:993] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.179399 31126 raft_consensus.cc:1081] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.183283 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:20:54.183944 30914 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.184367 30914 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.187160 31151 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.187522 31121 consensus_queue.cc:1048] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.197901 30914 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.199647 30913 raft_consensus.cc:1240] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Rejecting Update request from peer 6ac567053eb34071a10ad609b570120d for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:54.201664 31171 raft_consensus.cc:993] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.202106 31171 raft_consensus.cc:1081] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.202307 30914 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.203621 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.204025 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:54.204208 31065 raft_consensus.cc:3055] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.204558 31065 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.204603 30990 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.205447 31065 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.206549 31065 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.211854 30990 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.213050 30879 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.213913 31151 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.214399 31151 raft_consensus.cc:697] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:54.215246 31151 consensus_queue.cc:237] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.217389 31111 consensus_queue.cc:1048] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.218057 31065 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.221026 30913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:20:54.221545 30913 raft_consensus.cc:493] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.221913 30913 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.228221 30913 raft_consensus.cc:515] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.230278 30913 leader_election.cc:290] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.231690 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.231709 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9637f80d25fb405d965bd80db4f6f529" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:54.232283 31065 raft_consensus.cc:3055] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.232649 31065 raft_consensus.cc:740] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.232683 30990 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.233532 31065 consensus_queue.cc:260] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.234724 30811 catalog_manager.cc:5697] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.235903 31065 raft_consensus.cc:3060] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.239965 30990 raft_consensus.cc:2468] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.241132 30879 leader_election.cc:304] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.241963 31150 raft_consensus.cc:2804] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.242424 31150 raft_consensus.cc:697] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:54.242799 31065 raft_consensus.cc:2468] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.243345 31150 consensus_queue.cc:237] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.251287 30809 catalog_manager.cc:5697] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.274989 31162 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.285099 31157 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.316689 31111 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.323486 31121 raft_consensus.cc:993] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.324133 31171 raft_consensus.cc:1081] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.327430 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:20:54.328154 30914 raft_consensus.cc:493] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.328600 30914 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.332746 31171 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.336750 30914 raft_consensus.cc:515] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:54.339936 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.339936 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:54.340626 30991 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.340624 31065 raft_consensus.cc:3055] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.343127 31065 raft_consensus.cc:740] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.343894 31065 consensus_queue.cc:260] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:54.345062 31065 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.346923 30914 leader_election.cc:290] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.346908 30991 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.348599 30879 leader_election.cc:304] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.349318 31150 raft_consensus.cc:2804] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.349820 31150 raft_consensus.cc:697] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:54.350629 31150 consensus_queue.cc:237] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:20:54.352366 31065 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.357542 30811 catalog_manager.cc:5697] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.384363 31171 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.395226 31111 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.402904 31121 raft_consensus.cc:993] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.403364 31111 raft_consensus.cc:1081] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.404793 30991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:36718
I20260709 12:20:54.405285 30991 raft_consensus.cc:493] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.405601 30991 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.410059 30991 raft_consensus.cc:515] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.411830 30991 leader_election.cc:290] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.412679 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:54.412863 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.413187 30914 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.413511 31065 raft_consensus.cc:3055] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.413849 31065 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.414613 31065 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.415589 31065 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.419201 30914 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.420276 30955 leader_election.cc:304] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.420749 31065 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.421147 31157 raft_consensus.cc:2804] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.421602 31157 raft_consensus.cc:697] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:20:54.422389 31157 consensus_queue.cc:237] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.428992 30809 catalog_manager.cc:5697] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.447175 31171 raft_consensus.cc:993] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.447669 31111 raft_consensus.cc:1081] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:20:54.449084 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:20:54.449585 30914 raft_consensus.cc:493] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.449894 30914 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.454578 30914 raft_consensus.cc:515] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.456911 30914 leader_election.cc:290] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.457230 30991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:54.457772 30991 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.457763 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fdaec7493648269db0ee05a04934ac" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.458462 31065 raft_consensus.cc:3055] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.458822 31065 raft_consensus.cc:740] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.459600 31065 consensus_queue.cc:260] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.460796 31065 raft_consensus.cc:3060] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.463034 30991 raft_consensus.cc:2468] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.463960 30879 leader_election.cc:304] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.464692 31150 raft_consensus.cc:2804] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.465076 31150 raft_consensus.cc:697] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:54.465969 31065 raft_consensus.cc:2468] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:20:54.465809 31150 consensus_queue.cc:237] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.472025 30809 catalog_manager.cc:5697] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.516204 31121 raft_consensus.cc:993] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: : Instructing follower 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.516676 31121 raft_consensus.cc:1081] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Signalling peer 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.518286 30991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:36718
I20260709 12:20:54.518924 30991 raft_consensus.cc:493] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.519338 30991 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.524757 30991 raft_consensus.cc:515] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.526527 30991 leader_election.cc:290] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.527318 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:54.527946 30914 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.527634 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da68e716fa7465b87febdac7996df5f" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.528682 31065 raft_consensus.cc:3055] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.529063 31065 raft_consensus.cc:740] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:54.529758 31065 consensus_queue.cc:260] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.530859 31065 raft_consensus.cc:3060] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.533526 30914 raft_consensus.cc:2468] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.534804 30955 leader_election.cc:304] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.535768 31157 raft_consensus.cc:2804] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.536065 31065 raft_consensus.cc:2468] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.536350 31157 raft_consensus.cc:697] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:20:54.537235 31157 consensus_queue.cc:237] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.545328 30811 catalog_manager.cc:5697] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 1 to 2, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.621337 31151 raft_consensus.cc:993] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.621781 31151 raft_consensus.cc:1081] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Signalling peer 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:20:54.623310 30990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:36730
I20260709 12:20:54.623857 30990 raft_consensus.cc:493] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:54.624215 30990 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.629413 30990 raft_consensus.cc:515] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.631213 30990 leader_election.cc:290] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:20:54.632108 31064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:20:54.632297 31065 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.632230 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:54.632747 31064 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.632884 30914 raft_consensus.cc:3055] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:54.633275 30914 raft_consensus.cc:740] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:54.633646 31151 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.634033 30914 consensus_queue.cc:260] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.635214 30914 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:54.638301 31064 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.639480 30954 leader_election.cc:304] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:54.640316 31157 raft_consensus.cc:2804] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:54.640762 31157 raft_consensus.cc:697] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:20:54.641425 30914 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 2.
I20260709 12:20:54.641561 31157 consensus_queue.cc:237] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:54.649726 30990 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.649629 30809 catalog_manager.cc:5697] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 1 to 2, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.651221 31150 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.662837 31064 raft_consensus.cc:1275] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.663971 31150 consensus_queue.cc:1048] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.671914 30990 raft_consensus.cc:1275] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.673419 31112 consensus_queue.cc:1048] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.744175 30990 raft_consensus.cc:1275] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.745532 31112 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.752658 31064 raft_consensus.cc:1275] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.754479 31151 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.844113 30914 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.844863 31064 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:54.845511 31162 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:54.846207 31157 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.036374 31064 raft_consensus.cc:1275] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.037611 31151 consensus_queue.cc:1048] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.047341 30990 raft_consensus.cc:1275] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.049145 31150 consensus_queue.cc:1048] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.058480 31064 raft_consensus.cc:1275] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.059783 31162 consensus_queue.cc:1048] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.068295 30914 raft_consensus.cc:1275] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.069702 31162 consensus_queue.cc:1048] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.134706 31064 raft_consensus.cc:1275] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.136854 31193 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:55.145392 30914 raft_consensus.cc:1275] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:55.147257 31194 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.240070 30271 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:20:57.240897 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.258989 30913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1398125339354a8c91861630534cd865"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:20:57.259539 30913 raft_consensus.cc:606] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Received request to transfer leadership to TS 6ac567053eb34071a10ad609b570120d
I20260709 12:20:57.261801 30913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:20:57.262254 30913 raft_consensus.cc:606] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Received request to transfer leadership to TS 6ac567053eb34071a10ad609b570120d
I20260709 12:20:57.263278 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:57.263758 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.334563 31112 raft_consensus.cc:993] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:20:57.335337 31206 raft_consensus.cc:1081] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Signalling peer 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:20:57.337267 31064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1398125339354a8c91861630534cd865"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:20:57.337777 31064 raft_consensus.cc:493] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.338068 31064 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.342478 31064 raft_consensus.cc:515] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.344234 31064 leader_election.cc:290] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 2 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:57.344950 30913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:57.345201 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:57.345562 30913 raft_consensus.cc:3055] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:57.345705 30990 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.345886 30913 raft_consensus.cc:740] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:57.346724 30913 consensus_queue.cc:260] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.347620 30913 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.350248 30990 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 2.
I20260709 12:20:57.351284 31029 leader_election.cc:304] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:57.351974 31203 raft_consensus.cc:2804] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:57.352164 30913 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 2.
I20260709 12:20:57.352378 31203 raft_consensus.cc:697] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:57.353297 31203 consensus_queue.cc:237] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.359629 30813 catalog_manager.cc:5697] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 1 to 2, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 2 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.657845 31112 raft_consensus.cc:993] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:20:57.658293 31112 raft_consensus.cc:1081] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Signalling peer 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:20:57.659766 31064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:20:57.660245 31064 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:57.660549 31064 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.665031 31064 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.666476 31064 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 3 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:20:57.667357 30913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:20:57.667591 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:20:57.667929 30913 raft_consensus.cc:3055] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:57.668094 30990 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.668252 30913 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:20:57.669049 30913 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.669955 30913 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:57.672789 30990 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 3.
I20260709 12:20:57.673755 31029 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:20:57.674289 30913 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 3.
I20260709 12:20:57.674607 31203 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:57.675153 31203 raft_consensus.cc:697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:20:57.675850 31203 consensus_queue.cc:237] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:20:57.682605 30813 catalog_manager.cc:5697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 2 to 3, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 3 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.891027 30913 raft_consensus.cc:1275] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.892231 31203 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:57.902043 30990 raft_consensus.cc:1275] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:57.903580 31215 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:58.111862 30990 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:58.112964 31215 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:58.122047 30913 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:58.125823 31215 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:58.264760 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.270898 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:58.271250 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:59.272214 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:59.277865 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:59.278240 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:00.279160 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.285763 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:00.286229 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:01.287397 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.293417 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:01.293846 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:02.294999 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.300704 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:02.301129 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:03.302397 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.308318 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:03.308754 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.309639 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.316323 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:04.316836 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:05.317973 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:05.324651 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:05.325192 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:06.326243 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.331971 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:06.332430 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:07.365993 30271 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:21:07.373613 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:21:07.374264 31065 raft_consensus.cc:606] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:21:07.381909 31065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1398125339354a8c91861630534cd865"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:35972
I20260709 12:21:07.382421 31065 raft_consensus.cc:606] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:21:07.404274 30990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:56520
I20260709 12:21:07.404824 30990 raft_consensus.cc:606] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:21:07.410159 30990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:56520
I20260709 12:21:07.410588 30990 raft_consensus.cc:606] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:21:07.415380 30990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
mode: GRACEFUL
new_leader_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:56520
I20260709 12:21:07.415860 30990 raft_consensus.cc:606] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Received request to transfer leadership to TS 4c22594ca07447e9a7783aad0dd7be00
I20260709 12:21:07.447693 31227 raft_consensus.cc:993] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.448117 31227 raft_consensus.cc:1081] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.449668 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45954
I20260709 12:21:07.450198 30914 raft_consensus.cc:493] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.450520 30914 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.455803 30914 raft_consensus.cc:515] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.457743 30914 leader_election.cc:290] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:07.458820 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:07.458822 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:07.459609 30990 raft_consensus.cc:3055] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:07.459686 31065 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.460069 30990 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:21:07.461038 30990 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.462288 30990 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.464918 31065 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.466091 30878 leader_election.cc:304] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:21:07.466935 31112 raft_consensus.cc:2804] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:07.467298 30990 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.468068 31112 raft_consensus.cc:697] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:07.469000 31112 consensus_queue.cc:237] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.472327 31231 raft_consensus.cc:993] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.472998 31227 raft_consensus.cc:1081] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.474797 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45954
I20260709 12:21:07.475256 30914 raft_consensus.cc:493] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.475529 30914 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.476533 30813 catalog_manager.cc:5697] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 2 to 3, leader changed from 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.479931 30914 raft_consensus.cc:515] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.481832 30914 leader_election.cc:290] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:07.482242 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:07.482367 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:07.482963 31065 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.482944 30990 raft_consensus.cc:3055] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:07.486129 30990 raft_consensus.cc:740] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:21:07.487037 30990 consensus_queue.cc:260] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.488078 30990 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:07.487968 31065 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:21:07.489269 30878 leader_election.cc:304] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:21:07.489976 31112 raft_consensus.cc:2804] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:07.490473 31112 raft_consensus.cc:697] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:07.491706 31112 consensus_queue.cc:237] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.493703 30990 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 2.
I20260709 12:21:07.497541 30813 catalog_manager.cc:5697] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 1 to 2, leader changed from 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.531299 31228 raft_consensus.cc:993] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.531854 31215 raft_consensus.cc:1081] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.533187 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:21:07.533650 30914 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.533905 30914 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.538841 30914 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.540513 30914 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 4 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:07.541340 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:07.541568 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:07.541963 30990 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.542081 31065 raft_consensus.cc:3055] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:07.542450 31065 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:21:07.543123 31065 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.545466 31065 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:07.547396 30990 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 4.
I20260709 12:21:07.548667 30879 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:07.548995 31231 raft_consensus.cc:993] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.549366 31112 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:07.549408 31227 raft_consensus.cc:1081] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.550025 31112 raft_consensus.cc:697] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:07.550814 31112 consensus_queue.cc:237] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.551339 31065 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 4.
I20260709 12:21:07.551868 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45954
I20260709 12:21:07.552431 30914 raft_consensus.cc:493] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.552822 30914 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.557978 30914 raft_consensus.cc:515] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.558298 30813 catalog_manager.cc:5697] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 3 to 4, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.559494 30914 leader_election.cc:290] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:07.560178 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:07.562450 30990 raft_consensus.cc:3055] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:07.560499 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ffd7a58b0b44fc84af967fd24cd277" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:07.562753 30990 raft_consensus.cc:740] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:21:07.562924 31065 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.563630 30990 consensus_queue.cc:260] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.564644 30990 raft_consensus.cc:3060] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.568056 31065 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.568941 30878 leader_election.cc:304] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 6ac567053eb34071a10ad609b570120d; no voters: 
I20260709 12:21:07.569657 31112 raft_consensus.cc:2804] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:07.570014 31112 raft_consensus.cc:697] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:07.569960 30990 raft_consensus.cc:2468] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.570955 31112 consensus_queue.cc:237] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.576946 30813 catalog_manager.cc:5697] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 2 to 3, leader changed from 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.598222 31228 raft_consensus.cc:993] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: : Instructing follower 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.598775 31215 raft_consensus.cc:1081] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 LEADER]: Signalling peer 4c22594ca07447e9a7783aad0dd7be00 to start an election
I20260709 12:21:07.600209 30914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1398125339354a8c91861630534cd865"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
 from {username='slave'} at 127.0.0.1:45946
I20260709 12:21:07.600641 30914 raft_consensus.cc:493] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:07.600982 30914 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.605278 30914 raft_consensus.cc:515] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.607018 30914 leader_election.cc:290] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:07.607611 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:07.607860 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1398125339354a8c91861630534cd865" candidate_uuid: "4c22594ca07447e9a7783aad0dd7be00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:07.608178 30990 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.608445 31065 raft_consensus.cc:3055] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:07.608722 31065 raft_consensus.cc:740] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:21:07.609269 31065 consensus_queue.cc:260] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.610062 31065 raft_consensus.cc:3060] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:07.612399 30990 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.613276 30879 leader_election.cc:304] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c22594ca07447e9a7783aad0dd7be00, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:07.613950 31112 raft_consensus.cc:2804] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:07.614321 31112 raft_consensus.cc:697] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Becoming Leader. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:07.614318 31065 raft_consensus.cc:2468] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c22594ca07447e9a7783aad0dd7be00 in term 3.
I20260709 12:21:07.615341 31112 consensus_queue.cc:237] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:07.622783 30813 catalog_manager.cc:5697] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 reported cstate change: term changed from 2 to 3, leader changed from 6ac567053eb34071a10ad609b570120d (127.29.143.195) to 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "4c22594ca07447e9a7783aad0dd7be00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.860957 30990 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.862190 31112 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:07.872643 31065 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.874066 31112 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:07.960246 30990 raft_consensus.cc:1275] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.961642 31232 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:07.972311 31064 raft_consensus.cc:1275] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:07.973711 31232 consensus_queue.cc:1048] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.001600 30990 raft_consensus.cc:1275] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:08.002745 31232 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.010879 31064 raft_consensus.cc:1275] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:08.012359 31245 consensus_queue.cc:1048] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:08.041703 30990 raft_consensus.cc:1275] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.042891 31245 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.045863 31064 raft_consensus.cc:1275] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.046941 31245 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.091355 30990 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:08.092677 31112 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:08.102604 31064 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Refusing update from remote peer 4c22594ca07447e9a7783aad0dd7be00: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:08.104398 31245 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:10.452442 30271 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:21:10.453101 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:10.460220 30914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:21:10.460736 30914 raft_consensus.cc:606] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Received request to transfer leadership to TS 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:21:10.463078 30914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:21:10.463524 30914 raft_consensus.cc:606] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Received request to transfer leadership to TS 926b8e2166b64ab49296e0c78bb3bd78
I20260709 12:21:10.466039 30914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:21:10.466513 30914 raft_consensus.cc:606] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Received request to transfer leadership to TS 6ac567053eb34071a10ad609b570120d
I20260709 12:21:10.467856 31257 raft_consensus.cc:993] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:21:10.468374 31232 raft_consensus.cc:1081] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Signalling peer 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:21:10.469034 30914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
mode: GRACEFUL
new_leader_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:45974
I20260709 12:21:10.469545 30914 raft_consensus.cc:606] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 LEADER]: Received request to transfer leadership to TS 6ac567053eb34071a10ad609b570120d
I20260709 12:21:10.470081 30990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:36730
I20260709 12:21:10.470525 30990 raft_consensus.cc:493] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:10.470547 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:10.470971 30990 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.471272 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:10.475260 30990 raft_consensus.cc:515] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.477362 30990 leader_election.cc:290] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 4 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:10.478134 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:21:10.478499 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d7582840ad4f6983e237779a3bea36" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:10.478755 30914 raft_consensus.cc:3055] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:10.479014 31065 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.479046 30914 raft_consensus.cc:740] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:10.479844 30914 consensus_queue.cc:260] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.480921 30914 raft_consensus.cc:3060] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:10.485212 31065 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 4.
I20260709 12:21:10.486433 30954 leader_election.cc:304] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:10.487056 30914 raft_consensus.cc:2468] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 4.
I20260709 12:21:10.487214 31254 raft_consensus.cc:2804] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:10.488392 31254 raft_consensus.cc:697] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:21:10.489310 31254 consensus_queue.cc:237] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.496622 30811 catalog_manager.cc:5697] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 3 to 4, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:10.616930 31257 raft_consensus.cc:993] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:21:10.617424 31264 raft_consensus.cc:1081] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Signalling peer 926b8e2166b64ab49296e0c78bb3bd78 to start an election
I20260709 12:21:10.619035 30990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49"
dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
 from {username='slave'} at 127.0.0.1:36730
I20260709 12:21:10.619526 30990 raft_consensus.cc:493] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:10.619968 30990 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.624480 30990 raft_consensus.cc:515] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.625895 30990 leader_election.cc:290] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 3 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 6ac567053eb34071a10ad609b570120d (127.29.143.195:38929)
I20260709 12:21:10.626751 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:21:10.626888 31065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c243fc1455490b9b4374b59a4e7a49" candidate_uuid: "926b8e2166b64ab49296e0c78bb3bd78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ac567053eb34071a10ad609b570120d"
I20260709 12:21:10.627259 30914 raft_consensus.cc:3055] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:10.627378 31065 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.627554 30914 raft_consensus.cc:740] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:10.628207 30914 consensus_queue.cc:260] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.629318 30914 raft_consensus.cc:3060] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.632431 31065 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 3.
I20260709 12:21:10.633421 30954 leader_election.cc:304] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:10.634243 31254 raft_consensus.cc:2804] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:10.634519 30914 raft_consensus.cc:2468] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926b8e2166b64ab49296e0c78bb3bd78 in term 3.
I20260709 12:21:10.634763 31254 raft_consensus.cc:697] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 LEADER]: Becoming Leader. State: Replica: 926b8e2166b64ab49296e0c78bb3bd78, State: Running, Role: LEADER
I20260709 12:21:10.635612 31254 consensus_queue.cc:237] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.643002 30811 catalog_manager.cc:5697] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 reported cstate change: term changed from 2 to 3, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "926b8e2166b64ab49296e0c78bb3bd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:10.736626 31232 raft_consensus.cc:993] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:21:10.737129 31264 raft_consensus.cc:1081] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 LEADER]: Signalling peer 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:21:10.738411 31065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:21:10.738837 31065 raft_consensus.cc:493] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:10.739064 31065 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.743114 31065 raft_consensus.cc:515] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.745184 31065 leader_election.cc:290] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 5 election: Requested vote from peers 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187), 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239)
I20260709 12:21:10.745793 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:21:10.746171 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa76427ab2144ec93ab248b141190a1" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:10.746354 30914 raft_consensus.cc:3055] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:21:10.746637 30990 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.746707 30914 raft_consensus.cc:740] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:10.747717 30914 consensus_queue.cc:260] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.748591 30914 raft_consensus.cc:3060] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:21:10.750959 30990 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 5.
I20260709 12:21:10.751982 31029 leader_election.cc:304] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:10.752621 31215 raft_consensus.cc:2804] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:21:10.753121 30914 raft_consensus.cc:2468] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 5.
I20260709 12:21:10.753975 31215 raft_consensus.cc:697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 5 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:21:10.754724 31215 consensus_queue.cc:237] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } }
I20260709 12:21:10.761253 30811 catalog_manager.cc:5697] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 4 to 5, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 5 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:10.794517 31232 raft_consensus.cc:993] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: : Instructing follower 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:21:10.794970 31264 raft_consensus.cc:1081] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Signalling peer 6ac567053eb34071a10ad609b570120d to start an election
I20260709 12:21:10.796231 31065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64"
dest_uuid: "6ac567053eb34071a10ad609b570120d"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:21:10.796669 31065 raft_consensus.cc:493] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:10.796945 31065 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.801154 31065 raft_consensus.cc:515] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:21:10.802593 31065 leader_election.cc:290] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 3 election: Requested vote from peers 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239), 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187)
I20260709 12:21:10.803392 30990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "926b8e2166b64ab49296e0c78bb3bd78"
I20260709 12:21:10.803478 30914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9a1dc8c90c420085238d99a1973e64" candidate_uuid: "6ac567053eb34071a10ad609b570120d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4c22594ca07447e9a7783aad0dd7be00"
I20260709 12:21:10.804068 30990 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.804075 30914 raft_consensus.cc:3055] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:10.804596 30914 raft_consensus.cc:740] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4c22594ca07447e9a7783aad0dd7be00, State: Running, Role: LEADER
I20260709 12:21:10.805411 30914 consensus_queue.cc:260] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:21:10.806490 30914 raft_consensus.cc:3060] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:10.810468 30990 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 3.
I20260709 12:21:10.811546 31029 leader_election.cc:304] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ac567053eb34071a10ad609b570120d, 926b8e2166b64ab49296e0c78bb3bd78; no voters: 
I20260709 12:21:10.812175 31215 raft_consensus.cc:2804] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:10.812498 30914 raft_consensus.cc:2468] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ac567053eb34071a10ad609b570120d in term 3.
I20260709 12:21:10.812546 31215 raft_consensus.cc:697] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Becoming Leader. State: Replica: 6ac567053eb34071a10ad609b570120d, State: Running, Role: LEADER
I20260709 12:21:10.813431 31215 consensus_queue.cc:237] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } }
I20260709 12:21:10.819458 30811 catalog_manager.cc:5697] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d reported cstate change: term changed from 2 to 3, leader changed from 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193) to 6ac567053eb34071a10ad609b570120d (127.29.143.195). New cstate: current_term: 3 leader_uuid: "6ac567053eb34071a10ad609b570120d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:10.924155 30914 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:10.925379 31254 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:10.937633 31065 raft_consensus.cc:1275] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:10.939162 31254 consensus_queue.cc:1048] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:11.029381 31065 raft_consensus.cc:1275] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.031025 31254 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ac567053eb34071a10ad609b570120d" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 38929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:11.043756 30914 raft_consensus.cc:1275] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Refusing update from remote peer 926b8e2166b64ab49296e0c78bb3bd78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.046087 31258 consensus_queue.cc:1048] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:11.171479 30990 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 5 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:11.172919 31215 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:11.187742 30914 raft_consensus.cc:1275] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 5 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:21:11.189944 31215 consensus_queue.cc:1048] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:11.302706 30990 raft_consensus.cc:1275] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.303913 31215 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "926b8e2166b64ab49296e0c78bb3bd78" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 43239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:11.313454 30914 raft_consensus.cc:1275] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Refusing update from remote peer 6ac567053eb34071a10ad609b570120d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.315058 31266 consensus_queue.cc:1048] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c22594ca07447e9a7783aad0dd7be00" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 43187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:11.472501 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:11.478695 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:11.479161 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:12.480233 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:12.485502 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:12.485963 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.486843 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.492120 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:13.492530 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:14.493464 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:14.499343 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:14.499817 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:15.500783 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.506183 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:15.506599 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:16.508244 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:16.514462 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:16.515096 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:17.516186 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.521991 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:17.522439 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:18.523330 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:18.529008 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:18.529428 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:19.530668 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:19.535960 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:19.536412 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:20.567845 30271 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:21:20.568432 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
I20260709 12:21:20.597415 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:20.598217 30271 tablet_replica.cc:333] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.599318 30271 raft_consensus.cc:2243] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.599956 30271 raft_consensus.cc:2272] T 6da68e716fa7465b87febdac7996df5f P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:20.600566 31029 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:21:20.602763 30271 tablet_replica.cc:333] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.603480 30271 raft_consensus.cc:2243] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.603924 30271 raft_consensus.cc:2272] T ffa76427ab2144ec93ab248b141190a1 P 4c22594ca07447e9a7783aad0dd7be00 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:20.603977 31029 consensus_peers.cc:597] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d -> Peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Couldn't send request to peer 4c22594ca07447e9a7783aad0dd7be00. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.605597 30271 tablet_replica.cc:333] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.606153 30271 raft_consensus.cc:2243] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.606559 30271 raft_consensus.cc:2272] T 37c243fc1455490b9b4374b59a4e7a49 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.608183 30271 tablet_replica.cc:333] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.608664 30271 raft_consensus.cc:2243] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.609385 30271 raft_consensus.cc:2272] T 05ffd7a58b0b44fc84af967fd24cd277 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.611083 30271 tablet_replica.cc:333] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.611589 30271 raft_consensus.cc:2243] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.612005 30271 raft_consensus.cc:2272] T 7c9a1dc8c90c420085238d99a1973e64 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.613581 30271 tablet_replica.cc:333] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.614089 30271 raft_consensus.cc:2243] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.614480 30271 raft_consensus.cc:2272] T 28d7582840ad4f6983e237779a3bea36 P 4c22594ca07447e9a7783aad0dd7be00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.616036 30271 tablet_replica.cc:333] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.616503 30271 raft_consensus.cc:2243] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.617190 30271 raft_consensus.cc:2272] T 9637f80d25fb405d965bd80db4f6f529 P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.618908 30271 tablet_replica.cc:333] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.619383 30271 raft_consensus.cc:2243] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.620220 30271 raft_consensus.cc:2272] T 18fdaec7493648269db0ee05a04934ac P 4c22594ca07447e9a7783aad0dd7be00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.621881 30271 tablet_replica.cc:333] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.622341 30271 raft_consensus.cc:2243] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.622761 30271 raft_consensus.cc:2272] T 2e050e565a1e4487aedfbb65714e34fa P 4c22594ca07447e9a7783aad0dd7be00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.624413 30271 tablet_replica.cc:333] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00: stopping tablet replica
I20260709 12:21:20.624851 30271 raft_consensus.cc:2243] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.625597 30271 raft_consensus.cc:2272] T 1398125339354a8c91861630534cd865 P 4c22594ca07447e9a7783aad0dd7be00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.655949 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
I20260709 12:21:20.674629 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
W20260709 12:21:20.679931 31029 consensus_peers.cc:597] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d -> Peer 926b8e2166b64ab49296e0c78bb3bd78 (127.29.143.194:43239): Couldn't send request to peer 926b8e2166b64ab49296e0c78bb3bd78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.701550 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:20.702342 30271 tablet_replica.cc:333] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.703230 30271 raft_consensus.cc:2243] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.704025 30271 raft_consensus.cc:2272] T 28d7582840ad4f6983e237779a3bea36 P 926b8e2166b64ab49296e0c78bb3bd78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.705755 30271 tablet_replica.cc:333] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.706260 30271 raft_consensus.cc:2243] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.706645 30271 raft_consensus.cc:2272] T 9637f80d25fb405d965bd80db4f6f529 P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.708279 30271 tablet_replica.cc:333] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.708935 30271 raft_consensus.cc:2243] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.709390 30271 raft_consensus.cc:2272] T 7c9a1dc8c90c420085238d99a1973e64 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.711221 30271 tablet_replica.cc:333] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.711834 30271 raft_consensus.cc:2243] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.712280 30271 raft_consensus.cc:2272] T 1398125339354a8c91861630534cd865 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.714455 30271 tablet_replica.cc:333] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
W20260709 12:21:20.714844 30955 consensus_peers.cc:597] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 -> Peer 4c22594ca07447e9a7783aad0dd7be00 (127.29.143.193:43187): Couldn't send request to peer 4c22594ca07447e9a7783aad0dd7be00. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:43187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.715175 30271 raft_consensus.cc:2243] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.715730 30271 raft_consensus.cc:2272] T 05ffd7a58b0b44fc84af967fd24cd277 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.717964 30271 tablet_replica.cc:333] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.718783 30271 raft_consensus.cc:2243] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.719718 30271 raft_consensus.cc:2272] T 37c243fc1455490b9b4374b59a4e7a49 P 926b8e2166b64ab49296e0c78bb3bd78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.722105 30271 tablet_replica.cc:333] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.722783 30271 raft_consensus.cc:2243] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.723778 30271 raft_consensus.cc:2272] T 6da68e716fa7465b87febdac7996df5f P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.726183 30271 tablet_replica.cc:333] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.726854 30271 raft_consensus.cc:2243] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.727406 30271 raft_consensus.cc:2272] T ffa76427ab2144ec93ab248b141190a1 P 926b8e2166b64ab49296e0c78bb3bd78 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.729094 30271 tablet_replica.cc:333] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.729532 30271 raft_consensus.cc:2243] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.729861 30271 raft_consensus.cc:2272] T 2e050e565a1e4487aedfbb65714e34fa P 926b8e2166b64ab49296e0c78bb3bd78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.731530 30271 tablet_replica.cc:333] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78: stopping tablet replica
I20260709 12:21:20.731976 30271 raft_consensus.cc:2243] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.732383 30271 raft_consensus.cc:2272] T 18fdaec7493648269db0ee05a04934ac P 926b8e2166b64ab49296e0c78bb3bd78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.761516 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
I20260709 12:21:20.780683 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
I20260709 12:21:20.812562 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:20.813282 30271 tablet_replica.cc:333] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.813877 30271 raft_consensus.cc:2243] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.814370 30271 raft_consensus.cc:2272] T 28d7582840ad4f6983e237779a3bea36 P 6ac567053eb34071a10ad609b570120d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.816437 30271 tablet_replica.cc:333] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.817015 30271 raft_consensus.cc:2243] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.817775 30271 raft_consensus.cc:2272] T 7c9a1dc8c90c420085238d99a1973e64 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.819648 30271 tablet_replica.cc:333] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.820178 30271 raft_consensus.cc:2243] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.820672 30271 raft_consensus.cc:2272] T 1398125339354a8c91861630534cd865 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.822398 30271 tablet_replica.cc:333] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.823027 30271 raft_consensus.cc:2243] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.823462 30271 raft_consensus.cc:2272] T 9637f80d25fb405d965bd80db4f6f529 P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.825191 30271 tablet_replica.cc:333] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.825879 30271 raft_consensus.cc:2243] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.826431 30271 raft_consensus.cc:2272] T 05ffd7a58b0b44fc84af967fd24cd277 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.828366 30271 tablet_replica.cc:333] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.828890 30271 raft_consensus.cc:2243] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.829314 30271 raft_consensus.cc:2272] T 37c243fc1455490b9b4374b59a4e7a49 P 6ac567053eb34071a10ad609b570120d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.831110 30271 tablet_replica.cc:333] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.831614 30271 raft_consensus.cc:2243] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.832057 30271 raft_consensus.cc:2272] T 6da68e716fa7465b87febdac7996df5f P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.833915 30271 tablet_replica.cc:333] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.834447 30271 raft_consensus.cc:2243] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.834904 30271 raft_consensus.cc:2272] T 18fdaec7493648269db0ee05a04934ac P 6ac567053eb34071a10ad609b570120d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.836699 30271 tablet_replica.cc:333] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.837224 30271 raft_consensus.cc:2243] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.838088 30271 raft_consensus.cc:2272] T 2e050e565a1e4487aedfbb65714e34fa P 6ac567053eb34071a10ad609b570120d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.840350 30271 tablet_replica.cc:333] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d: stopping tablet replica
I20260709 12:21:20.840863 30271 raft_consensus.cc:2243] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.841594 30271 raft_consensus.cc:2272] T ffa76427ab2144ec93ab248b141190a1 P 6ac567053eb34071a10ad609b570120d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.871549 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:21:20.891201 30271 master.cc:562] Master@127.29.143.254:41629 shutting down...
I20260709 12:21:20.913872 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.914515 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.914907 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P b757764137d54bdb948465d1235b83aa: stopping tablet replica
I20260709 12:21:20.934234 30271 master.cc:584] Master@127.29.143.254:41629 shutdown complete.
4c22594ca07447e9a7783aad0dd7be00  5
6ac567053eb34071a10ad609b570120d  1
926b8e2166b64ab49296e0c78bb3bd78  4
4c22594ca07447e9a7783aad0dd7be00  3
6ac567053eb34071a10ad609b570120d  3
926b8e2166b64ab49296e0c78bb3bd78  4
4c22594ca07447e9a7783aad0dd7be00  8
6ac567053eb34071a10ad609b570120d  1
926b8e2166b64ab49296e0c78bb3bd78  1
4c22594ca07447e9a7783aad0dd7be00  4
6ac567053eb34071a10ad609b570120d  3
926b8e2166b64ab49296e0c78bb3bd78  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28679 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:21:20.976526 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:45911
I20260709 12:21:20.977648 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:20.983996 31295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:20.984032 31296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:20.984952 31298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:20.985503 30271 server_base.cc:1061] running on GCE node
I20260709 12:21:20.986374 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:20.986543 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:20.986806 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599680986788 us; error 0 us; skew 500 ppm
I20260709 12:21:20.987357 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:20.989578 30271 webserver.cc:533] Webserver started at http://127.29.143.254:37409/ using document root <none> and password file <none>
I20260709 12:21:20.990039 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:20.990228 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:20.990511 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:20.991787 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "79dd877deb754ad9bbc3b169ee250de3"
format_stamp: "Formatted at 2026-07-09 12:21:20 on dist-test-slave-9k85"
I20260709 12:21:20.995911 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:21:20.999084 31303 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:20.999833 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:21:21.000131 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "79dd877deb754ad9bbc3b169ee250de3"
format_stamp: "Formatted at 2026-07-09 12:21:20 on dist-test-slave-9k85"
I20260709 12:21:21.000478 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:21.038185 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:21.039865 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:21.081650 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:45911
I20260709 12:21:21.081818 31356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:45911 every 8 connection(s)
I20260709 12:21:21.086411 31357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.096377 31357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Bootstrap starting.
I20260709 12:21:21.101248 31357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:21.105816 31357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: No bootstrap required, opened a new log
I20260709 12:21:21.108089 31357 raft_consensus.cc:359] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER }
I20260709 12:21:21.108608 31357 raft_consensus.cc:385] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:21.108898 31357 raft_consensus.cc:740] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79dd877deb754ad9bbc3b169ee250de3, State: Initialized, Role: FOLLOWER
I20260709 12:21:21.109498 31357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER }
I20260709 12:21:21.109954 31357 raft_consensus.cc:399] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:21.110191 31357 raft_consensus.cc:493] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:21.110488 31357 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:21.114820 31357 raft_consensus.cc:515] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER }
I20260709 12:21:21.115324 31357 leader_election.cc:304] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79dd877deb754ad9bbc3b169ee250de3; no voters: 
I20260709 12:21:21.116717 31357 leader_election.cc:290] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:21.117063 31360 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:21.118472 31360 raft_consensus.cc:697] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 1 LEADER]: Becoming Leader. State: Replica: 79dd877deb754ad9bbc3b169ee250de3, State: Running, Role: LEADER
I20260709 12:21:21.119244 31360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER }
I20260709 12:21:21.119844 31357 sys_catalog.cc:565] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:21.125907 31361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79dd877deb754ad9bbc3b169ee250de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER } }
I20260709 12:21:21.126405 31361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:21.126632 31362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79dd877deb754ad9bbc3b169ee250de3. Latest consensus state: current_term: 1 leader_uuid: "79dd877deb754ad9bbc3b169ee250de3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79dd877deb754ad9bbc3b169ee250de3" member_type: VOTER } }
I20260709 12:21:21.127194 31362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:21.129045 31368 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:21.137091 31368 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:21.138075 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:21.147097 31368 catalog_manager.cc:1383] Generated new cluster ID: 7734381935d84529b6ec6af2a46cdb38
I20260709 12:21:21.147449 31368 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:21.163025 31368 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:21.164227 31368 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:21.178825 31368 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Generated new TSK 0
I20260709 12:21:21.179523 31368 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:21.204511 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:21.211726 31378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:21.212574 31379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:21.213232 31381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:21.213980 30271 server_base.cc:1061] running on GCE node
I20260709 12:21:21.214813 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:21.214991 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:21.215117 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599681215106 us; error 0 us; skew 500 ppm
I20260709 12:21:21.215590 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:21.217857 30271 webserver.cc:533] Webserver started at http://127.29.143.193:36677/ using document root <none> and password file <none>
I20260709 12:21:21.218276 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:21.218437 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:21.218755 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:21.219945 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "0065979e5b9a477f8abf064563426291"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.224587 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:21:21.228164 31386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.228928 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:21:21.229226 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "0065979e5b9a477f8abf064563426291"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.229508 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:21.243891 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:21.245075 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:21.246490 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:21.248804 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:21.249042 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.249291 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:21.249477 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.291492 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:35273
I20260709 12:21:21.291590 31449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:35273 every 8 connection(s)
I20260709 12:21:21.296417 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:21.304332 31454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:21.307745 31455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:21.309337 31457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:21.310534 30271 server_base.cc:1061] running on GCE node
I20260709 12:21:21.312033 31450 heartbeater.cc:344] Connected to a master server at 127.29.143.254:45911
I20260709 12:21:21.312404 31450 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:21.312412 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:21.312799 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:21.312964 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599681312948 us; error 0 us; skew 500 ppm
I20260709 12:21:21.313310 31450 heartbeater.cc:507] Master 127.29.143.254:45911 requested a full tablet report, sending...
I20260709 12:21:21.313570 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:21.315615 31322 ts_manager.cc:194] Registered new tserver with Master: 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:21.316464 30271 webserver.cc:533] Webserver started at http://127.29.143.194:38285/ using document root <none> and password file <none>
I20260709 12:21:21.317097 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:21.317350 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:21.317651 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:21.318153 31322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44950
I20260709 12:21:21.319240 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "b6bc3d9dbfb44e81b63071002a011f71"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.323879 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:21.327217 31462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.328043 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:21.328462 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "b6bc3d9dbfb44e81b63071002a011f71"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.328778 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:21.379467 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:21.380841 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:21.382412 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:21.384850 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:21.385089 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.385324 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:21.385490 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.429256 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:40303
I20260709 12:21:21.429354 31524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:40303 every 8 connection(s)
I20260709 12:21:21.434705 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:21.443840 31528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:21.445087 31529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:21.448426 31525 heartbeater.cc:344] Connected to a master server at 127.29.143.254:45911
I20260709 12:21:21.448949 31525 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:21.449966 31525 heartbeater.cc:507] Master 127.29.143.254:45911 requested a full tablet report, sending...
W20260709 12:21:21.449965 31531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:21.450841 30271 server_base.cc:1061] running on GCE node
I20260709 12:21:21.451749 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:21.451987 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:21.452183 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599681452161 us; error 0 us; skew 500 ppm
I20260709 12:21:21.452566 31322 ts_manager.cc:194] Registered new tserver with Master: b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:21.452741 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:21.454506 31322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44958
I20260709 12:21:21.455740 30271 webserver.cc:533] Webserver started at http://127.29.143.195:36687/ using document root <none> and password file <none>
I20260709 12:21:21.456481 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:21.456775 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:21.457127 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:21.458405 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "8553a13b444649b9a19e5488aabaf1c5"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.463367 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:21.466876 31536 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.467724 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:21:21.467975 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "8553a13b444649b9a19e5488aabaf1c5"
format_stamp: "Formatted at 2026-07-09 12:21:21 on dist-test-slave-9k85"
I20260709 12:21:21.468246 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:21.485001 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:21.486161 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:21.487640 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:21.489795 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:21.490017 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.490265 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:21.490442 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:21.531910 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:34217
I20260709 12:21:21.532049 31599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:34217 every 8 connection(s)
I20260709 12:21:21.546142 31600 heartbeater.cc:344] Connected to a master server at 127.29.143.254:45911
I20260709 12:21:21.546499 31600 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:21.547266 31600 heartbeater.cc:507] Master 127.29.143.254:45911 requested a full tablet report, sending...
I20260709 12:21:21.549110 31322 ts_manager.cc:194] Registered new tserver with Master: 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:21.549441 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01444445s
I20260709 12:21:21.550544 31322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44974
I20260709 12:21:21.575778 31322 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44978:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:21.581863 31322 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:21.795491 31486 tablet_service.cc:1511] Processing CreateTablet for tablet 79f5f1e9d2894583bcc9bc45a5df0112 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:21.796159 31487 tablet_service.cc:1511] Processing CreateTablet for tablet 27c769ef5464411f973f730390441710 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:21.797081 31486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f5f1e9d2894583bcc9bc45a5df0112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.797533 31490 tablet_service.cc:1511] Processing CreateTablet for tablet b8f83500bdaf49a8ac53bb5ba49c3529 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:21.798997 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f83500bdaf49a8ac53bb5ba49c3529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.800791 31414 tablet_service.cc:1511] Processing CreateTablet for tablet b8f83500bdaf49a8ac53bb5ba49c3529 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:21.800748 31413 tablet_service.cc:1511] Processing CreateTablet for tablet e0a95aee9cae4e239fa037efead078d5 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:21.802219 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f83500bdaf49a8ac53bb5ba49c3529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.804456 31485 tablet_service.cc:1511] Processing CreateTablet for tablet 12a5ef370bb94f5abfccedf7e771d83c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:21.805778 31483 tablet_service.cc:1511] Processing CreateTablet for tablet dad6aaa667ee45cb985fe02da47448e3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:21.805770 31485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a5ef370bb94f5abfccedf7e771d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.807821 31484 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd7b78d2ef1488c970505878e67c6ca (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:21.809324 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd7b78d2ef1488c970505878e67c6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.810956 31488 tablet_service.cc:1511] Processing CreateTablet for tablet 6c70f01b47774cc48e80fabd1ef37f2e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:21.812419 31488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c70f01b47774cc48e80fabd1ef37f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.815045 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6aaa667ee45cb985fe02da47448e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.818250 31407 tablet_service.cc:1511] Processing CreateTablet for tablet dad6aaa667ee45cb985fe02da47448e3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:21.818723 31412 tablet_service.cc:1511] Processing CreateTablet for tablet 6c70f01b47774cc48e80fabd1ef37f2e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:21.820741 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 8b893ed7439d49939f7332cad4722c09 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:21.820978 31411 tablet_service.cc:1511] Processing CreateTablet for tablet 27c769ef5464411f973f730390441710 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:21.823843 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 12a5ef370bb94f5abfccedf7e771d83c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:21.825722 31408 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd7b78d2ef1488c970505878e67c6ca (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:21.827832 31481 tablet_service.cc:1511] Processing CreateTablet for tablet ab86e60df2854213b3c95a365e5f4807 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:21.829133 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab86e60df2854213b3c95a365e5f4807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.818779 31405 tablet_service.cc:1511] Processing CreateTablet for tablet ab86e60df2854213b3c95a365e5f4807 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:21.839993 31482 tablet_service.cc:1511] Processing CreateTablet for tablet 8b893ed7439d49939f7332cad4722c09 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:21.842278 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6aaa667ee45cb985fe02da47448e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.842916 31411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c769ef5464411f973f730390441710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.843626 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c70f01b47774cc48e80fabd1ef37f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.844452 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a5ef370bb94f5abfccedf7e771d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.845089 31408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd7b78d2ef1488c970505878e67c6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.847146 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 79f5f1e9d2894583bcc9bc45a5df0112 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:21.848513 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f5f1e9d2894583bcc9bc45a5df0112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.793628 31489 tablet_service.cc:1511] Processing CreateTablet for tablet e0a95aee9cae4e239fa037efead078d5 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:21.850934 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b893ed7439d49939f7332cad4722c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.852324 31405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab86e60df2854213b3c95a365e5f4807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.853602 31487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c769ef5464411f973f730390441710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.855158 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a95aee9cae4e239fa037efead078d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.856880 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a95aee9cae4e239fa037efead078d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.858337 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b893ed7439d49939f7332cad4722c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.842953 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7370a77bc48eaaa344ded5091445b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:21.859745 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7370a77bc48eaaa344ded5091445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.875336 31485 tablet_service.cc:1511] Processing CreateTablet for tablet 825684763f5c4e2dbf3597dc5a24f7df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:21.876642 31485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825684763f5c4e2dbf3597dc5a24f7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.879848 31563 tablet_service.cc:1511] Processing CreateTablet for tablet e0a95aee9cae4e239fa037efead078d5 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:21.881204 31563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a95aee9cae4e239fa037efead078d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.883869 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 27c769ef5464411f973f730390441710 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:21.885258 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c769ef5464411f973f730390441710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.888263 31559 tablet_service.cc:1511] Processing CreateTablet for tablet 12a5ef370bb94f5abfccedf7e771d83c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:21.890030 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a5ef370bb94f5abfccedf7e771d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.892299 31558 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd7b78d2ef1488c970505878e67c6ca (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:21.894066 31558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd7b78d2ef1488c970505878e67c6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.896325 31557 tablet_service.cc:1511] Processing CreateTablet for tablet dad6aaa667ee45cb985fe02da47448e3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:21.898118 31557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dad6aaa667ee45cb985fe02da47448e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.899932 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 6c70f01b47774cc48e80fabd1ef37f2e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:21.907994 31556 tablet_service.cc:1511] Processing CreateTablet for tablet 8b893ed7439d49939f7332cad4722c09 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:21.909829 31556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b893ed7439d49939f7332cad4722c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.911512 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7370a77bc48eaaa344ded5091445b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:21.913094 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7370a77bc48eaaa344ded5091445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.900957 31564 tablet_service.cc:1511] Processing CreateTablet for tablet b8f83500bdaf49a8ac53bb5ba49c3529 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:21.928555 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f83500bdaf49a8ac53bb5ba49c3529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.899932 31560 tablet_service.cc:1511] Processing CreateTablet for tablet 79f5f1e9d2894583bcc9bc45a5df0112 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:21.935223 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 825684763f5c4e2dbf3597dc5a24f7df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:21.936530 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825684763f5c4e2dbf3597dc5a24f7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.947158 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f5f1e9d2894583bcc9bc45a5df0112. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.955224 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c70f01b47774cc48e80fabd1ef37f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:21.980736 31555 tablet_service.cc:1511] Processing CreateTablet for tablet ab86e60df2854213b3c95a365e5f4807 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:21.990804 31615 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:21.992640 31616 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:21.994903 31555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab86e60df2854213b3c95a365e5f4807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.005999 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 825684763f5c4e2dbf3597dc5a24f7df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:22.008267 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 825684763f5c4e2dbf3597dc5a24f7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.023205 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 08259dcf521e4914917a72febcb040d1 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:22.024549 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08259dcf521e4914917a72febcb040d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.028558 31490 tablet_service.cc:1511] Processing CreateTablet for tablet 08259dcf521e4914917a72febcb040d1 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:22.031477 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 19ad016bcdfe4c62a610fe4974bc52c2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:22.033066 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 41d7370a77bc48eaaa344ded5091445b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:22.034783 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7370a77bc48eaaa344ded5091445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.047721 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08259dcf521e4914917a72febcb040d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.053197 31616 tablet_bootstrap.cc:654] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:21.986231 31407 tablet_service.cc:1511] Processing CreateTablet for tablet 19ad016bcdfe4c62a610fe4974bc52c2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:22.057264 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19ad016bcdfe4c62a610fe4974bc52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.066968 31555 tablet_service.cc:1511] Processing CreateTablet for tablet 19ad016bcdfe4c62a610fe4974bc52c2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:22.068678 31555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19ad016bcdfe4c62a610fe4974bc52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.091253 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 08259dcf521e4914917a72febcb040d1 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:22.092548 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08259dcf521e4914917a72febcb040d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.094493 31406 tablet_service.cc:1511] Processing CreateTablet for tablet a1af086d1060473f980f0bed9af34c07 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:22.095528 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1af086d1060473f980f0bed9af34c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.099138 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19ad016bcdfe4c62a610fe4974bc52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.118748 31483 tablet_service.cc:1511] Processing CreateTablet for tablet a1af086d1060473f980f0bed9af34c07 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:22.118888 31560 tablet_service.cc:1511] Processing CreateTablet for tablet a1af086d1060473f980f0bed9af34c07 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:22.120052 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1af086d1060473f980f0bed9af34c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.120343 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1af086d1060473f980f0bed9af34c07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:22.132232 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:22.133149 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 341ae51396d44edeba0872b9567766e7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:22.134428 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ae51396d44edeba0872b9567766e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.138888 31481 tablet_service.cc:1511] Processing CreateTablet for tablet 341ae51396d44edeba0872b9567766e7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:22.143980 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ae51396d44edeba0872b9567766e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.144344 31564 tablet_service.cc:1511] Processing CreateTablet for tablet 341ae51396d44edeba0872b9567766e7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:22.145637 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ae51396d44edeba0872b9567766e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.147425 31617 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:22.141002 31616 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:22.150992 31616 ts_tablet_manager.cc:1403] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.011s
I20260709 12:21:22.153896 31616 raft_consensus.cc:359] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.156265 31617 tablet_bootstrap.cc:654] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.164217 31617 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:22.164664 31617 ts_tablet_manager.cc:1403] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:21:22.165484 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 076aa0801557438fb22bfc7b11769a33 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:22.166877 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aa0801557438fb22bfc7b11769a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.167410 31490 tablet_service.cc:1511] Processing CreateTablet for tablet 076aa0801557438fb22bfc7b11769a33 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:22.167507 31617 raft_consensus.cc:359] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.168262 31617 raft_consensus.cc:385] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.168591 31617 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.168756 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aa0801557438fb22bfc7b11769a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.168895 31615 tablet_bootstrap.cc:654] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.169525 31617 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.154608 31616 raft_consensus.cc:385] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.172832 31616 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.173645 31616 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.178180 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 076aa0801557438fb22bfc7b11769a33 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:22.179855 31407 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64b21111bd41639226f8d37505e9a7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:22.181072 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64b21111bd41639226f8d37505e9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.183246 31564 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64b21111bd41639226f8d37505e9a7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:22.183648 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 8e64b21111bd41639226f8d37505e9a7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:22.184770 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64b21111bd41639226f8d37505e9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.185364 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 46eaf930cd8a4253b8c4ad7982a44485 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:22.187162 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46eaf930cd8a4253b8c4ad7982a44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.191497 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64b21111bd41639226f8d37505e9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.199122 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aa0801557438fb22bfc7b11769a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.199047 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 46eaf930cd8a4253b8c4ad7982a44485 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:22.200975 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46eaf930cd8a4253b8c4ad7982a44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.227784 31557 tablet_service.cc:1511] Processing CreateTablet for tablet 46eaf930cd8a4253b8c4ad7982a44485 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:22.229341 31557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46eaf930cd8a4253b8c4ad7982a44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.229108 31412 tablet_service.cc:1511] Processing CreateTablet for tablet a899a61b216247dbbb91edb923e9eddf (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:22.230360 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899a61b216247dbbb91edb923e9eddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.233125 31560 tablet_service.cc:1511] Processing CreateTablet for tablet a899a61b216247dbbb91edb923e9eddf (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:22.234375 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899a61b216247dbbb91edb923e9eddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.235244 31414 tablet_service.cc:1511] Processing CreateTablet for tablet d385c04853e749af8fb00afe40a4a255 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:22.236666 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d385c04853e749af8fb00afe40a4a255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.239705 31482 tablet_service.cc:1511] Processing CreateTablet for tablet a899a61b216247dbbb91edb923e9eddf (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:22.240923 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899a61b216247dbbb91edb923e9eddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.265416 31413 tablet_service.cc:1511] Processing CreateTablet for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:22.266295 31617 ts_tablet_manager.cc:1434] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.101s	user 0.025s	sys 0.045s
I20260709 12:21:22.266021 31483 tablet_service.cc:1511] Processing CreateTablet for tablet d385c04853e749af8fb00afe40a4a255 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:22.268355 31481 tablet_service.cc:1511] Processing CreateTablet for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:22.266750 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.267067 31600 heartbeater.cc:499] Master 127.29.143.254:45911 was elected leader, sending a full tablet report...
I20260709 12:21:22.275916 31615 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:22.276453 31615 ts_tablet_manager.cc:1403] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.286s	user 0.007s	sys 0.009s
I20260709 12:21:22.279029 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d385c04853e749af8fb00afe40a4a255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.281273 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.267401 31617 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:22.268164 31561 tablet_service.cc:1511] Processing CreateTablet for tablet d385c04853e749af8fb00afe40a4a255 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:22.291905 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d385c04853e749af8fb00afe40a4a255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.291720 31615 raft_consensus.cc:359] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.292644 31615 raft_consensus.cc:385] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.294857 31616 ts_tablet_manager.cc:1434] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.008s
I20260709 12:21:22.292999 31615 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.298936 31615 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.303331 31450 heartbeater.cc:499] Master 127.29.143.254:45911 was elected leader, sending a full tablet report...
I20260709 12:21:22.313952 31615 ts_tablet_manager.cc:1434] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:21:22.314747 31525 heartbeater.cc:499] Master 127.29.143.254:45911 was elected leader, sending a full tablet report...
I20260709 12:21:22.315078 31615 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:22.321349 31410 tablet_service.cc:1511] Processing CreateTablet for tablet c28624eba07742ab91e568bf551106a4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:22.313535 31557 tablet_service.cc:1511] Processing CreateTablet for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:22.328085 31616 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:22.325197 31414 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:22.329219 31559 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:22.330411 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.331712 31482 tablet_service.cc:1511] Processing CreateTablet for tablet c28624eba07742ab91e568bf551106a4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:22.332428 31560 tablet_service.cc:1511] Processing CreateTablet for tablet c28624eba07742ab91e568bf551106a4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:22.333105 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28624eba07742ab91e568bf551106a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.333817 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28624eba07742ab91e568bf551106a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.333943 31617 tablet_bootstrap.cc:654] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.331676 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:22.322651 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28624eba07742ab91e568bf551106a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.341478 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.341220 31557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.346993 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.350479 31622 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.351068 31622 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.353169 31616 tablet_bootstrap.cc:654] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.353375 31615 tablet_bootstrap.cc:654] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.379155 31622 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.395588 31564 tablet_service.cc:1511] Processing CreateTablet for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:22.401865 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a65ccf8d5e42c1aa51a8761a850dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.380664 31412 tablet_service.cc:1511] Processing CreateTablet for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:22.407735 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a65ccf8d5e42c1aa51a8761a850dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.429472 31557 tablet_service.cc:1511] Processing CreateTablet for tablet 987c407200734c78918f4e63b9c8f16f (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:22.434473 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 97965a28958a4537ae9f58c98ca87319 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:22.434569 31482 tablet_service.cc:1511] Processing CreateTablet for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:22.437398 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97965a28958a4537ae9f58c98ca87319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.437168 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 987c407200734c78918f4e63b9c8f16f (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:22.437726 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a65ccf8d5e42c1aa51a8761a850dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.438714 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987c407200734c78918f4e63b9c8f16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.442744 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 987c407200734c78918f4e63b9c8f16f (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:22.444094 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987c407200734c78918f4e63b9c8f16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.455587 31617 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:22.456123 31617 ts_tablet_manager.cc:1403] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.189s	user 0.018s	sys 0.027s
I20260709 12:21:22.458602 31490 tablet_service.cc:1511] Processing CreateTablet for tablet 97965a28958a4537ae9f58c98ca87319 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:22.459406 31617 raft_consensus.cc:359] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.459961 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97965a28958a4537ae9f58c98ca87319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.460146 31617 raft_consensus.cc:385] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.460443 31617 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.467911 31560 tablet_service.cc:1511] Processing CreateTablet for tablet 97965a28958a4537ae9f58c98ca87319 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:22.461194 31617 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.479212 31484 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa949305b1a42489bcc1e0b4287c6c3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:22.480507 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa949305b1a42489bcc1e0b4287c6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.471928 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:22.474738 31616 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:22.482442 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:22.483112 31616 ts_tablet_manager.cc:1403] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.019s
I20260709 12:21:22.483157 31574 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:22.486195 31616 raft_consensus.cc:359] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.486975 31616 raft_consensus.cc:385] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.486924 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:22.487444 31616 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.488016 31622 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:22.488409 31622 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:22.488132 31616 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.477252 31414 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa949305b1a42489bcc1e0b4287c6c3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:22.480528 31410 tablet_service.cc:1511] Processing CreateTablet for tablet f42c299f626148ba8af55613ab8e9bc4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:22.490584 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa949305b1a42489bcc1e0b4287c6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.490952 31557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987c407200734c78918f4e63b9c8f16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.477159 31481 tablet_service.cc:1511] Processing CreateTablet for tablet f42c299f626148ba8af55613ab8e9bc4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:22.477465 31561 tablet_service.cc:1511] Processing CreateTablet for tablet f42c299f626148ba8af55613ab8e9bc4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:22.488758 31622 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:22.491971 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97965a28958a4537ae9f58c98ca87319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.492363 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42c299f626148ba8af55613ab8e9bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.476238 31615 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:22.495059 31615 ts_tablet_manager.cc:1403] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.180s	user 0.007s	sys 0.013s
I20260709 12:21:22.498031 31615 raft_consensus.cc:359] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.489455 31623 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.498908 31623 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.499496 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42c299f626148ba8af55613ab8e9bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.499730 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42c299f626148ba8af55613ab8e9bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.501243 31622 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.502990 31615 raft_consensus.cc:385] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.506989 31615 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.508560 31622 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.508674 31615 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.509734 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:22.524907 31559 tablet_service.cc:1511] Processing CreateTablet for tablet 5aa949305b1a42489bcc1e0b4287c6c3 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:22.526840 31623 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.531421 31574 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:22.534442 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa949305b1a42489bcc1e0b4287c6c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:22.555428 31390 leader_election.cc:343] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:22.556295 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50667.3us
I20260709 12:21:22.557636 31615 ts_tablet_manager.cc:1434] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.062s	user 0.016s	sys 0.024s
I20260709 12:21:22.558036 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:22.558280 31617 ts_tablet_manager.cc:1434] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260709 12:21:22.559372 31617 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:22.559448 31390 leader_election.cc:343] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.569514 31617 tablet_bootstrap.cc:654] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.570705 31574 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:22.571424 31615 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:22.575420 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:21:22.577140 31466 leader_election.cc:343] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.572129 31616 ts_tablet_manager.cc:1434] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.089s	user 0.011s	sys 0.009s
I20260709 12:21:22.579346 31615 tablet_bootstrap.cc:654] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.579576 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:22.581187 31622 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:22.581874 31622 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:22.583791 31622 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.586241 31616 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:22.589181 31413 tablet_service.cc:1511] Processing CreateTablet for tablet e08d75cdb9c24b78bf644d1554c2c5fe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:22.590462 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d75cdb9c24b78bf644d1554c2c5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.597877 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:22.599215 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ab0d648ab643bf8d74dbe6ee9503d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.605384 31482 tablet_service.cc:1511] Processing CreateTablet for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:22.607232 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ab0d648ab643bf8d74dbe6ee9503d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.609514 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:22.611675 31465 leader_election.cc:343] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.612180 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:22.613438 31623 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:22.613206 31483 tablet_service.cc:1511] Processing CreateTablet for tablet e08d75cdb9c24b78bf644d1554c2c5fe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:22.615496 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d75cdb9c24b78bf644d1554c2c5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.616715 31560 tablet_service.cc:1511] Processing CreateTablet for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:22.624424 31616 tablet_bootstrap.cc:654] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.625228 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ab0d648ab643bf8d74dbe6ee9503d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.630959 31564 tablet_service.cc:1511] Processing CreateTablet for tablet e08d75cdb9c24b78bf644d1554c2c5fe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:22.632433 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d75cdb9c24b78bf644d1554c2c5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.647915 31559 tablet_service.cc:1511] Processing CreateTablet for tablet 5c09d681ba8545a397b540c3565c50ff (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:22.649377 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c09d681ba8545a397b540c3565c50ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.652418 31481 tablet_service.cc:1511] Processing CreateTablet for tablet 5c09d681ba8545a397b540c3565c50ff (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:22.652506 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 5c09d681ba8545a397b540c3565c50ff (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:22.653894 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c09d681ba8545a397b540c3565c50ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.654342 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c09d681ba8545a397b540c3565c50ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.664535 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 7e61fb74a676405696e2d0e6b9027efe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:22.668151 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 7e61fb74a676405696e2d0e6b9027efe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:22.669308 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e61fb74a676405696e2d0e6b9027efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.669905 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e61fb74a676405696e2d0e6b9027efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.668151 31410 tablet_service.cc:1511] Processing CreateTablet for tablet bda3e60a745b4a24a244329f3c923858 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:22.675920 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda3e60a745b4a24a244329f3c923858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.675604 31489 tablet_service.cc:1511] Processing CreateTablet for tablet bda3e60a745b4a24a244329f3c923858 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:22.666393 31622 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.679205 31482 tablet_service.cc:1511] Processing CreateTablet for tablet 91ffe6e1ad36492d95a9cf3251d2894c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:22.680107 31615 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:22.680586 31615 ts_tablet_manager.cc:1403] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.005s
I20260709 12:21:22.681319 31484 tablet_service.cc:1511] Processing CreateTablet for tablet 7e61fb74a676405696e2d0e6b9027efe (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:22.684315 31556 tablet_service.cc:1511] Processing CreateTablet for tablet bda3e60a745b4a24a244329f3c923858 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:22.685911 31556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda3e60a745b4a24a244329f3c923858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.687670 31616 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:22.691738 31321 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:22.692445 31616 ts_tablet_manager.cc:1403] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.010s
I20260709 12:21:22.698828 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda3e60a745b4a24a244329f3c923858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.677738 31622 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.699520 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e61fb74a676405696e2d0e6b9027efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.700536 31482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ffe6e1ad36492d95a9cf3251d2894c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.701229 31622 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.702118 31620 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.702385 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:22.702589 31620 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.703207 31617 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:22.703758 31617 ts_tablet_manager.cc:1403] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.013s
W20260709 12:21:22.704416 31389 leader_election.cc:343] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.705889 31620 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:22.707249 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:22.707469 31617 raft_consensus.cc:359] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.708197 31617 raft_consensus.cc:385] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.708484 31617 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
W20260709 12:21:22.709311 31390 leader_election.cc:343] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.709229 31617 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.709781 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:22.710733 31616 raft_consensus.cc:359] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.721099 31616 raft_consensus.cc:385] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.721660 31616 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.719318 31412 tablet_service.cc:1511] Processing CreateTablet for tablet 91ffe6e1ad36492d95a9cf3251d2894c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:22.710835 31622 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:22.722239 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 21e357624c0f4e5f89de3446133ddb5c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:22.725433 31412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ffe6e1ad36492d95a9cf3251d2894c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.726095 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e357624c0f4e5f89de3446133ddb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.684666 31615 raft_consensus.cc:359] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.726469 31615 raft_consensus.cc:385] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.726864 31615 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.727697 31615 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.731475 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 91ffe6e1ad36492d95a9cf3251d2894c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:22.732893 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ffe6e1ad36492d95a9cf3251d2894c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.736075 31615 ts_tablet_manager.cc:1434] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 12:21:22.726588 31481 tablet_service.cc:1511] Processing CreateTablet for tablet 21e357624c0f4e5f89de3446133ddb5c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:22.737078 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e357624c0f4e5f89de3446133ddb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.737131 31615 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:22.743541 31616 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.745108 31558 tablet_service.cc:1511] Processing CreateTablet for tablet 21e357624c0f4e5f89de3446133ddb5c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:22.745882 31616 ts_tablet_manager.cc:1434] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.002s
I20260709 12:21:22.746556 31558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e357624c0f4e5f89de3446133ddb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.756927 31617 ts_tablet_manager.cc:1434] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:21:22.764817 31483 tablet_service.cc:1511] Processing CreateTablet for tablet f97e5105626c48be9d1768855511628a (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:22.766220 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97e5105626c48be9d1768855511628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.774748 31617 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:22.758504 31616 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:22.788100 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5303969e814b4481d74acd8c7997df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:22.791378 31414 tablet_service.cc:1511] Processing CreateTablet for tablet f97e5105626c48be9d1768855511628a (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:22.792163 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5303969e814b4481d74acd8c7997df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.792860 31414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97e5105626c48be9d1768855511628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.799846 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5303969e814b4481d74acd8c7997df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:22.801141 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5303969e814b4481d74acd8c7997df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.801888 31615 tablet_bootstrap.cc:654] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.787003 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5303969e814b4481d74acd8c7997df (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:22.803596 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5303969e814b4481d74acd8c7997df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.818331 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 0650d5583d6f49e2aba22f8d696283ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:22.820994 31490 tablet_service.cc:1511] Processing CreateTablet for tablet 0650d5583d6f49e2aba22f8d696283ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:22.829015 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650d5583d6f49e2aba22f8d696283ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.836236 31622 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.836977 31622 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.844432 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:22.846196 31617 tablet_bootstrap.cc:654] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.848395 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 46d2c7602ed046c6afb92739319e584c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:22.849889 31616 tablet_bootstrap.cc:654] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:22.850113 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d2c7602ed046c6afb92739319e584c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.804234 31564 tablet_service.cc:1511] Processing CreateTablet for tablet f97e5105626c48be9d1768855511628a (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:21:22.851028 31390 leader_election.cc:343] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.852176 31564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97e5105626c48be9d1768855511628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.854998 31622 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.860755 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 0650d5583d6f49e2aba22f8d696283ea (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:22.862241 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650d5583d6f49e2aba22f8d696283ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.874336 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650d5583d6f49e2aba22f8d696283ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.884932 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 1685dea95ca449998eaf8075418fda96 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:22.886667 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1685dea95ca449998eaf8075418fda96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.900664 31560 tablet_service.cc:1511] Processing CreateTablet for tablet 1685dea95ca449998eaf8075418fda96 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:22.901367 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:22.902019 31558 tablet_service.cc:1511] Processing CreateTablet for tablet 46d2c7602ed046c6afb92739319e584c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:21:22.902631 31389 leader_election.cc:343] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.902781 31407 tablet_service.cc:1511] Processing CreateTablet for tablet 84c7d950f0b944939a3a24f8336687e2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:22.903138 31389 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:22.903448 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 46d2c7602ed046c6afb92739319e584c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:22.904188 31622 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:22.904659 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d2c7602ed046c6afb92739319e584c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.907824 31484 tablet_service.cc:1511] Processing CreateTablet for tablet 84c7d950f0b944939a3a24f8336687e2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:22.906920 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1685dea95ca449998eaf8075418fda96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.909018 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c7d950f0b944939a3a24f8336687e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.911670 31481 tablet_service.cc:1511] Processing CreateTablet for tablet 1685dea95ca449998eaf8075418fda96 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:22.912859 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1685dea95ca449998eaf8075418fda96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.913537 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:22.916651 31623 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.917130 31623 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.919276 31623 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:22.921155 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:21:22.922801 31466 leader_election.cc:343] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.926888 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:22.940889 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 84c7d950f0b944939a3a24f8336687e2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:22.942360 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c7d950f0b944939a3a24f8336687e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.945035 31556 tablet_service.cc:1511] Processing CreateTablet for tablet 60738423610d43149226454d80d6b245 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:22.946254 31556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60738423610d43149226454d80d6b245. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:22.947103 31540 leader_election.cc:343] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:22.948175 31559 tablet_service.cc:1511] Processing CreateTablet for tablet bb26db0e5b834d508281418291d5c108 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:22.948249 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:22.949436 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb26db0e5b834d508281418291d5c108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.954038 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 60738423610d43149226454d80d6b245 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:22.955323 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60738423610d43149226454d80d6b245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.958714 31410 tablet_service.cc:1511] Processing CreateTablet for tablet bb26db0e5b834d508281418291d5c108 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:22.959873 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb26db0e5b834d508281418291d5c108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.963759 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c7d950f0b944939a3a24f8336687e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.963802 31558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d2c7602ed046c6afb92739319e584c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.964000 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 60738423610d43149226454d80d6b245 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:22.968137 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60738423610d43149226454d80d6b245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:22.968219 31616 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:22.968791 31616 ts_tablet_manager.cc:1403] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.222s	user 0.007s	sys 0.029s
I20260709 12:21:22.969170 31489 tablet_service.cc:1511] Processing CreateTablet for tablet bb26db0e5b834d508281418291d5c108 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:22.975836 31616 raft_consensus.cc:359] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.982844 31616 raft_consensus.cc:385] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.983245 31616 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:22.984236 31616 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.985038 31615 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:22.985509 31615 ts_tablet_manager.cc:1403] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.249s	user 0.020s	sys 0.011s
I20260709 12:21:22.988582 31615 raft_consensus.cc:359] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:22.989284 31615 raft_consensus.cc:385] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:22.989576 31615 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
W20260709 12:21:22.948339 31540 leader_election.cc:343] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.011217 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.012130 31620 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:22.990414 31615 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.014714 31617 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.015254 31617 ts_tablet_manager.cc:1403] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.241s	user 0.009s	sys 0.003s
I20260709 12:21:23.018014 31617 raft_consensus.cc:359] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.018754 31617 raft_consensus.cc:385] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.019034 31617 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.019747 31617 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.012491 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb26db0e5b834d508281418291d5c108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.027878 31615 ts_tablet_manager.cc:1434] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:21:23.028316 31616 ts_tablet_manager.cc:1434] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.002s
I20260709 12:21:23.029624 31407 tablet_service.cc:1511] Processing CreateTablet for tablet f615aa4788f84d6fa066cd71bbdaeadb (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:23.034847 31562 tablet_service.cc:1511] Processing CreateTablet for tablet f615aa4788f84d6fa066cd71bbdaeadb (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:21:23.030547 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82234.5us
I20260709 12:21:23.036101 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f615aa4788f84d6fa066cd71bbdaeadb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:23.036005 31465 leader_election.cc:343] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.036473 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:23.037214 31623 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.038371 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f615aa4788f84d6fa066cd71bbdaeadb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.041286 31620 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.041736 31620 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.043632 31620 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:23.045737 31617 ts_tablet_manager.cc:1434] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:21:23.049197 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.049755 31617 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.031304 31484 tablet_service.cc:1511] Processing CreateTablet for tablet f615aa4788f84d6fa066cd71bbdaeadb (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:23.033017 31615 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.034998 31616 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.050983 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f615aa4788f84d6fa066cd71bbdaeadb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.056892 31407 tablet_service.cc:1511] Processing CreateTablet for tablet d4592ece2c344a3a8564f95da501ac46 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:23.057063 31617 tablet_bootstrap.cc:654] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.058137 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4592ece2c344a3a8564f95da501ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.058483 31616 tablet_bootstrap.cc:654] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.060232 31489 tablet_service.cc:1511] Processing CreateTablet for tablet d4592ece2c344a3a8564f95da501ac46 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:23.061381 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4592ece2c344a3a8564f95da501ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.063459 31409 tablet_service.cc:1511] Processing CreateTablet for tablet 70e01c7a1fa14a318bcfcf17308b0c63 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:23.063812 31481 tablet_service.cc:1511] Processing CreateTablet for tablet 70e01c7a1fa14a318bcfcf17308b0c63 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:23.064648 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e01c7a1fa14a318bcfcf17308b0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.065052 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e01c7a1fa14a318bcfcf17308b0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.065660 31562 tablet_service.cc:1511] Processing CreateTablet for tablet d4592ece2c344a3a8564f95da501ac46 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:23.065933 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:23.067049 31540 leader_election.cc:343] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.067941 31556 tablet_service.cc:1511] Processing CreateTablet for tablet 70e01c7a1fa14a318bcfcf17308b0c63 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:23.071574 31406 tablet_service.cc:1511] Processing CreateTablet for tablet cbb15d4732f1472ea96078ec58ddade4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:23.072546 31556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e01c7a1fa14a318bcfcf17308b0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.072774 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb15d4732f1472ea96078ec58ddade4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.080718 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4592ece2c344a3a8564f95da501ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.085580 31483 tablet_service.cc:1511] Processing CreateTablet for tablet cbb15d4732f1472ea96078ec58ddade4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:23.086777 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb15d4732f1472ea96078ec58ddade4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:23.085086 31540 leader_election.cc:343] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.087205 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.087364 31559 tablet_service.cc:1511] Processing CreateTablet for tablet cbb15d4732f1472ea96078ec58ddade4 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:23.092985 31410 tablet_service.cc:1511] Processing CreateTablet for tablet bfceb446d3434b4b8dad1af98ef2db39 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:23.111883 31620 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.116990 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfceb446d3434b4b8dad1af98ef2db39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.118135 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb15d4732f1472ea96078ec58ddade4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.120157 31615 tablet_bootstrap.cc:654] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.126236 31617 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.126739 31617 ts_tablet_manager.cc:1403] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 12:21:23.125939 31481 tablet_service.cc:1511] Processing CreateTablet for tablet bfceb446d3434b4b8dad1af98ef2db39 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:23.128839 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfceb446d3434b4b8dad1af98ef2db39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.130790 31561 tablet_service.cc:1511] Processing CreateTablet for tablet bfceb446d3434b4b8dad1af98ef2db39 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:23.131930 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfceb446d3434b4b8dad1af98ef2db39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:23.134595 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:23.129475 31617 raft_consensus.cc:359] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.139816 31617 raft_consensus.cc:385] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.139904 31616 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.140416 31616 ts_tablet_manager.cc:1403] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.106s	user 0.005s	sys 0.007s
I20260709 12:21:23.140244 31622 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:23.142156 31623 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.142586 31623 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.144282 31616 raft_consensus.cc:359] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.145051 31616 raft_consensus.cc:385] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.145776 31616 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.145399 31617 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.144665 31623 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.147168 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:21:23.152454 31466 leader_election.cc:343] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.152652 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:23.154323 31390 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:23.155390 31615 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.155956 31615 ts_tablet_manager.cc:1403] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.123s	user 0.006s	sys 0.008s
I20260709 12:21:23.155369 31617 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.157642 31574 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:23.159214 31483 tablet_service.cc:1511] Processing CreateTablet for tablet d54aaf3e560149eca7c259e9a3b7e37e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:23.160347 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54aaf3e560149eca7c259e9a3b7e37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.161336 31465 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:21:23.162421 31623 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.162791 31623 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.163100 31623 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.163566 31410 tablet_service.cc:1511] Processing CreateTablet for tablet c4cfa84e581647da8d228ad20eb18205 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:23.164659 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cfa84e581647da8d228ad20eb18205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.167785 31615 raft_consensus.cc:359] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.168515 31615 raft_consensus.cc:385] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.168788 31615 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.171006 31561 tablet_service.cc:1511] Processing CreateTablet for tablet d54aaf3e560149eca7c259e9a3b7e37e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:23.172127 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54aaf3e560149eca7c259e9a3b7e37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.146553 31616 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.180015 31616 ts_tablet_manager.cc:1434] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:21:23.171825 31623 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.183257 31617 ts_tablet_manager.cc:1434] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 12:21:23.169565 31615 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.187175 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:23.187361 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.188031 31574 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:23.188805 31466 leader_election.cc:343] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.192087 31616 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.195261 31617 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.178313 31407 tablet_service.cc:1511] Processing CreateTablet for tablet d54aaf3e560149eca7c259e9a3b7e37e (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:23.186791 31623 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.199152 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54aaf3e560149eca7c259e9a3b7e37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.202294 31616 tablet_bootstrap.cc:654] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.208034 31620 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.208668 31620 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.236547 31615 ts_tablet_manager.cc:1434] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.016s
I20260709 12:21:23.237655 31615 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.240167 31617 tablet_bootstrap.cc:654] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.243391 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:21:23.245154 31540 leader_election.cc:343] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.237618 31574 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:23.246012 31484 tablet_service.cc:1511] Processing CreateTablet for tablet c4cfa84e581647da8d228ad20eb18205 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:23.247421 31465 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:21:23.248723 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.249310 31616 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.249773 31616 ts_tablet_manager.cc:1403] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.009s
I20260709 12:21:23.250131 31653 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:23.250804 31540 leader_election.cc:343] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.251390 31653 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:23.251351 31540 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.252408 31653 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.246547 31615 tablet_bootstrap.cc:654] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.253966 31620 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:23.252568 31616 raft_consensus.cc:359] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.254843 31616 raft_consensus.cc:385] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.255131 31616 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.254494 31620 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.256214 31616 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.269652 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cfa84e581647da8d228ad20eb18205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.273458 31616 ts_tablet_manager.cc:1434] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.007s
I20260709 12:21:23.274046 31653 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.274482 31653 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.275851 31615 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.276320 31615 ts_tablet_manager.cc:1403] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:21:23.277139 31616 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.277319 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.277997 31424 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:23.279063 31615 raft_consensus.cc:359] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.279338 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.279785 31615 raft_consensus.cc:385] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.280129 31615 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.280226 31623 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.280616 31623 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.280938 31623 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.280862 31615 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.282002 31561 tablet_service.cc:1511] Processing CreateTablet for tablet c4cfa84e581647da8d228ad20eb18205 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:23.283082 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cfa84e581647da8d228ad20eb18205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.287843 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.289072 31616 tablet_bootstrap.cc:654] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.290019 31623 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.296964 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:23.297509 31424 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:23.301046 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50297.6us
I20260709 12:21:23.302904 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:23.305810 31465 leader_election.cc:343] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.306366 31653 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.308244 31424 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:23.310005 31409 tablet_service.cc:1511] Processing CreateTablet for tablet e77a183300084f968171dcd68225d026 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:23.310459 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.308976 31623 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.311503 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77a183300084f968171dcd68225d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.311551 31623 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.312242 31623 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:23.311851 31562 tablet_service.cc:1511] Processing CreateTablet for tablet e77a183300084f968171dcd68225d026 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:23.313434 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77a183300084f968171dcd68225d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.313268 31623 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.331313 31483 tablet_service.cc:1511] Processing CreateTablet for tablet e77a183300084f968171dcd68225d026 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:23.332931 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77a183300084f968171dcd68225d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.333561 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:21:23.335129 31465 leader_election.cc:343] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.343029 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 519f567f2eff4e55b84df6d3edde6bc2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:23.349349 31615 ts_tablet_manager.cc:1434] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.073s	user 0.024s	sys 0.006s
I20260709 12:21:23.350418 31615 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.356156 31615 tablet_bootstrap.cc:654] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.362504 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f567f2eff4e55b84df6d3edde6bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.390816 31616 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.391307 31616 ts_tablet_manager.cc:1403] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.027s
I20260709 12:21:23.394110 31616 raft_consensus.cc:359] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.394812 31616 raft_consensus.cc:385] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.394872 31561 tablet_service.cc:1511] Processing CreateTablet for tablet 519f567f2eff4e55b84df6d3edde6bc2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:23.397454 31617 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.398094 31617 ts_tablet_manager.cc:1403] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.203s	user 0.029s	sys 0.026s
I20260709 12:21:23.398473 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 519f567f2eff4e55b84df6d3edde6bc2 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:23.399685 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f567f2eff4e55b84df6d3edde6bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.401155 31617 raft_consensus.cc:359] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.401875 31617 raft_consensus.cc:385] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.401973 31561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f567f2eff4e55b84df6d3edde6bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.402185 31617 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.404312 31409 tablet_service.cc:1511] Processing CreateTablet for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:23.404490 31562 tablet_service.cc:1511] Processing CreateTablet for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:23.405614 31409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.397653 31321 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.405629 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.412357 31559 tablet_service.cc:1511] Processing CreateTablet for tablet 81365ffbeca2466590e0e6d5e449c28b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:23.413550 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81365ffbeca2466590e0e6d5e449c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.413341 31481 tablet_service.cc:1511] Processing CreateTablet for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:23.414306 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 81365ffbeca2466590e0e6d5e449c28b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:23.416167 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 81365ffbeca2466590e0e6d5e449c28b (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:23.414497 31481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e4a1fb5dbb4dca99dc9fbc2881de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.417433 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81365ffbeca2466590e0e6d5e449c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.395161 31616 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.419816 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81365ffbeca2466590e0e6d5e449c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.419577 31616 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.424988 31616 ts_tablet_manager.cc:1434] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.004s
I20260709 12:21:23.426005 31616 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.435204 31663 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.436952 31660 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.437398 31660 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.435779 31663 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.403074 31617 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.447381 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.448707 31616 tablet_bootstrap.cc:654] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.449080 31617 ts_tablet_manager.cc:1434] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:21:23.450850 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.451542 31499 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:23.453644 31556 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed13c6144834a9a9349865442585b12 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:21:23.449275 31389 leader_election.cc:343] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.455870 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:23.456774 31622 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.457132 31622 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.457451 31622 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.459167 31657 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.459638 31657 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.460987 31559 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ba1e461fb4563910a86b4223e918c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:23.442427 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.439484 31660 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.463758 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:23.464881 31390 leader_election.cc:343] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.461814 31657 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.457535 31616 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.448717 31663 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.465942 31622 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.468698 31623 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.469364 31483 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed13c6144834a9a9349865442585b12 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:23.483296 31623 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.483981 31622 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.469627 31407 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ba1e461fb4563910a86b4223e918c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:23.485203 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.485577 31407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ba1e461fb4563910a86b4223e918c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.487860 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:21:23.489311 31466 leader_election.cc:343] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.490818 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.491432 31572 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
W20260709 12:21:23.492385 31389 leader_election.cc:343] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.493506 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:21:23.494484 31662 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.494911 31662 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.471454 31484 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ba1e461fb4563910a86b4223e918c (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:23.495240 31662 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.495667 31410 tablet_service.cc:1511] Processing CreateTablet for tablet 92b3a623c9be4f43853d9eeb42b92968 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:23.473193 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.471580 31406 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed13c6144834a9a9349865442585b12 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:23.496739 31410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b3a623c9be4f43853d9eeb42b92968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.496677 31574 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:23.474736 31413 tablet_service.cc:1511] Processing CreateTablet for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:23.498281 31489 tablet_service.cc:1511] Processing CreateTablet for tablet 92b3a623c9be4f43853d9eeb42b92968 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:23.471024 31616 ts_tablet_manager.cc:1403] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.007s
I20260709 12:21:23.485323 31623 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.478644 31617 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:23.466081 31390 leader_election.cc:343] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.501348 31616 raft_consensus.cc:359] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.471632 31556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed13c6144834a9a9349865442585b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.502830 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:23.503424 31500 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.473377 31560 tablet_service.cc:1511] Processing CreateTablet for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:23.505043 31560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.483997 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed13c6144834a9a9349865442585b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.507401 31484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ba1e461fb4563910a86b4223e918c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.501998 31616 raft_consensus.cc:385] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.508005 31616 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.508694 31616 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.477283 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.509646 31389 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.510061 31573 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:23.497339 31406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed13c6144834a9a9349865442585b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.481746 31490 tablet_service.cc:1511] Processing CreateTablet for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:23.513880 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.471007 31615 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.514963 31413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.515300 31615 ts_tablet_manager.cc:1403] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.165s	user 0.028s	sys 0.000s
I20260709 12:21:23.478586 31656 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.519150 31656 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.521324 31656 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:23.522250 31616 ts_tablet_manager.cc:1434] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.001s
I20260709 12:21:23.522383 31617 tablet_bootstrap.cc:654] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.523182 31616 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.526852 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.527482 31499 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:23.528491 31616 tablet_bootstrap.cc:654] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.529170 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.529451 31663 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.529812 31663 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.529827 31424 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:23.530184 31663 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.532979 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.537735 31656 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.538136 31656 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.538435 31656 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.538475 31559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ba1e461fb4563910a86b4223e918c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.542109 31617 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.542610 31617 ts_tablet_manager.cc:1403] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.007s
I20260709 12:21:23.543380 31500 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:23.544771 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:23.545408 31617 raft_consensus.cc:359] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.545854 31622 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.546166 31617 raft_consensus.cc:385] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.546392 31622 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:23.547632 31662 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.547575 31622 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.546496 31617 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.550916 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:23.551623 31617 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:23.552079 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54221us
W20260709 12:21:23.552357 31466 leader_election.cc:343] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.553112 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.553959 31617 ts_tablet_manager.cc:1434] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:21:23.553887 31657 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.554399 31657 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.554745 31657 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.554611 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.555505 31573 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.556623 31616 tablet_bootstrap.cc:492] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.557072 31616 ts_tablet_manager.cc:1403] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:21:23.518448 31615 raft_consensus.cc:359] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.559628 31616 raft_consensus.cc:359] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.560002 31615 raft_consensus.cc:385] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.560273 31616 raft_consensus.cc:385] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.560428 31615 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.560577 31616 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.561324 31616 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.561439 31615 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.563531 31616 ts_tablet_manager.cc:1434] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:23.564414 31616 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.564528 31489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b3a623c9be4f43853d9eeb42b92968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.566756 31562 tablet_service.cc:1511] Processing CreateTablet for tablet 92b3a623c9be4f43853d9eeb42b92968 (DEFAULT_TABLE table=test-workload [id=59ab1996fef44b9ab26a01f942f775e5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:23.567936 31562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b3a623c9be4f43853d9eeb42b92968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:23.570119 31616 tablet_bootstrap.cc:654] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.555051 31617 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.561770 31657 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.577934 31617 tablet_bootstrap.cc:654] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.578509 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:21:23.579896 31390 leader_election.cc:343] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.582944 31616 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.583370 31616 ts_tablet_manager.cc:1403] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 12:21:23.546532 31663 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.584571 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.585211 31574 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.585902 31616 raft_consensus.cc:359] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.590418 31617 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.590750 31662 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.590888 31617 ts_tablet_manager.cc:1403] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 12:21:23.592779 31615 ts_tablet_manager.cc:1434] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 12:21:23.599491 31615 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.599570 31657 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.593685 31617 raft_consensus.cc:359] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.602895 31617 raft_consensus.cc:385] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.586513 31616 raft_consensus.cc:385] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.603302 31616 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.604099 31616 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.602916 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:23.603197 31617 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.605726 31663 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.606017 31616 ts_tablet_manager.cc:1434] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:21:23.606318 31617 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.606902 31616 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.608352 31617 ts_tablet_manager.cc:1434] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:21:23.610984 31573 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
W20260709 12:21:23.611815 31390 leader_election.cc:343] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.612663 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:21:23.613449 31662 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.613895 31662 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:23.614706 31662 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.617971 31574 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:23.619067 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.619072 31656 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.620337 31622 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.620811 31622 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:23.621155 31656 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:23.621641 31622 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.624379 31615 tablet_bootstrap.cc:654] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.627282 31616 tablet_bootstrap.cc:654] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.617980 31321 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.628594 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:23.629153 31500 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.631155 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:23.631721 31424 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.632884 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.633436 31572 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.631176 31617 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.642596 31622 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.655536 31617 tablet_bootstrap.cc:654] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.658833 31623 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:23.661902 31500 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:23.655280 31622 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.663432 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.664383 31622 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.665294 31656 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.665932 31656 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:23.668169 31656 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.668987 31424 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:23.676788 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:23.678500 31390 leader_election.cc:343] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.673092 31319 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.685636 31616 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.686131 31616 ts_tablet_manager.cc:1403] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.019s
I20260709 12:21:23.687095 31572 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:23.690243 31389 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.690527 31616 raft_consensus.cc:359] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.691233 31616 raft_consensus.cc:385] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.691427 31622 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.691493 31616 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.692092 31622 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:23.692432 31616 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.692014 31321 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.693373 31622 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.693928 31615 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.694391 31615 ts_tablet_manager.cc:1403] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.029s
I20260709 12:21:23.694499 31616 ts_tablet_manager.cc:1434] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:21:23.695369 31526 tablet.cc:2406] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:23.695555 31616 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.698235 31500 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.700963 31615 raft_consensus.cc:359] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.698151 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.727995 31615 raft_consensus.cc:385] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.728365 31615 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.729511 31616 tablet_bootstrap.cc:654] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.729530 31615 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.729465 31663 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.733652 31663 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.736439 31663 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:23.738386 31389 leader_election.cc:343] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.738868 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.739946 31663 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.737916 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.732842 31657 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.745203 31499 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:23.758430 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.759047 31574 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:23.759935 31617 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.759977 31390 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.760459 31617 ts_tablet_manager.cc:1403] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.015s
I20260709 12:21:23.761052 31663 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.748760 31657 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.761420 31663 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.761835 31663 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.764830 31617 raft_consensus.cc:359] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.765313 31617 raft_consensus.cc:385] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.765530 31617 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.766603 31617 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.769490 31617 ts_tablet_manager.cc:1434] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:23.770586 31617 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.770787 31424 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.774740 31616 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.775192 31616 ts_tablet_manager.cc:1403] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.009s
I20260709 12:21:23.776611 31615 ts_tablet_manager.cc:1434] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.021s
I20260709 12:21:23.777407 31615 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.779453 31617 tablet_bootstrap.cc:654] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.781059 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.786398 31657 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.784578 31320 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.788563 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.789573 31572 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:23.791208 31615 tablet_bootstrap.cc:654] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.791272 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.792732 31657 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.803444 31663 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.804930 31656 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.806990 31656 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.809743 31656 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:23.806552 31616 raft_consensus.cc:359] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.811753 31616 raft_consensus.cc:385] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.812161 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.812668 31657 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:23.814119 31540 leader_election.cc:343] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.814250 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:23.816918 31540 leader_election.cc:343] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.812165 31616 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.817346 31686 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:23.817636 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.818868 31656 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.820020 31616 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.822583 31616 ts_tablet_manager.cc:1434] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 12:21:23.823840 31616 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.826241 31321 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.829985 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:23.830624 31499 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.832769 31616 tablet_bootstrap.cc:654] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.835507 31653 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:21:23.836625 31653 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.840612 31653 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.842015 31499 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:23.843088 31390 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.844133 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.844461 31657 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:23.845146 31657 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:21:23.845750 31465 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:23.846304 31657 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.850962 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.852972 31466 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:23.854005 31663 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.854331 31653 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:23.858733 31615 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.859192 31615 ts_tablet_manager.cc:1403] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.082s	user 0.028s	sys 0.032s
I20260709 12:21:23.865020 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:23.865733 31572 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.867434 31615 raft_consensus.cc:359] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.868157 31615 raft_consensus.cc:385] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.868479 31615 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.869860 31615 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.872598 31615 ts_tablet_manager.cc:1434] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:23.873551 31615 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.874574 31686 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:23.876077 31572 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:23.879695 31617 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.880074 31617 ts_tablet_manager.cc:1403] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.006s
I20260709 12:21:23.882453 31615 tablet_bootstrap.cc:654] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.885432 31616 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.885865 31616 ts_tablet_manager.cc:1403] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.005s
I20260709 12:21:23.888391 31617 raft_consensus.cc:359] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.889284 31617 raft_consensus.cc:385] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.890094 31617 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.890985 31617 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.893590 31617 ts_tablet_manager.cc:1434] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 12:21:23.893950 31320 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:23.895186 31617 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.899714 31616 raft_consensus.cc:359] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.900017 31657 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.900429 31616 raft_consensus.cc:385] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.900802 31616 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.900702 31657 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.902062 31616 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.903833 31657 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.904469 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:23.905632 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:23.905817 31390 leader_election.cc:343] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.907572 31616 ts_tablet_manager.cc:1434] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:21:23.908485 31616 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.908632 31617 tablet_bootstrap.cc:654] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:23.909636 31389 leader_election.cc:343] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:23.910364 31615 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.910154 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:23.910964 31615 ts_tablet_manager.cc:1403] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.012s
I20260709 12:21:23.912892 31686 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.913424 31686 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.915647 31686 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:23.915989 31657 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.917956 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.918660 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.919725 31572 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 1: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:21:23.921093 31465 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:23.923098 31653 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:23.924546 31615 raft_consensus.cc:359] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.925509 31615 raft_consensus.cc:385] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.926223 31615 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.927204 31615 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.930428 31615 ts_tablet_manager.cc:1434] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:21:23.931532 31615 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.932268 31617 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.932720 31617 ts_tablet_manager.cc:1403] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.018s
I20260709 12:21:23.935316 31617 raft_consensus.cc:359] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.935964 31617 raft_consensus.cc:385] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.936199 31617 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.937203 31615 tablet_bootstrap.cc:654] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.938516 31616 tablet_bootstrap.cc:654] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.941040 31653 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:23.941995 31617 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.949736 31617 ts_tablet_manager.cc:1434] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:23.950979 31617 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.958820 31616 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:23.959290 31616 ts_tablet_manager.cc:1403] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.002s
I20260709 12:21:23.959621 31615 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:23.960033 31615 ts_tablet_manager.cc:1403] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 12:21:23.962273 31617 tablet_bootstrap.cc:654] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.962809 31615 raft_consensus.cc:359] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.963526 31615 raft_consensus.cc:385] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.963786 31615 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.964453 31615 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.965020 31616 raft_consensus.cc:359] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.965714 31616 raft_consensus.cc:385] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.965969 31616 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.966518 31615 ts_tablet_manager.cc:1434] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:21:23.968775 31615 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:23.967661 31616 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.970731 31617 tablet_bootstrap.cc:492] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:23.970990 31616 ts_tablet_manager.cc:1434] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:21:23.970938 31653 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:23.971153 31617 ts_tablet_manager.cc:1403] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:21:23.971588 31653 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.974076 31617 raft_consensus.cc:359] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.974798 31617 raft_consensus.cc:385] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:23.975114 31615 tablet_bootstrap.cc:654] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.975083 31617 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:23.975987 31617 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:23.976357 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:23.977008 31572 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:23.977931 31616 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:23.980183 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:23.981104 31617 ts_tablet_manager.cc:1434] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:21:23.981032 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:23.982426 31617 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:23.984513 31616 tablet_bootstrap.cc:654] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.987094 31465 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:23.988294 31686 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:23.988942 31617 tablet_bootstrap.cc:654] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:23.988871 31686 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:23.989486 31686 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:23.988382 31389 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.002291 31653 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.014540 31686 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.019798 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:24.020625 31423 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.030515 31657 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.031080 31657 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.032003 31616 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.032500 31616 ts_tablet_manager.cc:1403] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.006s
I20260709 12:21:24.032271 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.033057 31572 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.034571 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.035301 31616 raft_consensus.cc:359] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.035948 31616 raft_consensus.cc:385] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.036233 31616 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
W20260709 12:21:24.036584 31390 leader_election.cc:343] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.037103 31616 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.037849 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.033227 31657 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.040877 31617 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.041340 31617 ts_tablet_manager.cc:1403] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.036s
W20260709 12:21:24.041790 31389 leader_election.cc:343] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.042256 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.042985 31657 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.044800 31616 ts_tablet_manager.cc:1434] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:21:24.044723 31617 raft_consensus.cc:359] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.045565 31617 raft_consensus.cc:385] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.045876 31616 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.045830 31617 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.046643 31617 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.052026 31616 tablet_bootstrap.cc:654] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.062040 31656 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.042824 31686 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.064126 31616 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.064589 31616 ts_tablet_manager.cc:1403] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:21:24.064983 31657 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.065363 31572 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:24.062404 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:24.067301 31616 raft_consensus.cc:359] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.068013 31616 raft_consensus.cc:385] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.068312 31616 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.068085 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.069612 31653 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.069221 31616 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.070287 31653 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:24.071417 31653 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.072266 31616 ts_tablet_manager.cc:1434] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:24.073419 31616 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.078989 31656 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.079596 31656 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.084386 31616 tablet_bootstrap.cc:654] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.087036 31623 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.087699 31623 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.090952 31623 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.092792 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.094138 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.094946 31571 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 1: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:21:24.095983 31616 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.096415 31616 ts_tablet_manager.cc:1403] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 12:21:24.099134 31616 raft_consensus.cc:359] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.099802 31616 raft_consensus.cc:385] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.100061 31616 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.101395 31616 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.101863 31617 ts_tablet_manager.cc:1434] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:21:24.105599 31617 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.110347 31617 tablet_bootstrap.cc:654] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.104286 31616 ts_tablet_manager.cc:1434] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:24.111622 31616 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.117631 31465 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:24.118362 31616 tablet_bootstrap.cc:654] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.120455 31622 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.121886 31622 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.124121 31686 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.130211 31686 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.131807 31656 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.134068 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.133302 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.137727 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.138837 31656 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:24.142858 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:24.150049 31656 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.150556 31656 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.152747 31656 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.155306 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.155767 31616 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.156191 31616 ts_tablet_manager.cc:1403] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.004s
I20260709 12:21:24.157203 31615 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.157610 31615 ts_tablet_manager.cc:1403] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.189s	user 0.043s	sys 0.103s
I20260709 12:21:24.155311 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.158639 31616 raft_consensus.cc:359] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.159428 31616 raft_consensus.cc:385] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.159761 31616 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.159441 31423 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:24.160408 31616 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.161239 31615 raft_consensus.cc:359] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.161366 31657 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.162468 31616 ts_tablet_manager.cc:1434] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:21:24.162602 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:24.166049 31616 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
W20260709 12:21:24.166118 31540 leader_election.cc:343] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.163480 31615 raft_consensus.cc:385] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.168057 31615 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.168720 31615 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.169090 31620 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.169446 31620 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.169754 31620 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.170944 31617 tablet_bootstrap.cc:492] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.171362 31617 ts_tablet_manager.cc:1403] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.003s
I20260709 12:21:24.174275 31617 raft_consensus.cc:359] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.175814 31622 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.176421 31615 ts_tablet_manager.cc:1434] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 12:21:24.180904 31615 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.177062 31686 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.185014 31616 tablet_bootstrap.cc:654] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.184803 31656 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.174937 31617 raft_consensus.cc:385] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.189637 31617 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.190310 31617 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.193243 31321 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.178960 31620 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.196135 31615 tablet_bootstrap.cc:654] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.196317 31616 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.199039 31616 ts_tablet_manager.cc:1403] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 12:21:24.200109 31620 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.195027 31617 ts_tablet_manager.cc:1434] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:21:24.201749 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:24.201612 31616 raft_consensus.cc:359] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.202639 31616 raft_consensus.cc:385] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.202409 31422 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.201643 31617 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.204474 31616 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.205341 31616 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.205967 31622 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.206466 31622 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.207450 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:24.208819 31616 ts_tablet_manager.cc:1434] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:21:24.213997 31617 tablet_bootstrap.cc:654] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:24.216640 31540 leader_election.cc:343] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.216915 31622 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.215865 31422 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:24.218503 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:24.219774 31390 leader_election.cc:343] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.222795 31616 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.231782 31616 tablet_bootstrap.cc:654] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.237224 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:24.239105 31389 leader_election.cc:343] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.239625 31389 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.240775 31622 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.241492 31615 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.241447 31617 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.241950 31615 ts_tablet_manager.cc:1403] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.061s	user 0.004s	sys 0.016s
I20260709 12:21:24.242308 31617 ts_tablet_manager.cc:1403] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.014s
I20260709 12:21:24.244513 31615 raft_consensus.cc:359] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.245189 31615 raft_consensus.cc:385] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.245453 31615 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.246555 31615 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.247257 31616 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.247448 31623 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.247745 31616 ts_tablet_manager.cc:1403] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 12:21:24.248708 31623 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.249167 31623 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.250545 31616 raft_consensus.cc:359] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.251439 31616 raft_consensus.cc:385] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.251765 31616 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.252435 31616 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.252884 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.253504 31422 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:24.256073 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.256799 31620 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.257798 31620 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:24.259284 31623 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.259032 31620 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.259626 31622 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.260673 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.261857 31653 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.262269 31653 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.262617 31653 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.269311 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:24.271232 31465 leader_election.cc:343] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.271997 31653 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.246898 31617 raft_consensus.cc:359] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.272820 31617 raft_consensus.cc:385] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.273191 31617 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.248723 31615 ts_tablet_manager.cc:1434] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:24.275161 31616 ts_tablet_manager.cc:1434] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:21:24.276163 31616 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.276432 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:21:24.277741 31465 leader_election.cc:343] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.278283 31653 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.278954 31617 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.281390 31617 ts_tablet_manager.cc:1434] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:21:24.282145 31616 tablet_bootstrap.cc:654] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.282299 31617 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.286689 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:24.287323 31424 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.289114 31617 tablet_bootstrap.cc:654] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.274641 31615 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.297874 31616 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.298342 31616 ts_tablet_manager.cc:1403] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 12:21:24.300964 31616 raft_consensus.cc:359] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.301651 31616 raft_consensus.cc:385] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.301924 31616 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.304613 31616 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.306329 31663 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.306617 31657 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.307081 31657 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.308044 31617 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.308487 31617 ts_tablet_manager.cc:1403] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.006s
I20260709 12:21:24.309175 31657 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.311146 31616 ts_tablet_manager.cc:1434] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:21:24.311010 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.312060 31616 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
W20260709 12:21:24.312338 31390 leader_election.cc:343] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.312896 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.313503 31572 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:24.314716 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.315774 31663 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.316114 31663 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.316431 31663 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.317407 31424 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:24.318192 31616 tablet_bootstrap.cc:654] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.311031 31617 raft_consensus.cc:359] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.319185 31617 raft_consensus.cc:385] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.319487 31617 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.320147 31653 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.320609 31653 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.321772 31615 tablet_bootstrap.cc:654] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.322520 31653 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.323724 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.324103 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:24.324316 31572 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:24.324946 31653 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.325385 31653 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:24.326217 31653 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.326980 31465 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.328591 31682 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.329079 31682 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.329502 31682 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.334847 31572 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.336915 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.337620 31424 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:24.338910 31321 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.343493 31657 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.344182 31657 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.349566 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.350431 31571 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:24.320122 31617 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.355113 31617 ts_tablet_manager.cc:1434] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:21:24.359577 31389 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:24.360692 31622 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.361047 31622 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.361404 31622 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.364931 31617 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.366631 31657 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.371136 31622 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.373320 31622 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.374128 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:24.374076 31663 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.374830 31499 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.376925 31622 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.377388 31622 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.376570 31663 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.409662 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:21:24.414081 31390 leader_election.cc:343] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.418143 31617 tablet_bootstrap.cc:654] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.418629 31663 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.426111 31499 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:24.415755 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.429195 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.434144 31663 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.437569 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.439581 31663 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.440255 31663 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.440768 31663 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:24.441799 31663 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.448426 31682 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.451272 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:24.452271 31424 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.454327 31620 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.454813 31620 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.456739 31620 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.460315 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.458788 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.468957 31617 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.469411 31617 ts_tablet_manager.cc:1403] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.001s
W20260709 12:21:24.470453 31390 leader_election.cc:343] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.471117 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:24.472223 31390 leader_election.cc:343] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.474645 31617 raft_consensus.cc:359] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.475318 31617 raft_consensus.cc:385] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.475565 31617 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.475850 31424 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:24.476312 31617 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.477161 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.477977 31653 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.478830 31653 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:24.462316 31622 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.485232 31653 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.462561 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.479588 31321 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.486702 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.483361 31682 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.479105 31617 ts_tablet_manager.cc:1434] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:21:24.489938 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.490909 31617 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.489895 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.491261 31574 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.491393 31570 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.491223 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.493865 31616 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.494292 31616 ts_tablet_manager.cc:1403] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.182s	user 0.047s	sys 0.077s
I20260709 12:21:24.489207 31620 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.490703 31571 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.496832 31616 raft_consensus.cc:359] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.497439 31616 raft_consensus.cc:385] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.497689 31616 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.498342 31616 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.498909 31569 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.500550 31620 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.501009 31620 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.503403 31322 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.512043 31570 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:24.514055 31682 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.515924 31620 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.521288 31574 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:24.521477 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.522085 31422 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:24.522339 31616 ts_tablet_manager.cc:1434] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:21:24.523602 31616 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.526605 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:24.531968 31389 leader_election.cc:343] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.534086 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.536449 31615 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.536854 31622 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.537786 31615 ts_tablet_manager.cc:1403] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.263s	user 0.029s	sys 0.071s
I20260709 12:21:24.540052 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:24.541355 31620 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.541973 31620 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.542310 31620 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.543164 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.543921 31572 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:24.553265 31620 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.555717 31620 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.557988 31616 tablet_bootstrap.cc:654] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:24.558916 31540 leader_election.cc:343] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.559408 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.561808 31617 tablet_bootstrap.cc:654] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.561897 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:24.562585 31422 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.563068 31620 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.563643 31620 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.573698 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.566039 31322 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.620905 31620 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:21:24.628494 31735 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:21:24.622411 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.560115 31571 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
W20260709 12:21:24.626102 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67263.2us
I20260709 12:21:24.620831 31615 raft_consensus.cc:359] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.632504 31615 raft_consensus.cc:385] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.632622 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.627055 31424 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:24.570887 31622 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.638592 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.621398 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:24.640635 31622 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:21:24.641822 31540 leader_election.cc:343] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.575187 31422 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:24.640357 31712 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.641569 31622 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.632814 31615 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.645255 31615 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.646194 31731 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.646566 31731 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.647178 31731 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.600262 31663 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.658305 31615 ts_tablet_manager.cc:1434] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.005s
I20260709 12:21:24.659490 31615 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.652933 31663 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.665953 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.671773 31620 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.672282 31620 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:24.673053 31620 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.682040 31617 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.682593 31617 ts_tablet_manager.cc:1403] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.008s
I20260709 12:21:24.683991 31663 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.685223 31617 raft_consensus.cc:359] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.685699 31616 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.685443 31682 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:24.686257 31616 ts_tablet_manager.cc:1403] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.163s	user 0.037s	sys 0.050s
I20260709 12:21:24.685880 31617 raft_consensus.cc:385] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.686970 31617 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.688714 31617 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.691905 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.692487 31739 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:24.695320 31617 ts_tablet_manager.cc:1434] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:21:24.682101 31731 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.700666 31712 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:24.693109 31389 leader_election.cc:343] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.702579 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.703274 31731 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.704377 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:24.705782 31499 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.707077 31617 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:24.713881 31390 leader_election.cc:343] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.714336 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.716432 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.716977 31569 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.719285 31615 tablet_bootstrap.cc:654] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.721269 31616 raft_consensus.cc:359] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.721964 31616 raft_consensus.cc:385] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.722236 31616 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.723953 31740 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:24.725204 31569 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:24.725695 31499 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:24.726080 31616 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.732592 31322 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:24.735170 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.728900 31320 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.739821 31616 ts_tablet_manager.cc:1434] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.006s
I20260709 12:21:24.750314 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:24.751684 31616 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.752259 31682 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.754107 31740 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.754563 31740 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:24.755388 31740 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.760795 31617 tablet_bootstrap.cc:654] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.785095 31616 tablet_bootstrap.cc:654] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.791909 31616 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.791939 31615 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.792794 31615 ts_tablet_manager.cc:1403] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.134s	user 0.037s	sys 0.021s
I20260709 12:21:24.795493 31616 ts_tablet_manager.cc:1403] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.002s
I20260709 12:21:24.796599 31615 raft_consensus.cc:359] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.797363 31615 raft_consensus.cc:385] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.797678 31615 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.798450 31730 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.798466 31615 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.799108 31730 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.805141 31617 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.805593 31617 ts_tablet_manager.cc:1403] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.008s
I20260709 12:21:24.807464 31615 ts_tablet_manager.cc:1434] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:21:24.808173 31617 raft_consensus.cc:359] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.808691 31615 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.808877 31617 raft_consensus.cc:385] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.809237 31617 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.809896 31617 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.810846 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.809497 31730 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.811980 31617 ts_tablet_manager.cc:1434] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
W20260709 12:21:24.813045 31390 leader_election.cc:343] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.813390 31617 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.815544 31615 tablet_bootstrap.cc:654] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.821976 31617 tablet_bootstrap.cc:654] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.822530 31322 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.823833 31662 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.826968 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.832959 31569 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:24.834976 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.836459 31740 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.836953 31740 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.837378 31740 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.847769 31740 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.823752 31616 raft_consensus.cc:359] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.848556 31616 raft_consensus.cc:385] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.848918 31616 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.848618 31615 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.850823 31615 ts_tablet_manager.cc:1403] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.010s
I20260709 12:21:24.850622 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:24.851208 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:24.851730 31571 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.853242 31615 raft_consensus.cc:359] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.853739 31615 raft_consensus.cc:385] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.854005 31615 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
W20260709 12:21:24.854595 31390 leader_election.cc:343] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.854658 31615 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.858021 31615 ts_tablet_manager.cc:1434] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:24.858649 31571 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:24.858872 31615 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.859885 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.860798 31731 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:24.861231 31731 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:24.862000 31731 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.864993 31615 tablet_bootstrap.cc:654] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.866109 31616 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.868562 31616 ts_tablet_manager.cc:1434] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
I20260709 12:21:24.869437 31616 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.870810 31740 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.879370 31322 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.911067 31616 tablet_bootstrap.cc:654] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.912122 31617 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:24.912312 31615 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.912660 31617 ts_tablet_manager.cc:1403] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.012s
I20260709 12:21:24.912760 31615 ts_tablet_manager.cc:1403] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.017s
I20260709 12:21:24.915308 31615 raft_consensus.cc:359] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.915835 31615 raft_consensus.cc:385] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.915584 31617 raft_consensus.cc:359] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.916049 31616 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:24.916254 31617 raft_consensus.cc:385] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.916105 31615 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.916584 31616 ts_tablet_manager.cc:1403] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.005s
I20260709 12:21:24.916613 31617 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.917418 31617 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.917452 31615 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.919149 31616 raft_consensus.cc:359] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.919780 31616 raft_consensus.cc:385] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.919813 31615 ts_tablet_manager.cc:1434] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:21:24.920115 31616 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.920924 31616 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.924194 31615 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.927260 31616 ts_tablet_manager.cc:1434] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:21:24.928272 31616 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:24.930301 31617 ts_tablet_manager.cc:1434] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:21:24.930883 31615 tablet_bootstrap.cc:654] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.935014 31617 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:24.943251 31662 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:24.946781 31617 tablet_bootstrap.cc:654] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.947110 31616 tablet_bootstrap.cc:654] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:24.956387 31615 tablet_bootstrap.cc:492] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:24.955564 31712 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.957058 31712 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.959131 31730 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:24.959159 31712 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:24.957063 31615 ts_tablet_manager.cc:1403] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.015s
I20260709 12:21:24.962700 31615 raft_consensus.cc:359] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.963238 31615 raft_consensus.cc:385] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:24.963481 31615 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:24.965740 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:24.966552 31423 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:24.966928 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.967123 31615 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.968047 31498 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:24.970892 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:24.969496 31615 ts_tablet_manager.cc:1434] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:21:24.973008 31712 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:24.973479 31712 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:24.973917 31712 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:24.978819 31730 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.979480 31730 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.985445 31740 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:24.986038 31740 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:24.986186 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:24.988694 31740 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:24.989710 31730 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:24.992297 31390 leader_election.cc:343] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.992769 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.992964 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:24.994503 31389 leader_election.cc:343] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.994634 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:24.995020 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.973489 31615 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:24.996313 31730 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:24.996922 31389 leader_election.cc:343] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:24.997735 31390 leader_election.cc:343] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:24.998139 31390 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:24.999627 31730 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.005192 31616 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.006466 31617 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.006918 31617 ts_tablet_manager.cc:1403] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.025s
I20260709 12:21:25.008394 31712 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.012205 31623 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.013262 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.013813 31616 ts_tablet_manager.cc:1403] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.023s
I20260709 12:21:25.013888 31498 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.014392 31617 raft_consensus.cc:359] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.015913 31617 raft_consensus.cc:385] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.016206 31617 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.016831 31617 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.017678 31616 raft_consensus.cc:359] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.018324 31616 raft_consensus.cc:385] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.018859 31616 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.019104 31617 ts_tablet_manager.cc:1434] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:21:25.020448 31739 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.022245 31617 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.022255 31739 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.023386 31616 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.024843 31739 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.026904 31622 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.028654 31616 ts_tablet_manager.cc:1434] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:21:25.029712 31616 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.028532 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.028895 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.034230 31423 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.035884 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.036734 31499 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.038375 31623 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.040649 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.034425 31424 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.049422 31739 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.049893 31739 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.050191 31739 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.015429 31712 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.051692 31498 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.056464 31615 tablet_bootstrap.cc:654] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.060663 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.061780 31712 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.062453 31712 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.052662 31623 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.065371 31712 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.068990 31616 tablet_bootstrap.cc:654] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.073263 31653 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.073734 31653 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.073773 31739 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.077759 31653 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.079654 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.082248 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.083636 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:25.083999 31617 tablet_bootstrap.cc:654] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.084044 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.084718 31653 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.089814 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.091753 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.092013 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.092428 31424 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.092566 31499 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.093415 31574 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 1: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:21:25.104768 31540 consensus_peers.cc:597] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:25.095068 31465 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:25.107491 31653 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.090195 31623 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.090444 31739 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.117693 31423 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.119208 31424 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.120306 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.120908 31499 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.121206 31739 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.122745 31653 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.122498 31739 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.125491 31617 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.126005 31615 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.126008 31617 ts_tablet_manager.cc:1403] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.011s
I20260709 12:21:25.126580 31615 ts_tablet_manager.cc:1403] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.014s
I20260709 12:21:25.126801 31739 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.126240 31616 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.128693 31616 ts_tablet_manager.cc:1403] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.025s
I20260709 12:21:25.129195 31617 raft_consensus.cc:359] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.129918 31617 raft_consensus.cc:385] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.129745 31615 raft_consensus.cc:359] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.130470 31617 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.130967 31615 raft_consensus.cc:385] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.131335 31615 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.131502 31617 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.132686 31615 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.135659 31615 ts_tablet_manager.cc:1434] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:21:25.133358 31617 ts_tablet_manager.cc:1434] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:25.136960 31617 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.141819 31616 raft_consensus.cc:359] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.142318 31622 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.142520 31616 raft_consensus.cc:385] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.142869 31622 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.144066 31617 tablet_bootstrap.cc:654] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.142882 31616 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.146698 31616 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.149559 31615 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.149928 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.150640 31574 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:25.147071 31620 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.156997 31620 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.159574 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.149302 31622 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.164032 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.180434 31622 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.180847 31622 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.181176 31622 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:25.184525 31390 leader_election.cc:343] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.185603 31730 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:25.187060 31620 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.190531 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.195931 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.196712 31424 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
W20260709 12:21:25.196893 31540 leader_election.cc:343] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.199126 31622 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.201365 31616 ts_tablet_manager.cc:1434] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.006s
I20260709 12:21:25.200531 31663 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:25.203586 31740 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:25.205132 31615 tablet_bootstrap.cc:654] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.205212 31740 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.206156 31616 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.194553 31321 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.215734 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.206935 31740 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.291436 31620 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.374954 31620 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.375413 31620 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.376381 31740 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:25.325315 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:25.309365 31731 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:25.291550 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 81525.3us
I20260709 12:21:25.377514 31731 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.369133 31663 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.310878 31622 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.380031 31663 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.382562 31663 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.278369 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.380013 31731 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.387391 31615 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.387831 31615 ts_tablet_manager.cc:1403] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.238s	user 0.010s	sys 0.007s
I20260709 12:21:25.391346 31617 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.391791 31617 ts_tablet_manager.cc:1403] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.255s	user 0.045s	sys 0.047s
I20260709 12:21:25.394392 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.397993 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:25.401798 31390 leader_election.cc:343] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.402544 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.401916 31617 raft_consensus.cc:359] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:25.403280 31390 leader_election.cc:343] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.404973 31617 raft_consensus.cc:385] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.405578 31616 tablet_bootstrap.cc:654] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.405309 31617 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.406422 31617 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:25.405265 31390 leader_election.cc:343] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:25.408638 31390 leader_election.cc:343] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.409858 31739 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.410280 31739 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.410964 31620 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.412873 31617 ts_tablet_manager.cc:1434] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:21:25.413605 31617 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.419064 31739 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.424050 31615 raft_consensus.cc:359] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.428035 31617 tablet_bootstrap.cc:654] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.433249 31653 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.435184 31653 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.435482 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:25.436218 31574 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.437201 31653 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.434738 31615 raft_consensus.cc:385] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.440976 31615 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.441941 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.442256 31615 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.446195 31615 ts_tablet_manager.cc:1434] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:21:25.451038 31615 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.451545 31620 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.460029 31615 tablet_bootstrap.cc:654] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.468501 31498 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.475751 31615 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.476497 31615 ts_tablet_manager.cc:1403] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 12:21:25.477818 31740 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.482714 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.486951 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.487326 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.449858 31617 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.491101 31617 ts_tablet_manager.cc:1403] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.000s
I20260709 12:21:25.450500 31574 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:25.495134 31615 raft_consensus.cc:359] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.495489 31617 raft_consensus.cc:359] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.496272 31617 raft_consensus.cc:385] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.496604 31617 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.497901 31498 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.500874 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.501750 31424 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.495916 31615 raft_consensus.cc:385] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.506513 31615 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.507331 31615 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.509716 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.510401 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.510989 31424 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.512080 31616 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.512488 31616 ts_tablet_manager.cc:1403] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.306s	user 0.016s	sys 0.016s
I20260709 12:21:25.513185 31615 ts_tablet_manager.cc:1434] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:21:25.514061 31615 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.514635 31320 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.516361 31740 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.517372 31424 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.517446 31616 raft_consensus.cc:359] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.518141 31616 raft_consensus.cc:385] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.518424 31616 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.518539 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.519335 31497 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.519101 31616 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.521234 31740 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:25.521592 31389 leader_election.cc:343] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.522048 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.522789 31740 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.523634 31616 ts_tablet_manager.cc:1434] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:25.525030 31616 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
W20260709 12:21:25.526362 31389 leader_election.cc:343] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.526793 31389 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.527493 31740 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.527952 31497 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.530292 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:25.530900 31389 leader_election.cc:343] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.531108 31572 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 1: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:21:25.531343 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.532080 31740 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.533176 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.533918 31740 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.534363 31740 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:25.535063 31740 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.537153 31615 tablet_bootstrap.cc:654] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.539279 31617 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.539815 31620 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.542295 31616 tablet_bootstrap.cc:654] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.548396 31617 ts_tablet_manager.cc:1434] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 12:21:25.549305 31617 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.551251 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.552488 31739 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.552610 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.552893 31739 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.553251 31739 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.554149 31712 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.554625 31712 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.555436 31712 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.560720 31739 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.563915 31739 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.580906 31615 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.581425 31615 ts_tablet_manager.cc:1403] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
I20260709 12:21:25.584054 31615 raft_consensus.cc:359] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.584753 31615 raft_consensus.cc:385] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.584412 31617 tablet_bootstrap.cc:654] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.585043 31615 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.585796 31615 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.587505 31616 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.587982 31616 ts_tablet_manager.cc:1403] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.024s
I20260709 12:21:25.591681 31740 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.592249 31740 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.595433 31740 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.595707 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:25.595494 31540 leader_election.cc:343] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.591301 31616 raft_consensus.cc:359] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.596727 31616 raft_consensus.cc:385] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.596961 31616 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
W20260709 12:21:25.597086 31390 leader_election.cc:343] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.597666 31616 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.600203 31620 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.601058 31616 ts_tablet_manager.cc:1434] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:25.602294 31616 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.607224 31465 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:25.608249 31662 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.609602 31616 tablet_bootstrap.cc:654] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.612648 31662 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.613111 31662 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.615202 31662 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.615388 31322 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.619947 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.620642 31422 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:25.621929 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.622756 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.623428 31423 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.627933 31615 ts_tablet_manager.cc:1434] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:21:25.628850 31615 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.622769 31498 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.629706 31466 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.633057 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.638163 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.638921 31571 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 1: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:21:25.641091 31389 leader_election.cc:343] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.641249 31498 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.641561 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.642570 31653 raft_consensus.cc:2764] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:25.645256 31740 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:25.647351 31616 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.647852 31616 ts_tablet_manager.cc:1403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 12:21:25.651813 31423 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.654173 31616 raft_consensus.cc:359] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.654740 31616 raft_consensus.cc:385] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.655076 31616 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.655807 31616 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.658110 31616 ts_tablet_manager.cc:1434] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:21:25.657464 31620 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:25.659206 31616 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.660386 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.662160 31712 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.662781 31617 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.663215 31617 ts_tablet_manager.cc:1403] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.114s	user 0.039s	sys 0.008s
I20260709 12:21:25.665130 31616 tablet_bootstrap.cc:654] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.667466 31615 tablet_bootstrap.cc:654] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.669365 31620 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.671690 31712 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.672796 31785 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:25.672596 31712 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.677157 31498 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.678450 31617 raft_consensus.cc:359] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.679265 31617 raft_consensus.cc:385] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.679579 31617 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.680235 31617 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.681996 31617 ts_tablet_manager.cc:1434] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:21:25.683131 31617 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.683904 31320 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.689199 31617 tablet_bootstrap.cc:654] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.730388 31320 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:25.736860 31615 tablet_bootstrap.cc:492] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.737337 31615 ts_tablet_manager.cc:1403] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.013s
I20260709 12:21:25.740146 31615 raft_consensus.cc:359] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.740849 31615 raft_consensus.cc:385] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.741142 31615 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.741842 31615 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.743875 31615 ts_tablet_manager.cc:1434] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:25.745249 31615 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.749226 31616 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.761451 31615 tablet_bootstrap.cc:654] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.766184 31616 ts_tablet_manager.cc:1403] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.007s
I20260709 12:21:25.773998 31616 raft_consensus.cc:359] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.774668 31616 raft_consensus.cc:385] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.774948 31616 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.776278 31616 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.778231 31616 ts_tablet_manager.cc:1434] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:21:25.782294 31617 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.782807 31617 ts_tablet_manager.cc:1403] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.100s	user 0.027s	sys 0.039s
I20260709 12:21:25.785544 31617 raft_consensus.cc:359] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.786278 31617 raft_consensus.cc:385] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.786593 31617 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.787295 31617 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.789479 31617 ts_tablet_manager.cc:1434] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:25.790390 31617 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.796054 31617 tablet_bootstrap.cc:654] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.796115 31616 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.799319 31615 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.799749 31615 ts_tablet_manager.cc:1403] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.016s
I20260709 12:21:25.803071 31615 raft_consensus.cc:359] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.803612 31616 tablet_bootstrap.cc:654] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.803807 31615 raft_consensus.cc:385] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.804132 31615 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.804742 31615 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.806469 31615 ts_tablet_manager.cc:1434] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:25.807328 31615 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.812765 31615 tablet_bootstrap.cc:654] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.815886 31616 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.816362 31616 ts_tablet_manager.cc:1403] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:21:25.817680 31615 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.818174 31615 ts_tablet_manager.cc:1403] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:21:25.818950 31616 raft_consensus.cc:359] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.819783 31616 raft_consensus.cc:385] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.820025 31617 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.820053 31616 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.820581 31617 ts_tablet_manager.cc:1403] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 12:21:25.820964 31616 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.822438 31615 raft_consensus.cc:359] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.823230 31615 raft_consensus.cc:385] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.823549 31615 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.823647 31617 raft_consensus.cc:359] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.824301 31617 raft_consensus.cc:385] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.824582 31617 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.824415 31615 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.825399 31617 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.826354 31785 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.826905 31615 ts_tablet_manager.cc:1434] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:25.826781 31785 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.828388 31615 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.828783 31785 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.831269 31616 ts_tablet_manager.cc:1434] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:25.832159 31616 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:25.833587 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.834230 31497 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.835673 31615 tablet_bootstrap.cc:654] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.836149 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.835520 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.837028 31424 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.838369 31616 tablet_bootstrap.cc:654] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.842892 31785 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.843281 31785 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.843626 31785 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.848973 31617 ts_tablet_manager.cc:1434] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:21:25.849902 31617 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.857134 31785 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.862190 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.863366 31424 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.863749 31617 tablet_bootstrap.cc:654] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.869211 31615 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:25.869813 31620 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.869858 31615 ts_tablet_manager.cc:1403] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.024s
I20260709 12:21:25.871165 31617 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:25.870397 31620 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.871611 31617 ts_tablet_manager.cc:1403] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:21:25.873070 31620 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:25.874197 31617 raft_consensus.cc:359] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.874795 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:25.874224 31615 raft_consensus.cc:359] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.875447 31615 raft_consensus.cc:385] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.875890 31615 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.876227 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.874969 31617 raft_consensus.cc:385] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.876888 31422 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:25.877111 31785 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:21:25.876226 31540 leader_election.cc:343] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:25.877039 31615 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.879025 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:25.879482 31615 ts_tablet_manager.cc:1434] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:25.879539 31497 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.880937 31615 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:25.880924 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:25.882025 31785 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.882387 31785 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.882735 31785 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.883502 31616 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:25.884292 31616 ts_tablet_manager.cc:1403] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.017s
I20260709 12:21:25.887036 31616 raft_consensus.cc:359] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.887745 31615 tablet_bootstrap.cc:654] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:25.887781 31616 raft_consensus.cc:385] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.888262 31616 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.889294 31424 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.888995 31616 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.876911 31617 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.891052 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.894126 31620 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.894088 31785 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.896936 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:25.897501 31422 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.899425 31620 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.904287 31422 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.900285 31620 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.906195 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:25.905344 31617 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.907174 31653 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.907537 31739 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:25.908038 31739 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:25.907805 31653 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.908850 31739 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.912236 31653 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:25.914893 31617 ts_tablet_manager.cc:1434] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:21:25.915079 31616 ts_tablet_manager.cc:1434] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:21:25.915839 31617 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:25.919099 31740 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:25.919396 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:25.919754 31740 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.920215 31424 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:25.921562 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:25.922652 31653 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:25.922605 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:25.923100 31653 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:25.923300 31572 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:25.927443 31497 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:25.926505 31785 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.022931 31615 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.023020 31617 tablet_bootstrap.cc:654] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.023526 31615 ts_tablet_manager.cc:1403] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.143s	user 0.025s	sys 0.033s
I20260709 12:21:25.953274 31740 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.028004 31617 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:26.029671 31615 raft_consensus.cc:359] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.030340 31615 raft_consensus.cc:385] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.030606 31615 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.031260 31615 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.032233 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:26.033003 31497 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.033286 31615 ts_tablet_manager.cc:1434] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:26.035106 31615 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.040771 31615 tablet_bootstrap.cc:654] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.028502 31617 ts_tablet_manager.cc:1403] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.004s
I20260709 12:21:26.049850 31617 raft_consensus.cc:359] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.951469 31616 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.060963 31617 raft_consensus.cc:385] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.061272 31617 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.061847 31617 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.063264 31617 ts_tablet_manager.cc:1434] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:21:25.923456 31653 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.063669 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.065070 31740 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.042215 31322 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.065712 31740 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:25.929069 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:26.067616 31390 leader_election.cc:343] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.051698 31615 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.068374 31615 ts_tablet_manager.cc:1403] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 12:21:26.071020 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.072067 31740 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:26.074926 31390 leader_election.cc:343] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.078722 31653 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.072423 31497 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.080703 31615 raft_consensus.cc:359] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.081290 31615 raft_consensus.cc:385] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.081524 31615 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.082098 31615 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.083374 31616 tablet_bootstrap.cc:654] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.083745 31740 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.084729 31740 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.085299 31653 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.019716 31499 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.088539 31740 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:26.089074 31389 leader_election.cc:343] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.089577 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.090642 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.091075 31785 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.091689 31740 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:26.092036 31390 leader_election.cc:343] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.095535 31620 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.096009 31616 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.096509 31616 ts_tablet_manager.cc:1403] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.008s
I20260709 12:21:26.096145 31620 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.098433 31616 raft_consensus.cc:359] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.098793 31620 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.099056 31616 raft_consensus.cc:385] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.099421 31616 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.100248 31616 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.102414 31616 ts_tablet_manager.cc:1434] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:21:26.103549 31616 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.111660 31662 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.112126 31662 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.113633 31616 tablet_bootstrap.cc:654] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.118151 31662 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.119479 31740 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.120896 31617 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:26.125305 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49215.6us
I20260709 12:21:26.127525 31739 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:26.129913 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 103413us
I20260709 12:21:26.130051 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.132975 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.133507 31424 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.137238 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.140668 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.142750 31424 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:26.142869 31615 ts_tablet_manager.cc:1434] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.074s	user 0.014s	sys 0.009s
I20260709 12:21:26.144152 31615 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.143944 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:26.148861 31819 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.149400 31819 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:26.155172 31739 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.159147 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.157457 31739 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.159775 31570 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:26.159722 31322 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.160609 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:26.160983 31739 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.161227 31574 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.157447 31819 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.163952 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.165058 31424 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:26.165331 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:21:26.168736 31653 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:26.169216 31653 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:21:26.169652 31653 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.181380 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:26.183034 31620 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.183423 31620 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.183727 31620 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.186343 31615 tablet_bootstrap.cc:654] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.188450 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.189119 31496 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
W20260709 12:21:26.190040 31389 leader_election.cc:343] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.190236 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:26.190502 31389 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.191017 31712 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.191363 31712 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.195163 31663 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:26.195814 31622 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.196444 31622 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.191677 31712 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.202186 31617 tablet_bootstrap.cc:654] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:26.191624 31389 leader_election.cc:343] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.207814 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.208844 31616 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.209266 31616 ts_tablet_manager.cc:1403] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.015s
I20260709 12:21:26.211066 31622 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.211076 31623 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.211733 31623 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.213701 31623 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.215276 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.215931 31423 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:26.215847 31653 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.216872 31498 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:26.217161 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:26.217938 31623 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.218250 31663 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.218847 31731 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:26.221344 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:26.222361 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.222712 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.218282 31623 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:26.231065 31390 leader_election.cc:343] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.231249 31623 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.233083 31616 raft_consensus.cc:359] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.233762 31616 raft_consensus.cc:385] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.234014 31616 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.234628 31616 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.235061 31653 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.201726 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.242231 31321 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.244364 31616 ts_tablet_manager.cc:1434] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:21:26.245290 31616 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.246799 31424 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:26.251502 31616 tablet_bootstrap.cc:654] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.257959 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.271093 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.261350 31620 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:26.293913 31540 leader_election.cc:343] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.271485 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:26.295768 31739 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.287075 31622 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:26.296844 31622 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.297133 31622 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:26.293514 31623 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:26.302161 31389 leader_election.cc:343] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.302693 31389 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.300333 31663 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.304056 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:26.304183 31663 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.305310 31819 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:21:26.306034 31739 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.306638 31740 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:26.267374 31712 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.308143 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.303862 31623 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.306227 31663 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.271003 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.308753 31423 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.310725 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:26.326159 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.327886 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.328493 31420 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.328748 31569 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:26.330329 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.331198 31622 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.334342 31622 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.332513 31712 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.345958 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:26.349568 31663 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.349934 31663 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.351737 31663 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.352882 31617 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:26.353195 31615 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.353315 31617 ts_tablet_manager.cc:1403] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.024s
I20260709 12:21:26.353813 31615 ts_tablet_manager.cc:1403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.210s	user 0.033s	sys 0.018s
I20260709 12:21:26.356925 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.357556 31422 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.357429 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:26.358261 31498 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:26.346240 31465 leader_election.cc:343] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:26.359587 31465 leader_election.cc:343] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.362561 31620 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.356900 31617 raft_consensus.cc:359] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.363457 31617 raft_consensus.cc:385] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.363778 31617 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
W20260709 12:21:26.350600 31390 leader_election.cc:343] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.365195 31617 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.344437 31423 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:26.381211 31617 ts_tablet_manager.cc:1434] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:21:26.382180 31617 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:26.383154 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:26.383325 31420 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.384999 31623 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.385411 31422 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.385813 31623 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:26.386873 31623 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.389355 31615 raft_consensus.cc:359] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.389991 31615 raft_consensus.cc:385] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.390264 31615 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.390902 31615 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:26.392783 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47229.2us
I20260709 12:21:26.394838 31498 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.398031 31616 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.398655 31616 ts_tablet_manager.cc:1403] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.001s
I20260709 12:21:26.392972 31615 ts_tablet_manager.cc:1434] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.006s
I20260709 12:21:26.408689 31615 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.408818 31616 raft_consensus.cc:359] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.409508 31616 raft_consensus.cc:385] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.409765 31616 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.410343 31616 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.412824 31616 ts_tablet_manager.cc:1434] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:21:26.413698 31616 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.421062 31663 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.426898 31615 tablet_bootstrap.cc:654] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.427162 31617 tablet_bootstrap.cc:654] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.441792 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:26.442092 31740 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.453042 31740 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.446161 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:26.446617 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:26.449791 31826 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.460938 31740 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.461328 31826 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:26.461860 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:26.462265 31826 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.458874 31785 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.460088 31663 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.466226 31785 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:21:26.466712 31390 leader_election.cc:343] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.463541 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:26.467137 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.467582 31569 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.467095 31785 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.470345 31739 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.472450 31739 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:26.473991 31389 leader_election.cc:343] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.474308 31569 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:26.475006 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:26.481031 31540 leader_election.cc:343] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.484380 31616 tablet_bootstrap.cc:654] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:26.500523 31390 leader_election.cc:343] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.501034 31390 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.515489 31663 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:26.573875 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:26.605563 31840 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.616819 31785 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.617637 31785 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.620442 31615 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.621330 31616 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.621896 31616 ts_tablet_manager.cc:1403] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.010s
I20260709 12:21:26.622632 31615 ts_tablet_manager.cc:1403] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.214s	user 0.020s	sys 0.011s
I20260709 12:21:26.621690 31321 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.624109 31321 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.639825 31785 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.641949 31616 raft_consensus.cc:359] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.643323 31616 raft_consensus.cc:385] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.643657 31616 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.644420 31616 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.646343 31616 ts_tablet_manager.cc:1434] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 12:21:26.647449 31616 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.660166 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.631218 31740 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.668008 31615 raft_consensus.cc:359] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.668974 31615 raft_consensus.cc:385] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.669322 31615 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.671612 31615 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.666924 31663 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.679606 31615 ts_tablet_manager.cc:1434] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:21:26.670212 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.671053 31740 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.670332 31826 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:21:26.704643 31615 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.707150 31424 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:26.704383 31663 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:26.705775 31740 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.714656 31816 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.714581 31663 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.718204 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.737576 31617 tablet_bootstrap.cc:492] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:26.738099 31617 ts_tablet_manager.cc:1403] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.356s	user 0.016s	sys 0.019s
I20260709 12:21:26.739502 31616 tablet_bootstrap.cc:654] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.740491 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:26.741309 31840 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.741703 31840 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:26.752209 31540 leader_election.cc:343] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.749414 31617 raft_consensus.cc:359] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.754160 31617 raft_consensus.cc:385] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.754429 31617 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.756578 31617 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.755393 31840 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.769302 31617 ts_tablet_manager.cc:1434] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:21:26.757138 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:26.771505 31617 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:26.773882 31616 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.778054 31616 ts_tablet_manager.cc:1403] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.014s
I20260709 12:21:26.774758 31615 tablet_bootstrap.cc:654] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.796942 31320 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.804280 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:26.806165 31616 raft_consensus.cc:359] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:26.806532 31390 leader_election.cc:343] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.806901 31616 raft_consensus.cc:385] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.807230 31616 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.813303 31616 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.820152 31616 ts_tablet_manager.cc:1434] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:21:26.828189 31840 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.831336 31615 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.831873 31615 ts_tablet_manager.cc:1403] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.012s
I20260709 12:21:26.840701 31615 raft_consensus.cc:359] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.842926 31615 raft_consensus.cc:385] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.843181 31615 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.845744 31615 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.847968 31615 ts_tablet_manager.cc:1434] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
W20260709 12:21:26.848891 31850 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.081s	user 0.002s	sys 0.002s
W20260709 12:21:26.850073 31389 leader_election.cc:343] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.851320 31616 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.848881 31615 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.850529 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:26.876163 31617 tablet_bootstrap.cc:654] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.876641 31653 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.880498 31740 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:26.889611 31615 tablet_bootstrap.cc:654] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.889737 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.890969 31421 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.896122 31653 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.903959 31653 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.906484 31653 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.910058 31616 tablet_bootstrap.cc:654] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:26.910593 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:26.911763 31465 leader_election.cc:343] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.911984 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:26.912101 31653 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.912631 31422 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:26.916821 31497 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.917258 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:26.918537 31857 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:26.918923 31857 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:26.919281 31857 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.925446 31840 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:26.926165 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:26.926889 31498 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.933979 31615 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:26.934429 31615 ts_tablet_manager.cc:1403] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.002s
I20260709 12:21:26.936230 31616 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:26.936703 31616 ts_tablet_manager.cc:1403] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.002s
I20260709 12:21:26.940801 31615 raft_consensus.cc:359] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.941480 31615 raft_consensus.cc:385] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.941758 31615 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.942435 31615 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.944096 31570 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.944610 31615 ts_tablet_manager.cc:1434] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 12:21:26.945487 31615 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:26.946264 31857 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.947520 31616 raft_consensus.cc:359] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.948172 31616 raft_consensus.cc:385] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:26.948442 31616 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:26.949112 31616 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.951803 31840 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:26.952126 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:26.952713 31422 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.953361 31617 tablet_bootstrap.cc:492] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:26.953794 31617 ts_tablet_manager.cc:1403] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.001s
I20260709 12:21:26.936005 31498 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.923321 31421 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:26.960033 31422 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:26.961182 31857 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:26.962836 31616 ts_tablet_manager.cc:1434] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:21:26.962975 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:26.963706 31616 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:26.966375 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:26.971640 31854 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.972667 31663 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.973302 31663 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.974073 31620 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:26.974843 31840 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.969059 31320 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.978215 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:26.981913 31390 leader_election.cc:343] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:26.979846 31620 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:26.983230 31620 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.980005 31854 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:26.998669 31841 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.999236 31841 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.988994 31854 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:26.980437 31653 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:21:27.008016 31841 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.006884 31663 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.021183 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:27.023054 31616 tablet_bootstrap.cc:654] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.026042 31615 tablet_bootstrap.cc:654] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.026432 31320 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.045606 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.049350 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.055287 31616 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
W20260709 12:21:27.055233 31465 leader_election.cc:343] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.060585 31616 ts_tablet_manager.cc:1403] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.097s	user 0.037s	sys 0.038s
I20260709 12:21:27.063135 31616 raft_consensus.cc:359] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.063776 31616 raft_consensus.cc:385] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.064050 31616 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.064644 31616 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.066898 31616 ts_tablet_manager.cc:1434] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:27.058216 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.058941 31617 raft_consensus.cc:359] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.067368 31617 raft_consensus.cc:385] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.067729 31617 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.068374 31617 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.069345 31663 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.070084 31616 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.069800 31663 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.070973 31785 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.072113 31663 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.073661 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.074548 31617 ts_tablet_manager.cc:1434] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 12:21:27.067366 31615 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.075436 31617 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.076030 31615 ts_tablet_manager.cc:1403] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.003s
W20260709 12:21:27.075313 31390 leader_election.cc:343] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.076159 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.076898 31712 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:27.075552 31616 tablet_bootstrap.cc:654] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.078706 31620 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.080045 31615 raft_consensus.cc:359] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.080837 31615 raft_consensus.cc:385] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.081169 31615 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.081858 31615 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.084839 31615 ts_tablet_manager.cc:1434] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:27.086040 31615 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.085762 31320 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.093966 31615 tablet_bootstrap.cc:654] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.095976 31854 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.096477 31854 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.099977 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.100584 31424 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.101706 31466 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:21:27.101961 31389 leader_election.cc:343] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.102414 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.102725 31653 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.103073 31653 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.103406 31653 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.103446 31740 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.107904 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.114171 31854 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:27.114233 31389 leader_election.cc:343] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.114838 31389 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.115583 31663 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.118016 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.125777 31653 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.130514 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.131093 31424 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:27.136914 31465 leader_election.cc:343] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.145673 31424 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.146947 31466 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.148288 31854 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.148917 31854 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.149709 31854 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:27.152498 31390 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:27.156967 31617 tablet_bootstrap.cc:654] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.159766 31653 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.169371 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:27.176723 31320 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.183032 31740 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:27.183174 31465 leader_election.cc:343] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.183599 31740 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.187477 31617 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.187829 31740 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.188524 31617 ts_tablet_manager.cc:1403] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.003s
I20260709 12:21:27.188342 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:27.189761 31390 leader_election.cc:343] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.195115 31616 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.195739 31615 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.196305 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.198944 31615 ts_tablet_manager.cc:1403] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.029s
I20260709 12:21:27.199625 31663 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:27.200060 31389 leader_election.cc:343] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.200505 31389 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.200553 31617 raft_consensus.cc:359] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.201275 31663 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.201283 31617 raft_consensus.cc:385] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.200919 31616 ts_tablet_manager.cc:1403] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.131s	user 0.032s	sys 0.056s
I20260709 12:21:27.201927 31617 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.201434 31615 raft_consensus.cc:359] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.202446 31615 raft_consensus.cc:385] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.202630 31617 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.206749 31616 raft_consensus.cc:359] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.207320 31617 ts_tablet_manager.cc:1434] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:27.207391 31616 raft_consensus.cc:385] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.207716 31616 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.208261 31617 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.208426 31616 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.209925 31663 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.210399 31663 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.212837 31663 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.202754 31615 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.215377 31615 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.217582 31615 ts_tablet_manager.cc:1434] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:21:27.217916 31617 tablet_bootstrap.cc:654] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.218925 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:27.222188 31389 leader_election.cc:343] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.225780 31616 ts_tablet_manager.cc:1434] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:21:27.226768 31616 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.230595 31615 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.232947 31616 tablet_bootstrap.cc:654] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.237859 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:27.239311 31390 leader_election.cc:343] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.239789 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.240903 31663 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.241256 31615 tablet_bootstrap.cc:654] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.248677 31616 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.249593 31616 ts_tablet_manager.cc:1403] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 12:21:27.252437 31616 raft_consensus.cc:359] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.253352 31616 raft_consensus.cc:385] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.253701 31616 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.254726 31616 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.257315 31616 ts_tablet_manager.cc:1434] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:27.258632 31615 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.259114 31615 ts_tablet_manager.cc:1403] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 12:21:27.259285 31617 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.259743 31617 ts_tablet_manager.cc:1403] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.007s
I20260709 12:21:27.260018 31616 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.261693 31615 raft_consensus.cc:359] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.262332 31615 raft_consensus.cc:385] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.262737 31615 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.262601 31617 raft_consensus.cc:359] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.263576 31617 raft_consensus.cc:385] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.263883 31617 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.263677 31615 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.264614 31617 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.266664 31616 tablet_bootstrap.cc:654] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.267359 31854 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.267869 31854 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.272303 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.272842 31424 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.273533 31854 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.273320 31617 ts_tablet_manager.cc:1434] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:27.273805 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.274474 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.274751 31617 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.274513 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.275508 31854 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.275871 31854 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.276207 31854 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.277120 31615 ts_tablet_manager.cc:1434] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:21:27.278542 31615 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.288296 31615 tablet_bootstrap.cc:654] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.290719 31617 tablet_bootstrap.cc:654] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.293810 31616 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.294282 31616 ts_tablet_manager.cc:1403] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 12:21:27.296826 31617 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.297273 31615 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.296901 31616 raft_consensus.cc:359] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.296819 31854 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.297596 31617 ts_tablet_manager.cc:1403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:21:27.297776 31616 raft_consensus.cc:385] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.298211 31615 ts_tablet_manager.cc:1403] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 12:21:27.298389 31616 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.299154 31616 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.300397 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.300273 31617 raft_consensus.cc:359] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.300901 31617 raft_consensus.cc:385] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.300642 31615 raft_consensus.cc:359] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.301115 31616 ts_tablet_manager.cc:1434] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:27.301318 31615 raft_consensus.cc:385] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.301204 31617 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.300905 31424 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.301703 31615 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.302143 31616 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.302296 31617 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.302651 31615 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.304797 31615 ts_tablet_manager.cc:1434] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:21:27.305918 31615 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.308041 31616 tablet_bootstrap.cc:654] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.312220 31615 tablet_bootstrap.cc:654] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.317627 31653 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.318122 31653 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.320216 31616 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.320789 31616 ts_tablet_manager.cc:1403] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.012s
I20260709 12:21:27.322299 31653 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.323698 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.324380 31616 raft_consensus.cc:359] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.325275 31616 raft_consensus.cc:385] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.325605 31616 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.326064 31617 ts_tablet_manager.cc:1434] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:21:27.326992 31617 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.326650 31616 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.327365 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.329391 31616 ts_tablet_manager.cc:1434] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:21:27.329309 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.330506 31653 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.331097 31616 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.332617 31615 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.333032 31615 ts_tablet_manager.cc:1403] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 12:21:27.336000 31615 raft_consensus.cc:359] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.336653 31615 raft_consensus.cc:385] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.336910 31615 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.337452 31616 tablet_bootstrap.cc:654] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.337546 31615 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.340420 31424 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.342167 31615 ts_tablet_manager.cc:1434] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:27.342748 31617 tablet_bootstrap.cc:654] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.343122 31615 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.344058 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.344897 31653 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.345294 31653 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.345973 31653 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.346386 31854 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.354236 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:27.354962 31569 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.359728 31615 tablet_bootstrap.cc:654] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.367828 31616 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.368378 31616 ts_tablet_manager.cc:1403] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.007s
I20260709 12:21:27.371676 31616 raft_consensus.cc:359] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.372511 31616 raft_consensus.cc:385] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.372836 31616 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.374159 31616 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.374912 31785 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.375404 31785 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.377007 31616 ts_tablet_manager.cc:1434] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:27.377285 31785 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.380156 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.381072 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.381852 31424 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:27.383960 31497 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:27.385421 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:27.387332 31617 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.387663 31620 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.387977 31663 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.388584 31617 ts_tablet_manager.cc:1403] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.006s
I20260709 12:21:27.388494 31663 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.389452 31785 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.388048 31620 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.390938 31620 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.391247 31617 raft_consensus.cc:359] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.392653 31663 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.395136 31615 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.398727 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.402307 31615 ts_tablet_manager.cc:1403] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.010s
I20260709 12:21:27.385658 31616 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.391865 31617 raft_consensus.cc:385] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.403359 31617 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
W20260709 12:21:27.405961 31390 leader_election.cc:343] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.408656 31615 raft_consensus.cc:359] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.409317 31615 raft_consensus.cc:385] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.409561 31615 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.410163 31615 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.401923 31319 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.411965 31620 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.414073 31620 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.398761 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.416093 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.416635 31423 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.419803 31617 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.421644 31617 ts_tablet_manager.cc:1434] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:21:27.423954 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:27.424656 31497 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.426062 31663 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.426666 31663 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.428807 31663 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.431200 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:27.433100 31390 leader_election.cc:343] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.412606 31615 ts_tablet_manager.cc:1434] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:27.440567 31615 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.494779 31785 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.501039 31826 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.501319 31785 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.501746 31826 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.503654 31617 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.503568 31785 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.504369 31826 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.441385 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.509143 31497 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:27.511277 31423 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:27.513032 31854 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.514166 31653 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.514590 31653 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.516284 31653 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.517683 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.519937 31841 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.517114 31785 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:27.520396 31841 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:27.521265 31841 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:27.522353 31389 leader_election.cc:343] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.522847 31389 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.523429 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.524319 31663 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:27.525576 31389 leader_election.cc:343] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.525982 31389 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.527046 31570 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.527230 31740 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:27.512813 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 89254.9us
I20260709 12:21:27.532816 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.536413 31615 tablet_bootstrap.cc:654] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:27.541908 31465 leader_election.cc:343] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.547986 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.549083 31423 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:27.549741 31616 tablet_bootstrap.cc:654] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.549077 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.550326 31498 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:27.547997 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.552470 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.551589 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.553120 31423 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:27.553856 31826 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.555037 31826 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.555380 31826 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.561663 31826 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.564031 31826 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.565140 31819 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.568965 31617 tablet_bootstrap.cc:654] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.568886 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:27.570765 31497 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.577864 31498 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.582548 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:27.584163 31321 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.587543 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.594089 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.596698 31663 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.596808 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.597817 31422 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.597687 31663 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.598901 31620 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.599365 31620 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:27.600176 31740 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.600039 31620 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.600605 31740 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.602795 31740 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.604602 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.606747 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:27.607939 31390 leader_election.cc:343] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:27.609025 31389 leader_election.cc:343] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.609609 31389 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.611129 31663 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.611095 31740 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.612833 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.614253 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:27.614588 31389 leader_election.cc:343] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.615254 31615 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
W20260709 12:21:27.615865 31390 leader_election.cc:343] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.616411 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.617633 31615 ts_tablet_manager.cc:1403] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.009s
I20260709 12:21:27.617774 31740 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.620352 31616 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.620841 31616 ts_tablet_manager.cc:1403] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.238s	user 0.008s	sys 0.004s
I20260709 12:21:27.622912 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.623793 31616 raft_consensus.cc:359] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.624346 31616 raft_consensus.cc:385] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.624595 31616 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.624892 31857 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.625243 31857 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.625221 31616 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.625718 31857 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.626451 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.627034 31422 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.629922 31616 ts_tablet_manager.cc:1434] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:21:27.632217 31616 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.633383 31857 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.633811 31422 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:27.643217 31615 raft_consensus.cc:359] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.646567 31819 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.642594 31826 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.648394 31819 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.655092 31616 tablet_bootstrap.cc:654] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.647223 31615 raft_consensus.cc:385] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.656118 31615 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.658129 31615 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.658932 31854 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.659374 31854 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.661319 31854 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.664197 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:27.665388 31465 leader_election.cc:343] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.666889 31819 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.667109 31615 ts_tablet_manager.cc:1434] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:21:27.672680 31615 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.671809 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:27.675192 31465 leader_election.cc:343] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.675362 31857 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.670061 31318 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:27.679281 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:21:27.681984 31465 leader_election.cc:343] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.682830 31826 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.683835 31826 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.685457 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.686041 31423 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.687088 31615 tablet_bootstrap.cc:654] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.693943 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.694541 31424 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.693976 31617 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.695839 31617 ts_tablet_manager.cc:1403] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.192s	user 0.032s	sys 0.015s
I20260709 12:21:27.695919 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.696523 31424 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:27.700855 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.698877 31826 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.702750 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.703475 31819 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.703812 31819 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.704128 31819 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.704286 31854 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.708204 31616 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.708292 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.708696 31616 ts_tablet_manager.cc:1403] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.000s
I20260709 12:21:27.711174 31617 raft_consensus.cc:359] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.714200 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.715941 31620 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.718526 31617 raft_consensus.cc:385] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.718915 31617 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.716567 31423 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.721093 31422 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:27.724896 31615 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.725425 31615 ts_tablet_manager.cc:1403] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.004s
I20260709 12:21:27.725495 31466 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.727896 31854 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:27.728284 31854 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.728618 31854 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.732542 31819 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.733798 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.737306 31620 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.738547 31617 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.742157 31616 raft_consensus.cc:359] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.742746 31857 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.742847 31653 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.743449 31857 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.744257 31857 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.744866 31615 raft_consensus.cc:359] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.745514 31615 raft_consensus.cc:385] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.745808 31615 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.742865 31616 raft_consensus.cc:385] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.747025 31616 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.747920 31616 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.746466 31615 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.752763 31616 ts_tablet_manager.cc:1434] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:21:27.753638 31616 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.755395 31854 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.759593 31617 ts_tablet_manager.cc:1434] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:21:27.760412 31617 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.768607 31615 ts_tablet_manager.cc:1434] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 12:21:27.772541 31615 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:27.780114 31819 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.785589 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:21:27.786752 31465 leader_election.cc:343] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.787000 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.787614 31423 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.801405 31321 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.802547 31841 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:21:27.804463 31841 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.805948 31854 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.810225 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:27.810791 31569 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.806411 31841 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.813939 31616 tablet_bootstrap.cc:654] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.806902 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.816746 31419 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:27.816637 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.818116 31497 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:27.818791 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.819728 31420 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:21:27.821712 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.822425 31826 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:27.822825 31826 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:21:27.823165 31826 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:27.824231 31854 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.824961 31854 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.825286 31663 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.825767 31663 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:27.828681 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:27.834924 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:27.836723 31390 leader_election.cc:343] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.830919 31663 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.834314 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:27.846037 31389 leader_election.cc:343] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.846707 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:27.847625 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:27.848176 31663 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:27.848407 31420 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:21:27.850266 31617 tablet_bootstrap.cc:654] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.853209 31569 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.854748 31854 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.857053 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.859292 31854 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.859557 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:27.860212 31854 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.856597 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:27.861549 31653 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:21:27.861871 31653 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.862188 31653 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:27.861121 31854 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.873739 31653 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.848939 31826 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.877393 31653 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:27.905781 31423 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.895511 31571 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:21:27.911540 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:27.921587 31617 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:27.922127 31617 ts_tablet_manager.cc:1403] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.000s
I20260709 12:21:27.919804 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.925223 31423 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:27.925763 31419 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:27.926972 31615 tablet_bootstrap.cc:654] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.928473 31826 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:27.930637 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:27.931485 31497 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:21:27.931999 31616 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:27.932392 31616 ts_tablet_manager.cc:1403] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.179s	user 0.025s	sys 0.031s
I20260709 12:21:27.933444 31540 leader_election.cc:400] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:21:27.933754 31540 leader_election.cc:403] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:21:27.934273 31826 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:27.934835 31616 raft_consensus.cc:359] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.935503 31616 raft_consensus.cc:385] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.935822 31616 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.936465 31819 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:27.937006 31423 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:21:27.937417 31616 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.944473 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:27.945737 31419 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:21:27.947153 31826 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:21:27.947634 31616 ts_tablet_manager.cc:1434] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:21:27.951828 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.954563 31857 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:27.955116 31857 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.955974 31857 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.961395 31540 leader_election.cc:400] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:21:27.961560 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:27.962407 31819 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:27.962927 31819 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:27.963680 31819 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.963984 31617 raft_consensus.cc:359] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.964591 31617 raft_consensus.cc:385] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.964845 31617 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.965437 31617 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.968505 31617 ts_tablet_manager.cc:1434] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:21:27.969363 31617 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:27.969444 31318 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:27.948586 31616 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:27.978502 31617 tablet_bootstrap.cc:654] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:27.983564 31740 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.984506 31740 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.987397 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:27.988441 31616 tablet_bootstrap.cc:654] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:27.989959 31390 leader_election.cc:343] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:27.989943 31819 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:27.993003 31615 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:27.993396 31615 ts_tablet_manager.cc:1403] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.221s	user 0.008s	sys 0.010s
I20260709 12:21:27.995401 31615 raft_consensus.cc:359] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.996042 31615 raft_consensus.cc:385] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:27.996306 31615 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:27.996899 31615 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:27.999595 31615 ts_tablet_manager.cc:1434] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:28.000429 31615 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:28.004405 31318 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.005897 31615 tablet_bootstrap.cc:654] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.006433 31785 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:28.012189 31740 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.013775 31318 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.015751 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:28.018481 31389 leader_election.cc:343] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.019240 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.019883 31615 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:28.020306 31740 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.020306 31615 ts_tablet_manager.cc:1403] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.009s
I20260709 12:21:28.023461 31785 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.026818 31615 raft_consensus.cc:359] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.027508 31615 raft_consensus.cc:385] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.027770 31615 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.034633 31617 tablet_bootstrap.cc:492] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:28.035140 31617 ts_tablet_manager.cc:1403] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.000s
I20260709 12:21:28.037779 31617 raft_consensus.cc:359] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.038424 31617 raft_consensus.cc:385] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.039783 31617 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.040405 31617 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.041327 31616 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:28.041831 31616 ts_tablet_manager.cc:1403] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.019s
I20260709 12:21:28.042613 31617 ts_tablet_manager.cc:1434] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:28.043485 31617 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:28.044683 31616 raft_consensus.cc:359] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.039067 31615 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.045439 31616 raft_consensus.cc:385] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.045797 31616 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.046819 31615 ts_tablet_manager.cc:1434] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:21:28.046432 31616 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.047662 31615 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:28.048743 31616 ts_tablet_manager.cc:1434] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:28.049737 31616 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:28.053248 31617 tablet_bootstrap.cc:654] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.054157 31615 tablet_bootstrap.cc:654] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.056505 31616 tablet_bootstrap.cc:654] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.072644 31826 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.073241 31615 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:28.073743 31615 ts_tablet_manager.cc:1403] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:21:28.077020 31615 raft_consensus.cc:359] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.077701 31615 raft_consensus.cc:385] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.077968 31615 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.078567 31615 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.081784 31616 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:28.082275 31616 ts_tablet_manager.cc:1403] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.004s
I20260709 12:21:28.082635 31663 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.083069 31663 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.084509 31615 ts_tablet_manager.cc:1434] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:28.084947 31663 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.085392 31615 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:28.085063 31616 raft_consensus.cc:359] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.085865 31616 raft_consensus.cc:385] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.086169 31616 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.086952 31616 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.089792 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:28.091588 31390 leader_election.cc:343] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.094189 31616 ts_tablet_manager.cc:1434] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.004s
I20260709 12:21:28.094899 31819 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.095374 31819 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.099022 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.099619 31419 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.100996 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.102044 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.102954 31857 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.103335 31857 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.103461 31819 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.103704 31857 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.104588 31616 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
W20260709 12:21:28.107550 31389 leader_election.cc:343] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.108119 31389 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.109023 31663 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.113751 31615 tablet_bootstrap.cc:654] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.121281 31663 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.121920 31663 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.125754 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:28.162271 31857 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.167011 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.167847 31419 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.171864 31663 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.173643 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.174275 31571 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.175134 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.175662 31569 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.178036 31419 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.179082 31826 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:28.181079 31390 leader_election.cc:343] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.190068 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.192190 31617 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
W20260709 12:21:28.192416 31389 leader_election.cc:343] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.192727 31617 ts_tablet_manager.cc:1403] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.001s
I20260709 12:21:28.192898 31389 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.200103 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.201239 31854 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.201694 31854 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.194075 31857 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.193979 31819 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.202483 31854 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.196233 31913 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.216667 31569 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.214847 31819 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.218353 31617 raft_consensus.cc:359] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.219033 31617 raft_consensus.cc:385] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.219276 31617 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.222237 31617 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.229424 31617 ts_tablet_manager.cc:1434] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:21:28.239997 31819 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.245187 31617 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:28.244876 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.246166 31420 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.247786 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.248499 31854 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.252100 31653 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.254722 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.256477 31616 tablet_bootstrap.cc:654] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.248840 31854 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.226750 31926 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.246212 31857 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.257768 31857 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.258273 31854 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.257730 31926 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.260825 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.261440 31419 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.262568 31466 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.262642 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:28.263358 31653 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.263686 31653 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.264076 31653 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:28.264290 31390 leader_election.cc:343] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.263713 31319 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.265669 31926 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:28.269764 31465 leader_election.cc:343] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.280236 31857 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.280514 31615 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:28.281003 31615 ts_tablet_manager.cc:1403] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.030s
I20260709 12:21:28.281312 31653 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.283910 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.289598 31615 raft_consensus.cc:359] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.290235 31615 raft_consensus.cc:385] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.290479 31615 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.291093 31615 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.295061 31653 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.296901 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.297523 31569 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.298581 31615 ts_tablet_manager.cc:1434] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:21:28.283062 31854 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.299567 31615 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:28.301273 31854 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.298110 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.302832 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.306692 31423 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.310930 31926 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.311544 31926 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.302423 31419 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.344812 31419 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.346349 31466 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.347368 31854 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.347975 31854 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.349050 31854 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:28.371908 31389 leader_election.cc:343] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.372380 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.379110 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.379763 31570 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:28.379146 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62974.4us
I20260709 12:21:28.381428 31913 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.383176 31615 tablet_bootstrap.cc:654] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.386780 31570 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.388054 31617 tablet_bootstrap.cc:654] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.389326 31616 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:28.389758 31616 ts_tablet_manager.cc:1403] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.285s	user 0.013s	sys 0.046s
I20260709 12:21:28.392324 31616 raft_consensus.cc:359] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.392985 31616 raft_consensus.cc:385] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.393273 31616 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.393302 31926 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.394002 31616 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.394800 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:28.395993 31616 ts_tablet_manager.cc:1434] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
W20260709 12:21:28.396328 31390 leader_election.cc:343] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.396855 31616 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:28.400085 31423 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.402726 31616 tablet_bootstrap.cc:654] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.409423 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.412737 31653 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.413594 31616 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:28.413870 31653 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.415663 31841 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.421612 31841 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.423501 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.420439 31653 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.424178 31841 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:28.424791 31617 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:28.425235 31617 ts_tablet_manager.cc:1403] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.180s	user 0.007s	sys 0.005s
I20260709 12:21:28.414042 31616 ts_tablet_manager.cc:1403] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:21:28.429239 31572 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.429620 31616 raft_consensus.cc:359] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.430341 31616 raft_consensus.cc:385] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.430351 31857 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.434670 31616 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.435164 31857 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.435629 31616 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.437251 31857 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.437848 31616 ts_tablet_manager.cc:1434] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:21:28.439656 31857 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.441532 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.442078 31419 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.443245 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.444176 31653 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.444525 31653 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.444856 31653 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.446738 31616 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:28.454557 31616 tablet_bootstrap.cc:654] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.461678 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.462019 31615 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:28.462621 31615 ts_tablet_manager.cc:1403] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.163s	user 0.000s	sys 0.011s
I20260709 12:21:28.463057 31653 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.465055 31653 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.466825 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.467392 31422 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:28.469156 31465 leader_election.cc:343] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:28.470873 31465 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:28.428202 31617 raft_consensus.cc:359] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.471184 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:28.471493 31465 leader_election.cc:343] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.472438 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.472800 31819 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.466295 31318 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.476009 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.476841 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.471369 31617 raft_consensus.cc:385] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.477537 31617 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.478318 31617 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.480444 31617 ts_tablet_manager.cc:1434] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:21:28.481913 31617 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:28.479102 31540 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.484616 31826 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.487727 31420 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:21:28.487825 31465 leader_election.cc:343] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:28.487968 31389 leader_election.cc:343] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.488510 31389 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.488969 31422 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.489893 31926 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.491757 31617 tablet_bootstrap.cc:654] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.491556 31615 raft_consensus.cc:359] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.492296 31615 raft_consensus.cc:385] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.492266 31653 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:28.492774 31615 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.493479 31615 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.495195 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:28.497088 31569 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:21:28.499172 31857 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.500303 31857 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.501134 31857 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.505300 31819 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:28.507021 31816 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.507465 31816 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.509159 31816 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.514477 31615 ts_tablet_manager.cc:1434] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:21:28.515297 31615 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:28.516933 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.525200 31653 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.525664 31653 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.527493 31854 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:28.529563 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.530128 31424 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:28.531160 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:28.531873 31854 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.532212 31854 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.532548 31854 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.532657 31653 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.536283 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:28.537595 31423 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
W20260709 12:21:28.539274 31465 leader_election.cc:343] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.540970 31653 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:28.546994 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:28.548936 31465 leader_election.cc:343] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.553448 31854 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.556461 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:28.559619 31926 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.562883 31926 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.563735 31854 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.565552 31616 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:28.566051 31616 ts_tablet_manager.cc:1403] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.003s
I20260709 12:21:28.565359 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.570852 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.570922 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:28.571177 31819 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:28.571609 31819 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:28.571990 31819 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:28.572479 31390 leader_election.cc:343] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:28.573347 31465 leader_election.cc:343] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.574052 31421 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.575832 31615 tablet_bootstrap.cc:654] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.580550 31926 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.645897 31616 raft_consensus.cc:359] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.646920 31616 raft_consensus.cc:385] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.647272 31616 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.648097 31616 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:28.668102 31944 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:28.672197 31819 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.685802 31616 ts_tablet_manager.cc:1434] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 12:21:28.686817 31616 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:28.687203 31819 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:28.694075 31421 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.681588 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:28.705153 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:28.709992 31945 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.710546 31945 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.712317 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:28.712859 31424 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:28.711822 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:28.726475 31319 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.730666 31319 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:28.736967 31424 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:28.711510 31945 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.741245 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:21:28.745476 31389 leader_election.cc:343] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.745932 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:28.748090 31819 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:28.748632 31819 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:28.749444 31819 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:28.760378 31465 leader_election.cc:343] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:28.769701 31617 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:28.770210 31617 ts_tablet_manager.cc:1403] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.288s	user 0.007s	sys 0.007s
W20260709 12:21:28.834072 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81421.1us
W20260709 12:21:28.834139 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88696.7us
I20260709 12:21:28.844472 31947 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:28.850440 31949 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:28.847934 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84207.8us
I20260709 12:21:28.846932 31740 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.858880 31620 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:28.859337 31620 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.926128 31620 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:28.927783 31617 raft_consensus.cc:359] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.928805 31617 raft_consensus.cc:385] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:28.929188 31617 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:28.932125 31615 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:28.932866 31615 ts_tablet_manager.cc:1403] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.418s	user 0.036s	sys 0.017s
I20260709 12:21:28.938086 31616 tablet_bootstrap.cc:654] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:28.857694 31740 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.930081 31617 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.961727 31617 ts_tablet_manager.cc:1434] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.191s	user 0.016s	sys 0.000s
I20260709 12:21:28.850972 31949 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:28.967193 31617 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:29.012112 31465 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.014267 31740 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.016204 31949 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.019944 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.020344 31615 raft_consensus.cc:359] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.021047 31615 raft_consensus.cc:385] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.021311 31615 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.022362 31950 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:21:29.025695 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.025748 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:29.028537 31389 leader_election.cc:343] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.029371 31389 leader_election.cc:343] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.076407 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.052788 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.083351 31615 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.095785 31615 ts_tablet_manager.cc:1434] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.163s	user 0.004s	sys 0.003s
W20260709 12:21:29.099990 31390 leader_election.cc:343] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.100409 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.101740 31663 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:29.102281 31390 leader_election.cc:343] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.102725 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.105822 31663 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.111626 31617 tablet_bootstrap.cc:654] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:29.112589 31956 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.096s	user 0.002s	sys 0.002s
I20260709 12:21:29.116195 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.120399 31616 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.120870 31616 ts_tablet_manager.cc:1403] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.434s	user 0.020s	sys 0.011s
I20260709 12:21:29.128962 31958 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:29.133608 31616 raft_consensus.cc:359] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.134317 31616 raft_consensus.cc:385] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.134570 31616 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.135167 31616 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.152654 31540 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.153605 31615 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.154430 31712 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.156855 31958 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.157369 31958 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.161346 31854 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.165810 31616 ts_tablet_manager.cc:1434] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.002s
I20260709 12:21:29.165953 31945 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.168134 31950 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.169349 31616 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:29.169759 31565 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.184441 31854 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.171731 31566 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.187500 31958 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.188568 31318 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.195842 31617 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.196465 31617 ts_tablet_manager.cc:1403] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.233s	user 0.015s	sys 0.000s
I20260709 12:21:29.198256 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:29.201833 31465 leader_election.cc:343] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.202617 31465 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:29.202837 31854 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:29.202840 31318 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.205714 31615 tablet_bootstrap.cc:654] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:29.212356 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:29.224665 31617 raft_consensus.cc:359] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.227644 31617 raft_consensus.cc:385] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.229957 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.230816 31418 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:29.236196 31466 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:29.237490 31816 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.237855 31816 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.238171 31816 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.245532 31616 tablet_bootstrap.cc:654] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.227902 31617 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.252466 31617 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.257089 31617 ts_tablet_manager.cc:1434] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 12:21:29.259353 31617 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.263671 31955 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.264207 31955 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.267383 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.267745 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:29.268708 31389 leader_election.cc:343] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.270062 31617 tablet_bootstrap.cc:654] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:29.275132 31390 leader_election.cc:343] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.275564 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.276199 31663 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.276293 31955 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.278100 31615 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.295150 31617 tablet_bootstrap.cc:492] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.295637 31617 ts_tablet_manager.cc:1403] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.002s
I20260709 12:21:29.279855 31816 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.290930 31958 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.295706 31615 ts_tablet_manager.cc:1403] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.002s
I20260709 12:21:29.303392 31617 raft_consensus.cc:359] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.300501 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.305902 31418 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.304293 31617 raft_consensus.cc:385] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.310838 31617 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.315979 31945 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.316603 31615 raft_consensus.cc:359] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.317605 31615 raft_consensus.cc:385] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.318009 31615 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.318652 31566 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.320248 31816 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.321463 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.311870 31617 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:29.323331 31465 leader_election.cc:343] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.334939 31945 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.342197 31841 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.342947 31841 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.346074 31841 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:29.347995 31617 ts_tablet_manager.cc:1434] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 12:21:29.351025 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.351351 31615 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.353091 31617 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.358175 31616 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.358718 31616 ts_tablet_manager.cc:1403] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.190s	user 0.036s	sys 0.052s
I20260709 12:21:29.361703 31418 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:29.361536 31616 raft_consensus.cc:359] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.362246 31616 raft_consensus.cc:385] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.362533 31616 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.363335 31616 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.364997 31616 ts_tablet_manager.cc:1434] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:29.358448 31615 ts_tablet_manager.cc:1434] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:21:29.368255 31617 tablet_bootstrap.cc:654] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.373139 31615 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.373565 31617 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.374027 31617 ts_tablet_manager.cc:1403] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 12:21:29.376588 31616 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:29.377880 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.384387 31617 raft_consensus.cc:359] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.385106 31617 raft_consensus.cc:385] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.385385 31617 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.385669 31466 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:29.385977 31617 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.387163 31615 tablet_bootstrap.cc:654] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.387109 31816 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.387863 31816 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:29.388396 31617 ts_tablet_manager.cc:1434] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:21:29.388885 31816 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.390264 31616 tablet_bootstrap.cc:654] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.394634 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.396574 31841 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.403118 31617 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.407785 31615 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.408259 31615 ts_tablet_manager.cc:1403] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.006s
I20260709 12:21:29.410085 31617 tablet_bootstrap.cc:654] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.410655 31615 raft_consensus.cc:359] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.411340 31615 raft_consensus.cc:385] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.411576 31615 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.414924 31615 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.416407 31615 ts_tablet_manager.cc:1434] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:21:29.426033 31616 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.426492 31616 ts_tablet_manager.cc:1403] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.002s
I20260709 12:21:29.430212 31615 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.437029 31616 raft_consensus.cc:359] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.437702 31616 raft_consensus.cc:385] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.437969 31616 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.438616 31616 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.440371 31616 ts_tablet_manager.cc:1434] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:21:29.450287 31573 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.465126 31615 tablet_bootstrap.cc:654] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.441640 31616 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:29.471927 31816 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.472523 31816 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.474154 31616 tablet_bootstrap.cc:654] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.475328 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.475984 31418 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:29.477239 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.477977 31653 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.478327 31653 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.478672 31653 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.480460 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:29.482206 31465 leader_election.cc:343] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.482930 31816 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.483163 31615 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.483711 31615 ts_tablet_manager.cc:1403] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 12:21:29.484539 31653 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.486346 31615 raft_consensus.cc:359] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.487003 31615 raft_consensus.cc:385] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.487270 31615 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.487833 31615 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.488808 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.489342 31418 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.489935 31615 ts_tablet_manager.cc:1434] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:21:29.490849 31615 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.496649 31615 tablet_bootstrap.cc:654] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.499243 31653 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.500654 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.498521 31418 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
W20260709 12:21:29.502496 31465 leader_election.cc:343] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.504010 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:29.507908 31615 tablet_bootstrap.cc:492] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.508344 31615 ts_tablet_manager.cc:1403] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 12:21:29.508419 31950 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.508898 31950 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:29.509690 31950 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.512552 31615 raft_consensus.cc:359] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.513394 31615 raft_consensus.cc:385] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.502209 31617 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.513752 31615 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.514109 31617 ts_tablet_manager.cc:1403] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.036s
I20260709 12:21:29.517719 31617 raft_consensus.cc:359] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.518555 31617 raft_consensus.cc:385] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.518860 31617 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.517575 31615 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.521505 31617 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.522344 31615 ts_tablet_manager.cc:1434] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:29.525528 31617 ts_tablet_manager.cc:1434] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:21:29.526624 31616 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.527114 31616 ts_tablet_manager.cc:1403] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.019s
I20260709 12:21:29.526954 31617 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.529639 31616 raft_consensus.cc:359] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.530325 31616 raft_consensus.cc:385] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.530579 31616 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.531927 31616 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.533537 31616 ts_tablet_manager.cc:1434] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:21:29.534322 31947 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.534796 31947 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.536314 31617 tablet_bootstrap.cc:654] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.536899 31947 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.538354 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.539407 31615 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
W20260709 12:21:29.539676 31390 leader_election.cc:343] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.542799 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:21:29.544728 31389 leader_election.cc:343] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.545183 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.545747 31947 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.546612 31615 tablet_bootstrap.cc:654] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.547868 31616 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:29.553617 31319 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.553658 31947 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.557868 31947 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.558907 31616 tablet_bootstrap.cc:654] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.563552 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.564138 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:29.565682 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.566427 31663 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.566751 31663 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.567044 31663 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.569898 31947 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.564124 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.570871 31566 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 0.
I20260709 12:21:29.573434 31663 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.576584 31617 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.577083 31617 ts_tablet_manager.cc:1403] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.003s
I20260709 12:21:29.581117 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:29.581735 31497 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.586102 31318 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.587368 31617 raft_consensus.cc:359] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.591670 31617 raft_consensus.cc:385] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.589262 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.592108 31617 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.592258 31573 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.592935 31617 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.595301 31617 ts_tablet_manager.cc:1434] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:21:29.597422 31617 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.588907 31663 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.606561 31573 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:29.607906 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:29.608785 31947 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.609341 31947 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:29.600092 31615 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.610143 31615 ts_tablet_manager.cc:1403] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.036s
I20260709 12:21:29.591216 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:21:29.610169 31947 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.613998 31615 raft_consensus.cc:359] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.614476 31663 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.614645 31615 raft_consensus.cc:385] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.614964 31663 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.615002 31615 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.616297 31615 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.618381 31615 ts_tablet_manager.cc:1434] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:21:29.618557 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.616873 31663 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.619305 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:29.619828 31389 leader_election.cc:343] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.620579 31390 leader_election.cc:343] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.620796 31615 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.620965 31390 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.622165 31663 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.630496 31615 tablet_bootstrap.cc:654] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.640213 31616 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.640663 31616 ts_tablet_manager.cc:1403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.009s
I20260709 12:21:29.643159 31617 tablet_bootstrap.cc:654] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.643105 31616 raft_consensus.cc:359] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.643908 31616 raft_consensus.cc:385] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.644511 31615 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.645021 31615 ts_tablet_manager.cc:1403] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 12:21:29.644178 31616 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.645723 31616 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.648082 31615 raft_consensus.cc:359] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.648967 31615 raft_consensus.cc:385] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.649382 31616 ts_tablet_manager.cc:1434] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:21:29.649314 31615 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.650336 31616 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Bootstrap starting.
I20260709 12:21:29.650532 31615 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.654919 31615 ts_tablet_manager.cc:1434] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:21:29.653450 31321 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.659495 31615 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.664917 31616 tablet_bootstrap.cc:654] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.667096 31615 tablet_bootstrap.cc:654] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.671463 31841 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.671940 31841 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.674094 31841 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:29.674623 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.675292 31418 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:29.677240 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.677706 31498 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 0.
I20260709 12:21:29.679593 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:29.680302 31712 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.680655 31712 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.680995 31712 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.687750 31712 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.689649 31712 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:29.705689 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.706540 31418 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.708017 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:29.710738 31498 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.718215 31418 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:29.719035 31617 tablet_bootstrap.cc:492] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.719515 31617 ts_tablet_manager.cc:1403] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.122s	user 0.029s	sys 0.017s
I20260709 12:21:29.720237 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:29.720918 31712 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.721371 31712 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:29.722038 31617 raft_consensus.cc:359] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.722142 31712 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.722775 31617 raft_consensus.cc:385] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.722837 31498 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:21:29.723107 31617 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.723758 31617 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.725832 31617 ts_tablet_manager.cc:1434] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:29.727820 31617 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.729461 31615 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.729895 31615 ts_tablet_manager.cc:1403] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.004s
I20260709 12:21:29.732380 31616 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: No bootstrap required, opened a new log
I20260709 12:21:29.732856 31616 ts_tablet_manager.cc:1403] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.004s
I20260709 12:21:29.733783 31615 raft_consensus.cc:359] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.734586 31615 raft_consensus.cc:385] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.734876 31615 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.735435 31616 raft_consensus.cc:359] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.736205 31616 raft_consensus.cc:385] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.736526 31616 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.738312 31616 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.735869 31615 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.744577 31615 ts_tablet_manager.cc:1434] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:29.745451 31615 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.751106 31615 tablet_bootstrap.cc:654] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.753538 31617 tablet_bootstrap.cc:654] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.758731 31616 ts_tablet_manager.cc:1434] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:21:29.760325 31617 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.760793 31617 ts_tablet_manager.cc:1403] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 12:21:29.762279 31615 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.762773 31615 ts_tablet_manager.cc:1403] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:21:29.763492 31617 raft_consensus.cc:359] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.764163 31617 raft_consensus.cc:385] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.764426 31617 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.765059 31617 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.765537 31615 raft_consensus.cc:359] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.766544 31615 raft_consensus.cc:385] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.766901 31615 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.767576 31615 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.769512 31615 ts_tablet_manager.cc:1434] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:29.766563 31617 ts_tablet_manager.cc:1434] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:21:29.770581 31617 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.770581 31615 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.774307 31712 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.774947 31712 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.776810 31712 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:29.777359 31617 tablet_bootstrap.cc:654] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.782608 31653 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.783093 31653 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.784806 31615 tablet_bootstrap.cc:654] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:29.786237 31318 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.787369 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.787990 31420 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:29.789197 31653 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.789149 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.789944 31653 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.790268 31653 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.790561 31653 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.796617 31653 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.798266 31653 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.800395 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.800499 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.802038 31420 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:29.802095 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.802712 31419 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.804821 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.809657 31566 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.809801 31419 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:29.816979 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.818132 31950 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.818641 31950 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:29.819468 31950 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.822871 31945 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.823360 31945 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.825304 31945 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.827399 31947 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.827894 31947 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.829809 31947 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.831501 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:29.832835 31390 leader_election.cc:343] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.833148 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.833746 31418 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:29.834718 31663 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.835158 31663 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.837023 31663 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.837352 31466 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.838099 31958 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.838446 31958 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.838788 31958 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.845881 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:29.847371 31390 leader_election.cc:343] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.850847 31712 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.851486 31712 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.853919 31712 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:21:29.859735 31465 leader_election.cc:343] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.862874 31945 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:29.865670 31945 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.866108 31945 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.872084 31945 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.869104 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.872855 31712 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.869833 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.858457 31958 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.874862 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.875399 31958 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.875523 31419 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:29.877472 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.878362 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.878990 31419 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.883597 31663 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:29.884038 31663 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.884339 32001 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:29.884830 32001 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:29.885257 32001 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.886972 31663 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.888070 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:21:29.889353 31390 leader_election.cc:343] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.890444 31419 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:29.891664 31466 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.893491 31816 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:29.893955 31816 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:29.894976 31816 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.896665 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.895995 32001 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.903714 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:29.904531 31418 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.904973 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.905540 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.909358 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:29.910622 31321 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.913574 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:29.913829 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:29.915825 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:29.903674 32001 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:29.917433 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:29.920420 31958 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:29.922369 31465 leader_election.cc:343] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.923724 31465 leader_election.cc:343] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.925439 31465 leader_election.cc:343] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.926602 31465 leader_election.cc:343] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:29.929077 31465 leader_election.cc:343] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.924391 31958 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:29.932832 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.933086 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.936331 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:29.940210 31958 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:29.942914 31389 leader_election.cc:343] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.943177 31816 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:29.943418 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.944407 31663 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:29.946632 31389 leader_election.cc:343] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.947029 31389 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.947791 31663 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:29.951712 31389 leader_election.cc:343] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:29.952279 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.953161 31955 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.960449 31540 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:29.962419 31615 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:29.963068 31615 ts_tablet_manager.cc:1403] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.193s	user 0.048s	sys 0.060s
I20260709 12:21:29.963536 32000 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:29.974038 31615 raft_consensus.cc:359] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.974764 31615 raft_consensus.cc:385] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.974982 31617 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:29.975042 31615 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.975553 31617 ts_tablet_manager.cc:1403] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.205s	user 0.045s	sys 0.090s
I20260709 12:21:29.975951 31615 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.977805 31615 ts_tablet_manager.cc:1434] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:21:29.978705 31615 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:29.980468 31617 raft_consensus.cc:359] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.981137 31617 raft_consensus.cc:385] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:29.981403 31617 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:29.982000 31617 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:29.984041 31617 ts_tablet_manager.cc:1434] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:29.984647 31617 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:29.990023 31573 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:29.998632 31318 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.004967 31955 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:30.008184 31615 tablet_bootstrap.cc:654] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.008595 31617 tablet_bootstrap.cc:654] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.002805 31318 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.017794 31572 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.028613 31945 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:30.047698 31615 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:30.048204 31615 ts_tablet_manager.cc:1403] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 12:21:30.050662 31615 raft_consensus.cc:359] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.063512 31615 raft_consensus.cc:385] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.063776 31615 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.068077 31955 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.071717 31617 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.073241 31958 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.073333 32001 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.073709 31958 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.076102 31958 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.072795 31617 ts_tablet_manager.cc:1403] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.017s
I20260709 12:21:30.078472 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.079751 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.079674 31617 raft_consensus.cc:359] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.080502 31617 raft_consensus.cc:385] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.080564 31419 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.080893 31617 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.080614 31615 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.081786 31617 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.082324 31615 ts_tablet_manager.cc:1434] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:21:30.082134 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.083174 31958 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.084128 31617 ts_tablet_manager.cc:1434] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:30.083531 31958 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.085042 31958 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.085147 31617 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.092795 31615 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:30.093647 31617 tablet_bootstrap.cc:654] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:30.094327 31465 leader_election.cc:343] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.125427 31958 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.131861 31615 tablet_bootstrap.cc:654] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.136849 31617 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.137367 31617 ts_tablet_manager.cc:1403] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.020s
I20260709 12:21:30.137382 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.138603 31420 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.139307 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.139858 31617 raft_consensus.cc:359] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.140515 31617 raft_consensus.cc:385] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.138124 31958 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.141069 31617 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.142035 31617 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.142877 31573 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.143990 31615 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:30.144469 31615 ts_tablet_manager.cc:1403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 12:21:30.146874 31615 raft_consensus.cc:359] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.147488 31615 raft_consensus.cc:385] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.147761 31615 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.148358 31615 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.142071 31958 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.149281 31573 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.149533 31958 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.151889 31958 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.152842 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.154196 31617 ts_tablet_manager.cc:1434] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:30.155179 31617 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.158025 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.154211 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.158712 31418 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
W20260709 12:21:30.154215 31465 leader_election.cc:343] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.160725 31615 ts_tablet_manager.cc:1434] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:21:30.161000 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.161124 31617 tablet_bootstrap.cc:654] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.161624 31615 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:30.161828 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:30.162768 31945 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.163218 31945 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.163329 32001 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.163681 32001 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.164004 32001 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.164067 31945 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.171662 32001 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.174343 32001 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.174525 31617 tablet_bootstrap.cc:492] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.175093 31617 ts_tablet_manager.cc:1403] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:21:30.175791 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.176898 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.176404 31418 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.179335 31615 tablet_bootstrap.cc:654] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.178934 31617 raft_consensus.cc:359] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.179749 31617 raft_consensus.cc:385] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.180073 31617 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
W20260709 12:21:30.180193 31465 leader_election.cc:343] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.181082 31841 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.181056 31617 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.191147 31617 ts_tablet_manager.cc:1434] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:21:30.192174 31617 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.193567 31615 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:30.194048 31615 ts_tablet_manager.cc:1403] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 12:21:30.197276 31615 raft_consensus.cc:359] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.198099 31615 raft_consensus.cc:385] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.198364 31615 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.198550 31617 tablet_bootstrap.cc:654] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.199303 31615 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.202338 31418 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.202606 31615 ts_tablet_manager.cc:1434] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:21:30.203584 31615 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Bootstrap starting.
I20260709 12:21:30.204079 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:30.205103 31958 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.205556 31958 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.206321 31958 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.209332 31816 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.209823 31816 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.218228 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.218920 31418 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.220394 32001 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.220173 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.220853 32001 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.221297 31950 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.221679 31950 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.222002 31950 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.223112 31653 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.223662 32001 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.224650 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.223690 31653 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.225400 31418 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.224647 31615 tablet_bootstrap.cc:654] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.228178 31653 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.219997 31321 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.230995 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.230223 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.232246 31418 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.233598 32001 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.233549 31950 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.234189 32001 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.234649 32001 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.248986 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.249115 31841 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.249783 31841 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.250586 32000 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.251091 32000 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.256680 31653 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.257092 31653 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.257408 31653 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.218976 31816 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.312075 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.305006 31841 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.330904 31617 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.332147 31617 ts_tablet_manager.cc:1403] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.140s	user 0.025s	sys 0.008s
W20260709 12:21:30.333246 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84348.1us
I20260709 12:21:30.323210 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.347915 31653 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:30.371007 31370 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:30.352490 31841 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.371701 31841 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.373544 32025 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.376682 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.379930 31418 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.380462 31653 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.381407 31950 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.394359 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.368806 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.395005 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.395200 31421 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.395628 31419 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.395390 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.374367 31841 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.374083 32025 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.351846 32000 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.403730 31617 raft_consensus.cc:359] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.408659 31617 raft_consensus.cc:385] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.408990 31617 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.411867 31617 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:30.421968 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71383.1us
I20260709 12:21:30.424511 32000 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.424969 32000 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.425467 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.426231 31423 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.427994 31615 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: No bootstrap required, opened a new log
I20260709 12:21:30.428428 31615 ts_tablet_manager.cc:1403] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Time spent bootstrapping tablet: real 0.225s	user 0.018s	sys 0.018s
W20260709 12:21:30.429229 31465 leader_election.cc:343] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:30.430642 31465 leader_election.cc:343] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.431839 32000 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.431937 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.435482 31615 raft_consensus.cc:359] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.436182 31615 raft_consensus.cc:385] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.436441 31615 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.437057 31615 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.415763 32001 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.438755 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.439333 31424 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.439713 31419 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.441555 31945 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.412812 31421 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.452723 31617 ts_tablet_manager.cc:1434] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 12:21:30.453874 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.442008 32001 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.443554 31466 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.454660 31495 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.454751 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.455319 32001 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.455724 32001 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.446934 32025 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.449203 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.457273 31615 ts_tablet_manager.cc:1434] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:21:30.456643 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.456236 31816 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:30.456593 32001 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.457837 31617 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.459720 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.461225 32026 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.461661 32026 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.461910 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.462467 32026 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.462481 31421 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.459640 31816 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.464978 31816 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.465780 31816 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.468674 31945 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.456986 32031 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:21:30.469379 31945 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.471097 31319 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.474327 32001 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.479401 31945 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.482278 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.482944 31422 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 0.
I20260709 12:21:30.484421 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.485677 32029 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:30.486037 32029 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:30.486353 32029 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.490317 31421 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.493806 32001 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.495896 31617 tablet_bootstrap.cc:654] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.497228 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.497241 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.498137 31421 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.498585 31816 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.501797 31816 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.504390 31566 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.508988 31421 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.511329 31466 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.512058 32001 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.502596 31816 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.512514 32001 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.512598 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.513329 32001 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.513903 31617 tablet_bootstrap.cc:492] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.514323 31617 ts_tablet_manager.cc:1403] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.008s
I20260709 12:21:30.516711 31565 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.516844 31617 raft_consensus.cc:359] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.517436 31617 raft_consensus.cc:385] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.517720 31617 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.518306 31617 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.520397 32029 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.526572 31617 ts_tablet_manager.cc:1434] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:30.527957 31617 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.527830 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.528462 31565 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.539595 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.542274 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.547501 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.552562 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:21:30.554306 31565 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.554549 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.549762 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:30.556037 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:30.556347 31424 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.548488 32029 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:30.563242 31617 tablet_bootstrap.cc:654] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.564577 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.570338 31424 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:21:30.576599 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:30.577708 32029 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:30.577911 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.578366 32029 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:30.579583 32029 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:30.582095 31465 leader_election.cc:343] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.594619 31945 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.596699 31945 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:30.600646 31465 leader_election.cc:343] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:30.603964 31465 leader_election.cc:343] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:30.605500 31465 leader_election.cc:343] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.606110 31617 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.606577 31617 ts_tablet_manager.cc:1403] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.001s
I20260709 12:21:30.609042 31617 raft_consensus.cc:359] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.609679 31617 raft_consensus.cc:385] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.609922 31617 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.610477 31617 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.611683 32033 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.613508 31617 ts_tablet_manager.cc:1434] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:30.614428 31617 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
W20260709 12:21:30.615286 31465 leader_election.cc:343] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.616453 32029 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:30.618199 31465 leader_election.cc:343] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:30.611783 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.620262 32033 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.621639 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.622316 32033 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.623499 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.623152 31321 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.624140 32033 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.624984 31617 tablet_bootstrap.cc:654] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.625054 31321 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.626741 31321 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.628237 31321 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.636366 32029 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:30.643920 31617 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.644451 31617 ts_tablet_manager.cc:1403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
I20260709 12:21:30.647855 31617 raft_consensus.cc:359] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.648573 31540 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.648597 31617 raft_consensus.cc:385] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.649459 31617 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.650054 31617 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.650957 32033 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.655242 31617 ts_tablet_manager.cc:1434] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:30.657510 31617 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.664170 31617 tablet_bootstrap.cc:654] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:30.696983 31465 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.698127 32026 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.717587 31617 tablet_bootstrap.cc:492] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.718077 31617 ts_tablet_manager.cc:1403] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.014s
I20260709 12:21:30.720710 31617 raft_consensus.cc:359] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.721443 31617 raft_consensus.cc:385] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.721714 31617 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.722316 31617 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.726279 31617 ts_tablet_manager.cc:1434] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:21:30.727201 31617 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Bootstrap starting.
I20260709 12:21:30.732797 31617 tablet_bootstrap.cc:654] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:30.742595 32033 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.743091 32033 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.743731 31617 tablet_bootstrap.cc:492] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: No bootstrap required, opened a new log
I20260709 12:21:30.744139 31617 ts_tablet_manager.cc:1403] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:21:30.745132 32033 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.745951 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.746315 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.746645 31424 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.746892 31617 raft_consensus.cc:359] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.747641 31617 raft_consensus.cc:385] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:30.747898 31617 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Initialized, Role: FOLLOWER
I20260709 12:21:30.748497 31617 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.748136 31321 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.749464 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.750805 31841 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.751652 31617 ts_tablet_manager.cc:1434] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:30.758175 31841 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.817514 31816 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.851500 31841 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.851976 31841 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.853904 31841 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.854410 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.854813 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.855234 31424 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.856583 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.857844 31841 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.862617 31841 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.874433 31841 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.875025 31841 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.877115 31841 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.878540 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.878969 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.879575 31424 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.881831 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.882578 31841 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.888697 31841 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.931484 31945 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.947245 32029 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.951682 31841 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.954650 31841 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.956496 31945 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.958001 31841 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.960939 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.964520 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.965906 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.966622 32033 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:30.962785 31945 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:30.960806 31841 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:30.968797 31841 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:30.971472 31841 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:30.982478 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:21:30.985280 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:21:30.986053 31420 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 1: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:21:30.987529 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:21:30.987602 32029 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.989557 31841 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:30.993247 32001 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:30.997623 31841 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:31.016034 31816 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:31.027263 32029 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:31.064218 32029 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:31.158811 32001 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:21:31.184360 31565 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:31.863567 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:31.897032 32068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:31.897787 32067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:31.897887 32071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:31.899631 30271 server_base.cc:1061] running on GCE node
I20260709 12:21:31.902043 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:31.902292 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:31.902518 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599691902499 us; error 0 us; skew 500 ppm
I20260709 12:21:31.903107 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:31.905964 30271 webserver.cc:533] Webserver started at http://127.29.143.196:35095/ using document root <none> and password file <none>
I20260709 12:21:31.906463 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:31.906630 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:31.907079 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:31.908406 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-3-root/instance:
uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
format_stamp: "Formatted at 2026-07-09 12:21:31 on dist-test-slave-9k85"
I20260709 12:21:31.913048 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:21:31.916366 32076 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:31.917263 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:21:31.917596 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
format_stamp: "Formatted at 2026-07-09 12:21:31 on dist-test-slave-9k85"
I20260709 12:21:31.917963 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:31.952821 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:31.954346 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:31.955703 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:31.958334 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:31.958580 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:31.958889 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:31.959084 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:32.023298 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.196:35667
I20260709 12:21:32.023447 32138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.196:35667 every 8 connection(s)
I20260709 12:21:32.032379 30271 auto_leader_rebalancer-test.cc:439] add a tserver: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:32.045954 32139 heartbeater.cc:344] Connected to a master server at 127.29.143.254:45911
I20260709 12:21:32.046455 32139 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:32.049146 32139 heartbeater.cc:507] Master 127.29.143.254:45911 requested a full tablet report, sending...
I20260709 12:21:32.051380 31319 ts_manager.cc:194] Registered new tserver with Master: e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:21:32.052596 31319 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37622
I20260709 12:21:32.496718 31568 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:32.503978 31497 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.504189 31419 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.506672 32033 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:32.510305 32146 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:32.524904 31537 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e08d75cdb9c24b78bf644d1554c2c5fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.526878 32033 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.528468 31419 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.540150 31497 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.547590 31319 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.578155 31422 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:32.587302 31497 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.587422 31566 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.588973 31955 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:32.593092 31955 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:32.609871 31387 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab86e60df2854213b3c95a365e5f4807. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.609827 31663 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.616025 31497 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.616118 31565 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.640084 31318 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.665354 31497 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:32.689036 31565 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.691288 31419 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.691761 32001 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:32.695261 32001 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:32.717947 31463 consensus_peers.cc:597] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d39355c9d4d4e3b922b43b63d9f6ef6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.718354 32031 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.724252 31419 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.728713 31568 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.739034 31496 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:32.739331 31318 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:32.757084 31463 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0650d5583d6f49e2aba22f8d696283ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:32.758098 31419 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.758195 31568 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:32.759500 32031 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:32.762003 32031 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:32.768579 32029 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.770321 31419 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.781476 31568 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.797987 31318 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:32.965713 32173 ts_tablet_manager.cc:933] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:32.969166 32173 tablet_copy_client.cc:323] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:32.984361 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet ab86e60df2854213b3c95a365e5f4807 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:32.984911 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet ab86e60df2854213b3c95a365e5f4807 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-ab86e60df2854213b3c95a365e5f4807
I20260709 12:21:32.990829 31434 tablet_copy_source_session.cc:215] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:32.994892 32173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab86e60df2854213b3c95a365e5f4807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.010562 32176 ts_tablet_manager.cc:933] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:33.012382 32173 tablet_copy_client.cc:806] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:33.013383 32173 tablet_copy_client.cc:670] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:33.014058 32176 tablet_copy_client.cc:323] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:33.022921 32173 tablet_copy_client.cc:538] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:33.032786 32173 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:33.034425 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet e08d75cdb9c24b78bf644d1554c2c5fe from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:33.035202 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet e08d75cdb9c24b78bf644d1554c2c5fe from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-e08d75cdb9c24b78bf644d1554c2c5fe
I20260709 12:21:33.047142 31585 tablet_copy_source_session.cc:215] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:33.052168 32176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e08d75cdb9c24b78bf644d1554c2c5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.055510 32139 heartbeater.cc:499] Master 127.29.143.254:45911 was elected leader, sending a full tablet report...
I20260709 12:21:33.060209 32173 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:33.061447 32173 tablet_bootstrap.cc:492] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:33.062273 32173 ts_tablet_manager.cc:1403] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:21:33.066619 32173 raft_consensus.cc:359] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.067689 32173 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:33.068496 32173 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.083694 32176 tablet_copy_client.cc:806] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:33.084376 32176 tablet_copy_client.cc:670] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:33.091810 32176 tablet_copy_client.cc:538] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:33.122411 32173 ts_tablet_manager.cc:1434] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.060s	user 0.016s	sys 0.024s
I20260709 12:21:33.124022 32176 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:33.129822 32181 ts_tablet_manager.cc:933] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:33.135726 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-ab86e60df2854213b3c95a365e5f4807 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:33.136265 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-ab86e60df2854213b3c95a365e5f4807 on tablet ab86e60df2854213b3c95a365e5f4807 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:33.145141 32181 tablet_copy_client.cc:323] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:33.164737 32176 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:33.165701 32176 tablet_bootstrap.cc:492] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:33.166378 32176 ts_tablet_manager.cc:1403] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.014s
I20260709 12:21:33.169548 32176 raft_consensus.cc:359] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.170378 32176 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:33.171052 32176 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.173288 32176 ts_tablet_manager.cc:1434] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:33.174662 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:33.176083 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-2d39355c9d4d4e3b922b43b63d9f6ef6
I20260709 12:21:33.177482 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e08d75cdb9c24b78bf644d1554c2c5fe received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:33.177933 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e08d75cdb9c24b78bf644d1554c2c5fe on tablet e08d75cdb9c24b78bf644d1554c2c5fe with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:33.190034 31510 tablet_copy_source_session.cc:215] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:33.192824 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.210510 32181 tablet_copy_client.cc:806] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:33.211112 32181 tablet_copy_client.cc:670] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:33.225351 32181 tablet_copy_client.cc:538] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:33.235527 32181 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:33.259980 32181 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:33.260859 32181 tablet_bootstrap.cc:492] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:33.261440 32181 ts_tablet_manager.cc:1403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.014s
I20260709 12:21:33.264581 32181 raft_consensus.cc:359] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.265622 32181 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:33.266243 32181 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.268042 32181 ts_tablet_manager.cc:1434] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 12:21:33.269645 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-2d39355c9d4d4e3b922b43b63d9f6ef6 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:33.270097 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-2d39355c9d4d4e3b922b43b63d9f6ef6 on tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:33.376654 32181 ts_tablet_manager.cc:933] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:33.378976 32181 tablet_copy_client.cc:323] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:33.380892 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 0650d5583d6f49e2aba22f8d696283ea from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:33.381491 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 0650d5583d6f49e2aba22f8d696283ea from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-0650d5583d6f49e2aba22f8d696283ea
I20260709 12:21:33.387244 31510 tablet_copy_source_session.cc:215] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:33.390614 32181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650d5583d6f49e2aba22f8d696283ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.403913 32181 tablet_copy_client.cc:806] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:33.404471 32181 tablet_copy_client.cc:670] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:33.407650 32181 tablet_copy_client.cc:538] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:33.414835 32181 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:33.432572 32114 raft_consensus.cc:1217] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:33.432915 32181 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:33.433853 32181 tablet_bootstrap.cc:492] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:33.434502 32181 ts_tablet_manager.cc:1403] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.003s
I20260709 12:21:33.442499 32181 raft_consensus.cc:359] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.443451 32181 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:33.444128 32181 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:33.449862 32181 ts_tablet_manager.cc:1434] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:21:33.451740 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-0650d5583d6f49e2aba22f8d696283ea received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:33.452157 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-0650d5583d6f49e2aba22f8d696283ea on tablet 0650d5583d6f49e2aba22f8d696283ea with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:33.479508 32114 raft_consensus.cc:1217] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:33.547088 32114 raft_consensus.cc:1217] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:33.815732 32114 raft_consensus.cc:1217] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:33.925328 32183 raft_consensus.cc:1064] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:33.928256 32183 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:33.936794 32114 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:33.938292 32029 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:33.938724 31571 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:33.943985 32031 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:33.952561 31419 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:33.956538 32001 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:33.955833 32031 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:33.957644 32114 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:33.973397 32033 raft_consensus.cc:1064] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:33.975766 32033 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:33.980965 31318 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:33.989421 31571 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.023960 32114 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.026113 32146 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:34.012440 31419 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.049693 31497 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.052490 31422 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.054302 32188 raft_consensus.cc:1064] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:34.056893 32188 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.054353 32146 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:34.064250 32196 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:34.084214 32114 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.085599 32188 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:34.086494 31497 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.089919 31663 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:34.097929 31571 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.101678 31663 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:34.125684 32033 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.133731 31496 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.137050 32188 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.153394 31422 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.157533 32114 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.160400 31572 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.164383 32113 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.174700 31322 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.182252 31495 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.189769 32112 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.191326 32183 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.193323 31568 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.194531 31319 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.204444 32183 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.210862 32031 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.213217 32112 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.237207 31568 raft_consensus.cc:2955] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.266736 31495 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.278941 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:21:34.283353 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68987.4us
I20260709 12:21:34.343241 31566 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.353593 32114 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.355230 32033 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.356144 31424 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.360863 32199 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:34.362393 32196 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.369853 31322 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.372929 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e08d75cdb9c24b78bf644d1554c2c5fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:34.376765 32114 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.389468 31422 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.396100 31420 raft_consensus.cc:2955] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.398334 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:34.403734 32209 raft_consensus.cc:1064] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:34.404207 32112 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.405565 32208 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:34.407565 31496 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.406184 32209 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.412632 32208 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.416744 31318 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.418920 32188 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.429844 32211 tablet_replica.cc:333] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:34.431006 32211 raft_consensus.cc:2243] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.431629 32211 raft_consensus.cc:2272] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.433105 32112 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.435266 32211 ts_tablet_manager.cc:1916] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:34.444748 31495 raft_consensus.cc:2955] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.454300 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab86e60df2854213b3c95a365e5f4807 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:34.513223 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet e08d75cdb9c24b78bf644d1554c2c5fe with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:34.519207 32211 ts_tablet_manager.cc:1929] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:34.519915 32211 log.cc:1199] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/2d39355c9d4d4e3b922b43b63d9f6ef6
I20260709 12:21:34.524920 31322 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.527513 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 2d39355c9d4d4e3b922b43b63d9f6ef6 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:34.538312 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet ab86e60df2854213b3c95a365e5f4807 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:34.547271 32214 tablet_replica.cc:333] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:34.547938 32112 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.548753 32214 raft_consensus.cc:2243] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.549697 31572 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.553592 32183 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:34.554977 32214 raft_consensus.cc:2272] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.559551 31419 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:34.560662 32215 tablet_replica.cc:333] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:34.561800 32215 raft_consensus.cc:2243] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.562530 32215 raft_consensus.cc:2272] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.565847 32029 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:34.567559 32214 ts_tablet_manager.cc:1916] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:34.571452 32031 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:34.574123 32215 ts_tablet_manager.cc:1916] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:34.610005 32214 ts_tablet_manager.cc:1929] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:34.610517 32214 log.cc:1199] T e08d75cdb9c24b78bf644d1554c2c5fe P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/e08d75cdb9c24b78bf644d1554c2c5fe
I20260709 12:21:34.612015 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet e08d75cdb9c24b78bf644d1554c2c5fe (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:34.614003 32215 ts_tablet_manager.cc:1929] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:34.614499 32215 log.cc:1199] T ab86e60df2854213b3c95a365e5f4807 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/ab86e60df2854213b3c95a365e5f4807
I20260709 12:21:34.616555 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet ab86e60df2854213b3c95a365e5f4807 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:34.620965 32031 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.625759 31422 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.630952 31566 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.635752 32112 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.652801 31322 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.680968 31495 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:34.687326 32112 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.688242 31422 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:34.689960 32217 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:34.691515 32031 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:34.697054 32183 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.699579 32112 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.700580 31422 raft_consensus.cc:2955] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.714221 31318 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:34.719245 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0650d5583d6f49e2aba22f8d696283ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:34.728116 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 0650d5583d6f49e2aba22f8d696283ea with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:34.728997 32215 tablet_replica.cc:333] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:34.730041 32215 raft_consensus.cc:2243] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.731282 32215 raft_consensus.cc:2272] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.733866 32215 ts_tablet_manager.cc:1916] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:34.746169 32215 ts_tablet_manager.cc:1929] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:34.746526 32215 log.cc:1199] T 0650d5583d6f49e2aba22f8d696283ea P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/0650d5583d6f49e2aba22f8d696283ea
I20260709 12:21:34.747725 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 0650d5583d6f49e2aba22f8d696283ea (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:35.805100 31565 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:35.811991 31495 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:35.811991 31422 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:35.812235 31537 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfceb446d3434b4b8dad1af98ef2db39. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:35.813402 32033 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.814302 32222 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.822553 32033 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.823618 31495 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.826524 31422 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.837425 31495 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:35.839288 31321 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:21:35.860981 31463 consensus_peers.cc:597] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b5303969e814b4481d74acd8c7997df. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:35.862146 31565 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:35.862385 31422 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:35.864861 32031 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.869441 32031 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.875877 32183 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.880390 31421 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.893203 31565 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.897413 31424 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:35.897993 31322 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.908133 31495 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:35.909539 32165 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.910699 31565 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:35.913095 31387 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0a95aee9cae4e239fa037efead078d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:35.913552 32165 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.920509 32165 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.922076 31495 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.939528 31495 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:35.951512 31321 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.957988 31565 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.978899 31572 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:35.980839 31463 consensus_peers.cc:597] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bda3e60a745b4a24a244329f3c923858. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:35.986146 32240 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.987278 31424 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:35.988612 32227 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.996685 32240 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.998997 31421 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:35.999307 31565 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:36.017133 31321 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.311149 32243 ts_tablet_manager.cc:933] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:36.322347 32243 tablet_copy_client.cc:323] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:36.323961 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 8b5303969e814b4481d74acd8c7997df from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:36.324497 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 8b5303969e814b4481d74acd8c7997df from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-8b5303969e814b4481d74acd8c7997df
I20260709 12:21:36.327901 32245 ts_tablet_manager.cc:933] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:36.332294 31510 tablet_copy_source_session.cc:215] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:36.332508 32245 tablet_copy_client.cc:323] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:36.334420 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet bfceb446d3434b4b8dad1af98ef2db39 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:36.334977 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet bfceb446d3434b4b8dad1af98ef2db39 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-bfceb446d3434b4b8dad1af98ef2db39
I20260709 12:21:36.336637 32243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5303969e814b4481d74acd8c7997df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.342499 31585 tablet_copy_source_session.cc:215] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:36.346789 32245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfceb446d3434b4b8dad1af98ef2db39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.353478 32243 tablet_copy_client.cc:806] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:36.354101 32243 tablet_copy_client.cc:670] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:36.360738 32243 tablet_copy_client.cc:538] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:36.371423 32243 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:36.378192 32245 tablet_copy_client.cc:806] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:36.378779 32245 tablet_copy_client.cc:670] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:36.383448 32245 tablet_copy_client.cc:538] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:36.396152 32245 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:36.398718 32243 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:36.404062 32243 tablet_bootstrap.cc:492] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:36.404683 32243 ts_tablet_manager.cc:1403] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.009s
I20260709 12:21:36.408643 32243 raft_consensus.cc:359] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.409499 32243 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:36.410143 32243 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.416671 32243 ts_tablet_manager.cc:1434] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:21:36.418351 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8b5303969e814b4481d74acd8c7997df received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:36.418932 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8b5303969e814b4481d74acd8c7997df on tablet 8b5303969e814b4481d74acd8c7997df with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:36.429139 32245 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:36.430187 32245 tablet_bootstrap.cc:492] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:36.430982 32245 ts_tablet_manager.cc:1403] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.014s
I20260709 12:21:36.433758 32245 raft_consensus.cc:359] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.434577 32245 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:36.435190 32245 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.437639 32245 ts_tablet_manager.cc:1434] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:36.439832 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bfceb446d3434b4b8dad1af98ef2db39 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:36.440263 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bfceb446d3434b4b8dad1af98ef2db39 on tablet bfceb446d3434b4b8dad1af98ef2db39 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:36.486352 32245 ts_tablet_manager.cc:933] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:36.488812 32245 tablet_copy_client.cc:323] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:36.490245 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet bda3e60a745b4a24a244329f3c923858 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:36.490842 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet bda3e60a745b4a24a244329f3c923858 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-bda3e60a745b4a24a244329f3c923858
I20260709 12:21:36.497203 31510 tablet_copy_source_session.cc:215] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:36.500213 32245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda3e60a745b4a24a244329f3c923858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.512853 32245 tablet_copy_client.cc:806] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:36.513643 32245 tablet_copy_client.cc:670] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:36.519636 32245 tablet_copy_client.cc:538] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:36.526537 32243 ts_tablet_manager.cc:933] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:36.527215 32245 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:36.528479 32243 tablet_copy_client.cc:323] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:36.530545 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet e0a95aee9cae4e239fa037efead078d5 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:36.531193 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet e0a95aee9cae4e239fa037efead078d5 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-e0a95aee9cae4e239fa037efead078d5
I20260709 12:21:36.538551 31434 tablet_copy_source_session.cc:215] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:36.543934 32243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a95aee9cae4e239fa037efead078d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.553400 32245 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:36.554399 32245 tablet_bootstrap.cc:492] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:36.555048 32245 ts_tablet_manager.cc:1403] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.001s
I20260709 12:21:36.557854 32245 raft_consensus.cc:359] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.558643 32245 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:36.559270 32245 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.562407 32245 ts_tablet_manager.cc:1434] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:36.564275 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bda3e60a745b4a24a244329f3c923858 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:36.564671 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bda3e60a745b4a24a244329f3c923858 on tablet bda3e60a745b4a24a244329f3c923858 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:36.560045 32243 tablet_copy_client.cc:806] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:36.573840 32243 tablet_copy_client.cc:670] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:36.578553 32243 tablet_copy_client.cc:538] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:36.597380 32243 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:36.617457 32243 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:36.618331 32243 tablet_bootstrap.cc:492] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:36.619017 32243 ts_tablet_manager.cc:1403] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.000s
I20260709 12:21:36.621533 32243 raft_consensus.cc:359] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.622180 32243 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:36.622800 32243 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:36.624960 32243 ts_tablet_manager.cc:1434] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:21:36.626811 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e0a95aee9cae4e239fa037efead078d5 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:36.627231 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e0a95aee9cae4e239fa037efead078d5 on tablet e0a95aee9cae4e239fa037efead078d5 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:36.678063 32112 raft_consensus.cc:1217] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:36.894106 32112 raft_consensus.cc:1217] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:36.906323 32112 raft_consensus.cc:1217] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:36.950107 32112 raft_consensus.cc:1217] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:37.103365 32227 raft_consensus.cc:1064] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:37.106050 32227 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.113574 32112 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.113934 31565 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.114903 31424 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.116129 32240 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.117203 32029 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.117916 32227 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:37.151294 32227 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.159220 31565 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.161888 32112 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.192111 31321 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.200341 31419 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.226974 31497 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.234848 32112 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.236693 32262 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.234841 31565 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.240785 32261 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.243881 32254 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.251082 31565 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.257885 32112 raft_consensus.cc:2955] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.266716 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b5303969e814b4481d74acd8c7997df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:37.275763 31318 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.287971 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b5303969e814b4481d74acd8c7997df with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:37.293960 32267 tablet_replica.cc:333] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:37.295107 32267 raft_consensus.cc:2243] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.295816 32267 raft_consensus.cc:2272] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.298905 32267 ts_tablet_manager.cc:1916] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:37.314342 32267 ts_tablet_manager.cc:1929] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:37.314783 32267 log.cc:1199] T 8b5303969e814b4481d74acd8c7997df P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/8b5303969e814b4481d74acd8c7997df
I20260709 12:21:37.316284 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 8b5303969e814b4481d74acd8c7997df (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:37.351671 32165 raft_consensus.cc:1064] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:37.354164 32165 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.361639 31497 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.362452 32112 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.363432 31566 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.363250 32238 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.365278 32269 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:37.366722 32238 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.418439 32222 raft_consensus.cc:1064] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:37.421478 32222 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.445858 32165 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.450426 32113 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.452478 32114 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.453893 32196 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.450698 31497 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.452015 31421 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.462198 32255 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.464005 32255 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:21:37.474901 31322 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.490953 32196 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.495327 31424 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.509910 32261 raft_consensus.cc:1064] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:37.508025 31566 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.509563 31496 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.512359 32261 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.523718 31497 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.525944 32113 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.553597 32114 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.555706 32227 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.556814 31566 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.558969 31420 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:37.559872 32261 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:37.562520 32240 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:37.561435 31318 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.594081 31566 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.597227 32261 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.600216 31421 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.604538 31424 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.606035 32274 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.607154 32113 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.612948 32222 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:37.616178 32255 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.622881 31420 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.625382 31424 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.625631 32112 raft_consensus.cc:2955] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.627730 32114 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.634325 31319 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.641010 32113 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.641767 31566 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.642904 32165 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.644799 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bfceb446d3434b4b8dad1af98ef2db39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:37.644850 32165 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:37.654654 32238 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.655822 31319 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.663162 31565 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.665670 32113 raft_consensus.cc:2955] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.653874 31566 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.671428 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0a95aee9cae4e239fa037efead078d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:37.683133 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet bfceb446d3434b4b8dad1af98ef2db39 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:37.700423 31318 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.713127 32283 tablet_replica.cc:333] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:37.714404 32283 raft_consensus.cc:2243] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.715205 32283 raft_consensus.cc:2272] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.718987 32283 ts_tablet_manager.cc:1916] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:37.718647 31497 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:37.725067 32113 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.726565 32262 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.731371 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet e0a95aee9cae4e239fa037efead078d5 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:37.742774 32283 ts_tablet_manager.cc:1929] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:37.742870 31568 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:37.743477 32283 log.cc:1199] T bfceb446d3434b4b8dad1af98ef2db39 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/bfceb446d3434b4b8dad1af98ef2db39
I20260709 12:21:37.745427 32283 tablet_replica.cc:333] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:37.746460 32283 raft_consensus.cc:2243] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.746743 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet bfceb446d3434b4b8dad1af98ef2db39 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:37.747416 32283 raft_consensus.cc:2272] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.747288 32240 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.751068 32283 ts_tablet_manager.cc:1916] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:37.751644 32113 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.780005 32262 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:37.779532 31321 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.792481 32283 ts_tablet_manager.cc:1929] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:37.792992 32283 log.cc:1199] T e0a95aee9cae4e239fa037efead078d5 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/e0a95aee9cae4e239fa037efead078d5
I20260709 12:21:37.793509 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet bda3e60a745b4a24a244329f3c923858 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:37.794397 32267 tablet_replica.cc:333] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:37.794934 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet e0a95aee9cae4e239fa037efead078d5 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:37.798840 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bda3e60a745b4a24a244329f3c923858 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:37.801560 31566 raft_consensus.cc:2955] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:37.806192 32267 raft_consensus.cc:2243] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.806953 32267 raft_consensus.cc:2272] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.810377 32267 ts_tablet_manager.cc:1916] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:37.825413 32267 ts_tablet_manager.cc:1929] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:37.825788 32267 log.cc:1199] T bda3e60a745b4a24a244329f3c923858 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/bda3e60a745b4a24a244329f3c923858
I20260709 12:21:37.827135 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet bda3e60a745b4a24a244329f3c923858 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:38.867617 31496 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:38.873252 31566 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:38.873943 31463 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb26db0e5b834d508281418291d5c108. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.875177 31420 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:38.875203 32029 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.876497 32286 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.882407 32029 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.884156 31566 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.895597 31421 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:38.901726 31319 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.906539 31420 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.912420 31566 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:38.912551 31387 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 341ae51396d44edeba0872b9567766e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.913868 31496 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:38.913996 32269 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.917454 32256 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.929754 32256 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.936640 31496 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.943434 31497 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:38.943396 31566 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:21:38.960712 31463 consensus_peers.cc:597] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4cfa84e581647da8d228ad20eb18205. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.961355 31420 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:38.962924 32285 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.980499 32029 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.984870 31566 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:38.990151 32285 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.993608 31421 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:38.990437 31321 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.039948 31496 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.044543 31566 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.060649 31318 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.074405 31566 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:39.073218 31463 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84c7d950f0b944939a3a24f8336687e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.076143 32286 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.079615 31420 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:39.085230 32303 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.094259 32284 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.096148 31566 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.099714 31424 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.119964 31319 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:39.397789 32309 ts_tablet_manager.cc:933] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:39.399972 32309 tablet_copy_client.cc:323] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:39.401540 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet c4cfa84e581647da8d228ad20eb18205 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:39.402055 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet c4cfa84e581647da8d228ad20eb18205 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-c4cfa84e581647da8d228ad20eb18205
I20260709 12:21:39.409936 31510 tablet_copy_source_session.cc:215] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:39.414631 32309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cfa84e581647da8d228ad20eb18205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.431584 32311 ts_tablet_manager.cc:933] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:39.433959 32309 tablet_copy_client.cc:806] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:39.434569 32309 tablet_copy_client.cc:670] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:39.447065 32309 tablet_copy_client.cc:538] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:39.457695 32309 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:39.460757 32311 tablet_copy_client.cc:323] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:39.462888 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet 341ae51396d44edeba0872b9567766e7 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:39.464565 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet 341ae51396d44edeba0872b9567766e7 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-341ae51396d44edeba0872b9567766e7
I20260709 12:21:39.473737 31434 tablet_copy_source_session.cc:215] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:39.482424 32311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341ae51396d44edeba0872b9567766e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.493853 32309 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:39.494791 32313 ts_tablet_manager.cc:933] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:39.494884 32309 tablet_bootstrap.cc:492] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:39.497018 32309 ts_tablet_manager.cc:1403] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.010s
I20260709 12:21:39.503171 32309 raft_consensus.cc:359] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.503906 32309 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:39.504170 32311 tablet_copy_client.cc:806] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:39.504717 32311 tablet_copy_client.cc:670] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:39.504556 32309 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.505520 32313 tablet_copy_client.cc:323] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:39.508289 32309 ts_tablet_manager.cc:1434] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:21:39.509335 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet bb26db0e5b834d508281418291d5c108 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:39.509555 32311 tablet_copy_client.cc:538] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:39.509899 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet bb26db0e5b834d508281418291d5c108 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-bb26db0e5b834d508281418291d5c108
I20260709 12:21:39.519742 31510 tablet_copy_source_session.cc:215] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:39.523751 32313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb26db0e5b834d508281418291d5c108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.529273 32311 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:39.522846 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-c4cfa84e581647da8d228ad20eb18205 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:39.530925 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-c4cfa84e581647da8d228ad20eb18205 on tablet c4cfa84e581647da8d228ad20eb18205 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:39.540282 32313 tablet_copy_client.cc:806] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:39.541563 32313 tablet_copy_client.cc:670] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:39.546375 32313 tablet_copy_client.cc:538] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:39.556082 32313 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:39.560500 32311 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:39.561453 32311 tablet_bootstrap.cc:492] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:39.562127 32311 ts_tablet_manager.cc:1403] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.005s
I20260709 12:21:39.565183 32311 raft_consensus.cc:359] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.566051 32311 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:39.566661 32311 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.592965 32311 ts_tablet_manager.cc:1434] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.007s
I20260709 12:21:39.596027 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-341ae51396d44edeba0872b9567766e7 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:39.596473 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-341ae51396d44edeba0872b9567766e7 on tablet 341ae51396d44edeba0872b9567766e7 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:39.602692 32313 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:39.603559 32313 tablet_bootstrap.cc:492] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:39.604239 32313 ts_tablet_manager.cc:1403] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.048s	user 0.029s	sys 0.012s
I20260709 12:21:39.606948 32313 raft_consensus.cc:359] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.607751 32313 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:39.608332 32313 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.610272 32313 ts_tablet_manager.cc:1434] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:39.612535 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bb26db0e5b834d508281418291d5c108 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:39.612915 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bb26db0e5b834d508281418291d5c108 on tablet bb26db0e5b834d508281418291d5c108 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:39.632396 32311 ts_tablet_manager.cc:933] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:39.675649 32311 tablet_copy_client.cc:323] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:39.681095 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 84c7d950f0b944939a3a24f8336687e2 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:39.681630 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 84c7d950f0b944939a3a24f8336687e2 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-84c7d950f0b944939a3a24f8336687e2
I20260709 12:21:39.687696 31510 tablet_copy_source_session.cc:215] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:39.690449 32311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c7d950f0b944939a3a24f8336687e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:39.700399 32311 tablet_copy_client.cc:806] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:39.700915 32311 tablet_copy_client.cc:670] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:39.704825 32311 tablet_copy_client.cc:538] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:39.714421 32311 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:39.730422 32311 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:39.731424 32311 tablet_bootstrap.cc:492] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:39.732005 32311 ts_tablet_manager.cc:1403] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 12:21:39.734357 32311 raft_consensus.cc:359] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.735172 32311 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:39.735980 32311 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:39.738186 32311 ts_tablet_manager.cc:1434] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:39.740049 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-84c7d950f0b944939a3a24f8336687e2 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:39.740439 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-84c7d950f0b944939a3a24f8336687e2 on tablet 84c7d950f0b944939a3a24f8336687e2 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:39.829205 32112 raft_consensus.cc:1217] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:39.911545 32112 raft_consensus.cc:1217] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:39.971505 32112 raft_consensus.cc:1217] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:40.132678 32112 raft_consensus.cc:1217] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:40.213284 32256 raft_consensus.cc:1064] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:40.215723 32256 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.228132 32112 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.228894 31496 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.228138 31566 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.230182 32256 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:40.231412 32299 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.242671 32322 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:40.253520 32256 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.257182 31566 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.271242 32112 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.264801 31496 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.284950 31318 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.341454 31421 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.346251 32112 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.347113 32284 raft_consensus.cc:1064] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:40.348147 31566 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.349433 32256 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.349553 32284 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.351248 32256 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.360280 32328 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.366214 32113 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.365687 31572 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.368211 32286 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.369643 32113 raft_consensus.cc:2955] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.374455 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 341ae51396d44edeba0872b9567766e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:40.384788 31322 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.390053 31572 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.391920 31421 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.391935 32286 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:40.393889 32305 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.411020 32286 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.412451 31424 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.422925 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 341ae51396d44edeba0872b9567766e7 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:40.452108 32338 tablet_replica.cc:333] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:40.456602 32113 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:21:40.474464 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55229.8us
I20260709 12:21:40.487556 31322 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.493028 32338 raft_consensus.cc:2243] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:40.493865 32338 raft_consensus.cc:2272] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:40.497561 32338 ts_tablet_manager.cc:1916] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:40.506091 31568 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.531972 32338 ts_tablet_manager.cc:1929] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:40.532452 32338 log.cc:1199] T 341ae51396d44edeba0872b9567766e7 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/341ae51396d44edeba0872b9567766e7
I20260709 12:21:40.535096 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 341ae51396d44edeba0872b9567766e7 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:40.537359 31496 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.542577 32113 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.543176 31568 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.544528 32284 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.545997 32341 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.552997 32305 raft_consensus.cc:1064] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:40.555624 32305 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.556386 32342 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.561316 32112 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.571417 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4cfa84e581647da8d228ad20eb18205 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:40.574342 31566 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.575295 31321 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.578879 31420 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.580363 32337 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.581492 32284 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.584316 32112 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.569463 31568 raft_consensus.cc:2955] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.586557 32284 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.595353 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet c4cfa84e581647da8d228ad20eb18205 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:40.627734 32346 tablet_replica.cc:333] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:40.627650 32284 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.629050 32346 raft_consensus.cc:2243] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:40.629788 32346 raft_consensus.cc:2272] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:40.630182 32112 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.669220 32346 ts_tablet_manager.cc:1916] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:40.685519 31319 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.690033 31568 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.690114 31420 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.696547 32346 ts_tablet_manager.cc:1929] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:40.696977 32346 log.cc:1199] T c4cfa84e581647da8d228ad20eb18205 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/c4cfa84e581647da8d228ad20eb18205
I20260709 12:21:40.700274 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet c4cfa84e581647da8d228ad20eb18205 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:40.709415 32337 raft_consensus.cc:1064] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:40.712138 32337 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.725805 31568 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.726145 32113 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.726183 31420 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:40.728107 32341 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:40.730850 32341 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.733374 32341 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:40.734333 31496 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.740207 31422 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.742290 32112 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.742159 32286 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.744551 32337 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.755991 32286 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.758694 31422 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.760489 32284 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.766837 31420 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.774367 32114 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.766896 32112 raft_consensus.cc:2955] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.789808 31319 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.798138 31566 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.804082 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb26db0e5b834d508281418291d5c108 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:40.808228 31322 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.819819 31496 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:40.834313 31422 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.837206 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet bb26db0e5b834d508281418291d5c108 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:40.841197 32112 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:40.836647 32339 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:21:40.845737 32352 tablet_replica.cc:333] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:40.846638 32286 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:40.847016 32352 raft_consensus.cc:2243] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:40.848588 32352 raft_consensus.cc:2272] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:40.856947 32352 ts_tablet_manager.cc:1916] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:40.862237 31421 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.854398 32337 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.872598 32112 raft_consensus.cc:2955] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.873783 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84c7d950f0b944939a3a24f8336687e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:40.879858 32352 ts_tablet_manager.cc:1929] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:40.880277 32352 log.cc:1199] T bb26db0e5b834d508281418291d5c108 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/bb26db0e5b834d508281418291d5c108
I20260709 12:21:40.882318 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet bb26db0e5b834d508281418291d5c108 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:40.889093 31322 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:40.902055 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 84c7d950f0b944939a3a24f8336687e2 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:40.902961 32352 tablet_replica.cc:333] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:40.903977 32352 raft_consensus.cc:2243] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:40.904568 32352 raft_consensus.cc:2272] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:40.907560 32352 ts_tablet_manager.cc:1916] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:40.918057 32352 ts_tablet_manager.cc:1929] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:40.918382 32352 log.cc:1199] T 84c7d950f0b944939a3a24f8336687e2 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/84c7d950f0b944939a3a24f8336687e2
I20260709 12:21:40.919845 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 84c7d950f0b944939a3a24f8336687e2 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:41.983670 31568 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:41.990906 31496 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:41.991223 31537 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bca4f4ed71aa4cfd84010eb5f7ee80ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:41.992102 31421 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:41.992434 32340 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:41.993618 32319 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.004866 32340 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.008407 31496 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.008860 31421 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.021096 31568 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:21:42.029631 31537 consensus_peers.cc:597] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5aa949305b1a42489bcc1e0b4287c6c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:42.030326 31421 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:42.030942 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:42.027675 31319 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.032382 32340 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.034143 32319 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.048237 32357 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.051647 31496 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.051350 31421 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.065110 31496 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.077170 31318 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:21:42.084266 31463 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c70f01b47774cc48e80fabd1ef37f2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:42.084470 31568 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:42.084489 31421 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:42.086036 32339 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:42.087026 32284 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.095541 32284 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.096988 31568 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.104691 31422 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.109875 31568 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.111415 31319 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.126392 31496 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:42.128051 32319 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.128908 31421 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:42.128912 31537 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d3e8b68142d4e34a867ce6d3a9fb56d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:42.132520 32319 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:42.141084 32319 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.144944 31421 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.160116 31497 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.179067 31319 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:42.418521 32372 ts_tablet_manager.cc:933] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:42.426481 32372 tablet_copy_client.cc:323] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:42.429296 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 5aa949305b1a42489bcc1e0b4287c6c3 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:42.429981 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 5aa949305b1a42489bcc1e0b4287c6c3 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-5aa949305b1a42489bcc1e0b4287c6c3
I20260709 12:21:42.442420 31585 tablet_copy_source_session.cc:215] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:42.456799 32372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa949305b1a42489bcc1e0b4287c6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:42.472265 32372 tablet_copy_client.cc:806] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:42.472957 32372 tablet_copy_client.cc:670] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:42.478026 32372 tablet_copy_client.cc:538] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:42.485539 32372 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:42.510841 32372 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:42.512598 32372 tablet_bootstrap.cc:492] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:42.513334 32372 ts_tablet_manager.cc:1403] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 12:21:42.515902 32372 raft_consensus.cc:359] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.516666 32372 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:42.517213 32372 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.521699 32372 ts_tablet_manager.cc:1434] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:42.524271 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-5aa949305b1a42489bcc1e0b4287c6c3 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:42.524750 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-5aa949305b1a42489bcc1e0b4287c6c3 on tablet 5aa949305b1a42489bcc1e0b4287c6c3 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:42.573216 32372 ts_tablet_manager.cc:933] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:42.575048 32372 tablet_copy_client.cc:323] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:42.576437 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:42.576967 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet bca4f4ed71aa4cfd84010eb5f7ee80ea from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-bca4f4ed71aa4cfd84010eb5f7ee80ea
I20260709 12:21:42.584637 31585 tablet_copy_source_session.cc:215] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:42.587450 32372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:42.598218 32372 tablet_copy_client.cc:806] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:42.598795 32372 tablet_copy_client.cc:670] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:42.602860 32372 tablet_copy_client.cc:538] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:42.611306 32372 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:42.625180 32378 ts_tablet_manager.cc:933] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:42.630429 32378 tablet_copy_client.cc:323] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:42.632012 32372 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:42.632249 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 6c70f01b47774cc48e80fabd1ef37f2e from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:42.632793 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 6c70f01b47774cc48e80fabd1ef37f2e from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-6c70f01b47774cc48e80fabd1ef37f2e
I20260709 12:21:42.632978 32372 tablet_bootstrap.cc:492] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:42.633685 32372 ts_tablet_manager.cc:1403] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:21:42.636595 32372 raft_consensus.cc:359] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.637475 32372 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:42.638609 32372 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.641077 32372 ts_tablet_manager.cc:1434] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:42.642829 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bca4f4ed71aa4cfd84010eb5f7ee80ea received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:42.643204 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-bca4f4ed71aa4cfd84010eb5f7ee80ea on tablet bca4f4ed71aa4cfd84010eb5f7ee80ea with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:42.652444 31510 tablet_copy_source_session.cc:215] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:42.655761 32378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c70f01b47774cc48e80fabd1ef37f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:42.669278 32378 tablet_copy_client.cc:806] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:42.669905 32378 tablet_copy_client.cc:670] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:42.673230 32378 tablet_copy_client.cc:538] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:42.680070 32378 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:42.690037 32372 ts_tablet_manager.cc:933] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:42.692068 32372 tablet_copy_client.cc:323] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:42.693720 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:42.694231 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 7d3e8b68142d4e34a867ce6d3a9fb56d from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-7d3e8b68142d4e34a867ce6d3a9fb56d
I20260709 12:21:42.697118 32378 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:42.698088 32378 tablet_bootstrap.cc:492] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:42.698879 32378 ts_tablet_manager.cc:1403] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.001s
I20260709 12:21:42.701926 32378 raft_consensus.cc:359] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.702845 32378 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:42.703264 31585 tablet_copy_source_session.cc:215] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:42.704487 32378 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.709524 32378 ts_tablet_manager.cc:1434] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:21:42.710813 32372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:42.715273 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-6c70f01b47774cc48e80fabd1ef37f2e received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:42.715739 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-6c70f01b47774cc48e80fabd1ef37f2e on tablet 6c70f01b47774cc48e80fabd1ef37f2e with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:42.735780 32372 tablet_copy_client.cc:806] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:42.736420 32372 tablet_copy_client.cc:670] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:42.740108 32372 tablet_copy_client.cc:538] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:42.749218 32372 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:42.784595 32372 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:42.785257 32372 tablet_bootstrap.cc:492] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:42.785742 32372 ts_tablet_manager.cc:1403] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.011s
I20260709 12:21:42.787721 32372 raft_consensus.cc:359] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.788255 32372 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:42.788725 32372 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:42.790628 32372 ts_tablet_manager.cc:1434] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:42.792497 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-7d3e8b68142d4e34a867ce6d3a9fb56d received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:42.792893 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-7d3e8b68142d4e34a867ce6d3a9fb56d on tablet 7d3e8b68142d4e34a867ce6d3a9fb56d with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:42.808907 32114 raft_consensus.cc:1217] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:42.974229 32114 raft_consensus.cc:1217] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:43.002728 32114 raft_consensus.cc:1217] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:43.259657 32112 raft_consensus.cc:1217] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:43.378942 32319 raft_consensus.cc:1064] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:43.381158 32319 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.388792 32114 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.390096 32357 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.392769 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.394745 32383 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.402977 31421 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.404120 32383 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.406291 32385 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.407905 31497 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.417331 32357 raft_consensus.cc:1064] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:43.420056 32357 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.431732 32114 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.434080 31322 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.445681 32112 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.459160 32337 raft_consensus.cc:1064] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:43.459717 31497 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.452286 32391 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.461688 32337 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.462594 32392 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:43.470747 31422 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.477887 32385 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:43.491492 31420 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.520622 32112 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.521324 31566 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.522662 32284 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.535174 32284 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:43.550319 31420 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.551992 32339 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.564438 32385 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.565549 32114 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:21:43.594901 32396 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:21:43.598407 31496 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:21:43.613018 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59355.6us
I20260709 12:21:43.613762 31420 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.640076 32339 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.647600 32114 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.662425 31424 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.654348 31321 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.668434 31568 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.690500 31572 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.693173 31322 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.697548 32114 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.697819 31568 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.699158 32385 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:43.703045 32112 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.704643 32393 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:43.702562 31496 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.708212 32395 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:43.710522 32395 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.711812 32112 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.713550 32357 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.719802 31424 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.720817 32113 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.731537 32393 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:21:43.732785 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:43.744493 31496 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.748685 31421 raft_consensus.cc:2955] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.750995 32112 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.754047 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5aa949305b1a42489bcc1e0b4287c6c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:43.753444 31496 raft_consensus.cc:2955] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.756672 31424 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.752775 32339 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:21:43.760174 31321 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.762151 31321 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.763329 32407 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:43.772735 32337 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.778211 32113 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.782045 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c70f01b47774cc48e80fabd1ef37f2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:43.785588 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet bca4f4ed71aa4cfd84010eb5f7ee80ea with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:43.791563 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aa949305b1a42489bcc1e0b4287c6c3 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:43.792721 31421 raft_consensus.cc:2955] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.803973 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:43.811759 32411 tablet_replica.cc:333] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:43.816125 32410 tablet_replica.cc:333] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:43.817377 32410 raft_consensus.cc:2243] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.818189 32410 raft_consensus.cc:2272] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.823928 32410 ts_tablet_manager.cc:1916] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:43.832880 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c70f01b47774cc48e80fabd1ef37f2e with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:43.833431 32357 raft_consensus.cc:1064] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:43.835996 32357 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.841755 32410 ts_tablet_manager.cc:1929] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:43.842306 32410 log.cc:1199] T bca4f4ed71aa4cfd84010eb5f7ee80ea P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/bca4f4ed71aa4cfd84010eb5f7ee80ea
I20260709 12:21:43.844012 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet bca4f4ed71aa4cfd84010eb5f7ee80ea (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:43.870231 32113 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.870894 31496 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.872159 32389 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:43.872583 32412 tablet_replica.cc:333] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:43.873077 32319 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.881289 32411 raft_consensus.cc:2243] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.881923 32411 raft_consensus.cc:2272] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.885556 31421 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:43.886574 32411 ts_tablet_manager.cc:1916] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:43.889760 32389 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:43.890669 32412 raft_consensus.cc:2243] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.892912 32412 raft_consensus.cc:2272] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.911907 32411 ts_tablet_manager.cc:1929] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:43.912482 32411 log.cc:1199] T 5aa949305b1a42489bcc1e0b4287c6c3 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/5aa949305b1a42489bcc1e0b4287c6c3
I20260709 12:21:43.914233 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 5aa949305b1a42489bcc1e0b4287c6c3 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:43.927891 32412 ts_tablet_manager.cc:1916] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:43.930543 32357 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.933303 32113 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.937419 31496 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.946929 32412 ts_tablet_manager.cc:1929] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:43.947522 32412 log.cc:1199] T 6c70f01b47774cc48e80fabd1ef37f2e P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/6c70f01b47774cc48e80fabd1ef37f2e
I20260709 12:21:43.949424 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 6c70f01b47774cc48e80fabd1ef37f2e (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:43.952404 31421 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.960659 31319 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.975558 31568 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:43.980501 31421 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.980501 32113 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:43.982134 32389 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:43.983080 32357 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:43.989154 32319 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:43.992900 32113 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:44.003273 31421 raft_consensus.cc:2955] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:44.005481 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:44.008172 31322 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:44.025487 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d3e8b68142d4e34a867ce6d3a9fb56d with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:44.026392 32410 tablet_replica.cc:333] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:44.027300 32410 raft_consensus.cc:2243] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:44.027971 32410 raft_consensus.cc:2272] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:44.031095 32410 ts_tablet_manager.cc:1916] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:44.047703 32410 ts_tablet_manager.cc:1929] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:44.048108 32410 log.cc:1199] T 7d3e8b68142d4e34a867ce6d3a9fb56d P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/7d3e8b68142d4e34a867ce6d3a9fb56d
I20260709 12:21:44.049305 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 7d3e8b68142d4e34a867ce6d3a9fb56d (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:45.093191 31497 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:21:45.099701 31463 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4592ece2c344a3a8564f95da501ac46. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:45.102415 31421 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.104985 31568 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.104816 32407 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.108659 32419 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.122423 32419 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.124846 31568 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.126047 31421 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.141575 31318 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.149961 31568 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:21:45.157496 31537 consensus_peers.cc:597] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21e357624c0f4e5f89de3446133ddb5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:45.158595 31497 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.161764 32389 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:45.182044 32357 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.183269 31421 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.191066 32430 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:45.192878 31497 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.198439 31496 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.222150 31321 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.244923 31421 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:21:45.250084 31463 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f97e5105626c48be9d1768855511628a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:45.250212 31568 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.250537 31420 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.251614 32419 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.254395 32337 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.264894 32407 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.266042 31568 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.267381 31421 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.277616 31419 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.284998 31321 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:45.294358 31387 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27c769ef5464411f973f730390441710. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:45.295578 31495 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.297215 32256 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.305866 32256 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.308411 31497 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.307668 31568 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:45.319556 32417 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.327913 31568 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.335554 31322 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:45.526108 32442 ts_tablet_manager.cc:933] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:45.530149 32442 tablet_copy_client.cc:323] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:45.531837 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet d4592ece2c344a3a8564f95da501ac46 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:45.532276 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet d4592ece2c344a3a8564f95da501ac46 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-d4592ece2c344a3a8564f95da501ac46
I20260709 12:21:45.538623 31510 tablet_copy_source_session.cc:215] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:45.541944 32442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4592ece2c344a3a8564f95da501ac46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:45.559213 32442 tablet_copy_client.cc:806] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:45.559839 32442 tablet_copy_client.cc:670] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:45.563735 32442 tablet_copy_client.cc:538] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:45.573763 32442 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:45.598008 32442 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:45.599079 32442 tablet_bootstrap.cc:492] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:45.599869 32442 ts_tablet_manager.cc:1403] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.012s
I20260709 12:21:45.603823 32442 raft_consensus.cc:359] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.604797 32442 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:45.605568 32442 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.609018 32442 ts_tablet_manager.cc:1434] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:45.610797 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d4592ece2c344a3a8564f95da501ac46 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:45.611227 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d4592ece2c344a3a8564f95da501ac46 on tablet d4592ece2c344a3a8564f95da501ac46 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:45.633805 32442 ts_tablet_manager.cc:933] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:45.636082 32442 tablet_copy_client.cc:323] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:45.638185 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 21e357624c0f4e5f89de3446133ddb5c from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:45.638726 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 21e357624c0f4e5f89de3446133ddb5c from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-21e357624c0f4e5f89de3446133ddb5c
I20260709 12:21:45.644223 31585 tablet_copy_source_session.cc:215] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:45.647413 32442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e357624c0f4e5f89de3446133ddb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:45.664529 32442 tablet_copy_client.cc:806] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:45.665192 32442 tablet_copy_client.cc:670] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:45.670569 32442 tablet_copy_client.cc:538] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:45.681054 32442 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:45.707083 32442 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:45.708125 32442 tablet_bootstrap.cc:492] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:45.708880 32442 ts_tablet_manager.cc:1403] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:21:45.711985 32442 raft_consensus.cc:359] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.712942 32442 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:45.713687 32442 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.720497 32442 ts_tablet_manager.cc:1434] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:45.722599 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-21e357624c0f4e5f89de3446133ddb5c received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:45.723069 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-21e357624c0f4e5f89de3446133ddb5c on tablet 21e357624c0f4e5f89de3446133ddb5c with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:45.747752 32442 ts_tablet_manager.cc:933] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:45.749446 32442 tablet_copy_client.cc:323] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:45.751384 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet 27c769ef5464411f973f730390441710 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:45.751951 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet 27c769ef5464411f973f730390441710 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-27c769ef5464411f973f730390441710
I20260709 12:21:45.760592 31434 tablet_copy_source_session.cc:215] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:45.763635 32442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c769ef5464411f973f730390441710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:45.775486 32442 tablet_copy_client.cc:806] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:45.776072 32442 tablet_copy_client.cc:670] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:45.779978 32442 tablet_copy_client.cc:538] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:45.785411 32442 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
W20260709 12:21:45.884589 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57624.3us
I20260709 12:21:45.929036 32455 ts_tablet_manager.cc:933] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:45.929860 32442 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:45.931021 32442 tablet_bootstrap.cc:492] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:45.931754 32442 ts_tablet_manager.cc:1403] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.146s	user 0.059s	sys 0.061s
I20260709 12:21:45.933457 32455 tablet_copy_client.cc:323] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:45.934650 32442 raft_consensus.cc:359] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.935623 32442 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:45.936298 32442 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:45.939582 32442 ts_tablet_manager.cc:1434] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:45.941437 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet f97e5105626c48be9d1768855511628a from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:45.941740 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-27c769ef5464411f973f730390441710 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:45.941984 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet f97e5105626c48be9d1768855511628a from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-f97e5105626c48be9d1768855511628a
I20260709 12:21:45.942269 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-27c769ef5464411f973f730390441710 on tablet 27c769ef5464411f973f730390441710 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:45.950449 31510 tablet_copy_source_session.cc:215] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:45.955300 32455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f97e5105626c48be9d1768855511628a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:45.971903 32455 tablet_copy_client.cc:806] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:45.972486 32455 tablet_copy_client.cc:670] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:45.975772 32455 tablet_copy_client.cc:538] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:45.984921 32455 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:46.007303 32455 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:46.008009 32455 tablet_bootstrap.cc:492] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:46.008531 32455 ts_tablet_manager.cc:1403] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.001s
I20260709 12:21:46.010993 32455 raft_consensus.cc:359] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:46.011875 32455 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:46.012564 32455 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:46.015440 32455 ts_tablet_manager.cc:1434] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:46.017419 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-f97e5105626c48be9d1768855511628a received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:46.017902 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-f97e5105626c48be9d1768855511628a on tablet f97e5105626c48be9d1768855511628a with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:46.049371 32113 raft_consensus.cc:1217] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:46.112646 32113 raft_consensus.cc:1217] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:46.357213 32113 raft_consensus.cc:1217] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:46.369447 32113 raft_consensus.cc:1217] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:46.544122 32452 raft_consensus.cc:1064] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:46.546829 32452 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:46.555094 31497 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.555752 32113 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.556725 32430 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.557809 32451 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.558117 31421 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.560032 32451 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.566314 32430 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.571331 32113 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.573895 31421 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.577889 31497 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.585101 31318 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.605209 32337 raft_consensus.cc:1064] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:46.607558 32337 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:46.614766 32114 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.616667 31568 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.616984 32421 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.618438 32454 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.630079 31419 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.631857 32337 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.655957 32421 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.657541 31568 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.662228 32113 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.670601 31421 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.682760 31568 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:46.691082 31497 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:46.691982 31319 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.694252 32430 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:46.700304 32113 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:46.704250 32452 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:46.707310 32452 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.709481 31495 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:46.709245 31497 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.716056 32114 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:46.718400 32473 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:46.721076 31421 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:46.724001 32337 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:46.725536 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21e357624c0f4e5f89de3446133ddb5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:46.730854 32454 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.728643 32114 raft_consensus.cc:2955] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.736495 31318 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.739749 31421 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.747905 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e357624c0f4e5f89de3446133ddb5c with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:46.751771 32113 raft_consensus.cc:2955] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.757323 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4592ece2c344a3a8564f95da501ac46 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:46.769372 31319 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.785328 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet d4592ece2c344a3a8564f95da501ac46 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:46.785614 32474 tablet_replica.cc:333] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:46.786731 32474 raft_consensus.cc:2243] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:46.787514 32474 raft_consensus.cc:2272] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:46.794062 32474 ts_tablet_manager.cc:1916] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:46.818799 32474 ts_tablet_manager.cc:1929] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:46.820322 32474 log.cc:1199] T 21e357624c0f4e5f89de3446133ddb5c P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/21e357624c0f4e5f89de3446133ddb5c
I20260709 12:21:46.822196 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 21e357624c0f4e5f89de3446133ddb5c (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
W20260709 12:21:46.830684 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49412.5us
I20260709 12:21:46.840482 32476 tablet_replica.cc:333] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:46.841547 32476 raft_consensus.cc:2243] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:46.843009 32476 raft_consensus.cc:2272] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:46.844591 32473 raft_consensus.cc:1064] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:46.847682 32473 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:46.848274 32476 ts_tablet_manager.cc:1916] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:46.862437 32113 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.864383 31424 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.864967 31566 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:46.865115 32454 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.866003 32475 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:46.875447 32473 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:21:46.946844 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57327us
I20260709 12:21:46.948596 32456 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.962649 32476 ts_tablet_manager.cc:1929] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:46.963203 32476 log.cc:1199] T d4592ece2c344a3a8564f95da501ac46 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/d4592ece2c344a3a8564f95da501ac46
I20260709 12:21:46.969658 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet d4592ece2c344a3a8564f95da501ac46 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:46.973829 31421 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.974505 31566 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.975198 32112 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:46.981159 31319 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.016403 31497 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:47.023342 32482 raft_consensus.cc:1064] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:47.025931 32482 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:47.034183 31566 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:47.034996 31497 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:47.035403 32112 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:47.036032 31424 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:47.036742 32114 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:47.038507 32456 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.039537 32337 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.036526 32482 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.042208 32441 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.044337 32481 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:47.062753 32481 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.076431 31421 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.068275 32337 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.081228 32113 raft_consensus.cc:2955] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.088441 32112 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.109637 31318 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.112229 31322 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.115090 31566 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.118893 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f97e5105626c48be9d1768855511628a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:47.131379 31497 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.142052 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet f97e5105626c48be9d1768855511628a with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:47.143159 32476 tablet_replica.cc:333] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:47.144157 32476 raft_consensus.cc:2243] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.144774 32476 raft_consensus.cc:2272] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.148391 31424 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:47.149524 32476 ts_tablet_manager.cc:1916] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:47.158210 32112 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:47.159932 32481 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.162997 31572 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:47.167718 32441 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.169620 32112 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.173825 32476 ts_tablet_manager.cc:1929] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:47.174360 32476 log.cc:1199] T f97e5105626c48be9d1768855511628a P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/f97e5105626c48be9d1768855511628a
I20260709 12:21:47.178649 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet f97e5105626c48be9d1768855511628a (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:47.185631 32481 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:47.191035 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27c769ef5464411f973f730390441710 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:47.190558 31566 raft_consensus.cc:2955] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:47.202525 31321 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.225559 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c769ef5464411f973f730390441710 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:47.241763 32487 tablet_replica.cc:333] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:47.242897 32487 raft_consensus.cc:2243] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.243659 32487 raft_consensus.cc:2272] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.248413 32487 ts_tablet_manager.cc:1916] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:47.268189 32487 ts_tablet_manager.cc:1929] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:47.268530 32487 log.cc:1199] T 27c769ef5464411f973f730390441710 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/27c769ef5464411f973f730390441710
I20260709 12:21:47.269991 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 27c769ef5464411f973f730390441710 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:48.311589 31495 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:48.320024 31572 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.320356 31424 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:48.320979 31463 consensus_peers.cc:597] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1685dea95ca449998eaf8075418fda96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.321374 32454 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.322335 32456 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.334825 31572 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.330425 32454 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.343181 31420 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.353550 31321 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.357353 31421 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:21:48.395388 31387 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79f5f1e9d2894583bcc9bc45a5df0112. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.395745 31495 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.395917 31572 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.397271 32488 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.398335 32481 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.421342 32488 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.425021 31497 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.430230 31572 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.448870 31322 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.455286 31572 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:48.466610 31420 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.467500 31495 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.468072 32504 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.469049 32489 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:48.471719 31537 consensus_peers.cc:597] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 076aa0801557438fb22bfc7b11769a33. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.480600 32489 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.484623 31495 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.488090 31420 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.498126 31497 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:48.510524 31318 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:21:48.513986 31463 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b893ed7439d49939f7332cad4722c09. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.518975 31421 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.520155 31566 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.522287 32337 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.525792 32454 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.532660 32456 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.537140 31420 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.553068 31321 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.553279 31566 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:48.857254 32510 ts_tablet_manager.cc:933] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:48.859148 32510 tablet_copy_client.cc:323] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:48.860576 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 1685dea95ca449998eaf8075418fda96 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:48.861035 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 1685dea95ca449998eaf8075418fda96 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-1685dea95ca449998eaf8075418fda96
I20260709 12:21:48.866060 31510 tablet_copy_source_session.cc:215] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:48.869479 32510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1685dea95ca449998eaf8075418fda96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:48.900468 32510 tablet_copy_client.cc:806] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:48.901840 32510 tablet_copy_client.cc:670] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:48.907853 32510 tablet_copy_client.cc:538] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:48.923475 32510 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:48.949390 32512 ts_tablet_manager.cc:933] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:48.955735 32512 tablet_copy_client.cc:323] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:48.956491 32514 ts_tablet_manager.cc:933] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:48.997896 32510 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.999285 32510 tablet_bootstrap.cc:492] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:49.000980 32510 ts_tablet_manager.cc:1403] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.011s
I20260709 12:21:49.004946 32510 raft_consensus.cc:359] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.005905 32510 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:49.014707 32514 tablet_copy_client.cc:323] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:49.006966 32510 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.037128 32510 ts_tablet_manager.cc:1434] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.036s	user 0.001s	sys 0.013s
I20260709 12:21:49.038527 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 8b893ed7439d49939f7332cad4722c09 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:49.039165 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 8b893ed7439d49939f7332cad4722c09 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-8b893ed7439d49939f7332cad4722c09
I20260709 12:21:49.072484 32516 ts_tablet_manager.cc:933] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:49.074182 31510 tablet_copy_source_session.cc:215] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:49.079521 32516 tablet_copy_client.cc:323] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:49.135246 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 076aa0801557438fb22bfc7b11769a33 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:49.135892 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 076aa0801557438fb22bfc7b11769a33 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-076aa0801557438fb22bfc7b11769a33
I20260709 12:21:49.153887 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-1685dea95ca449998eaf8075418fda96 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:49.154645 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-1685dea95ca449998eaf8075418fda96 on tablet 1685dea95ca449998eaf8075418fda96 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:49.161763 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet 79f5f1e9d2894583bcc9bc45a5df0112 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:49.163038 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet 79f5f1e9d2894583bcc9bc45a5df0112 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-79f5f1e9d2894583bcc9bc45a5df0112
I20260709 12:21:49.179577 32512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b893ed7439d49939f7332cad4722c09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:49.214854 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55371.4us
W20260709 12:21:49.220114 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44015.8us
I20260709 12:21:49.214843 31585 tablet_copy_source_session.cc:215] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:21:49.296043 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46916.4us
I20260709 12:21:49.296749 32514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076aa0801557438fb22bfc7b11769a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:49.319347 31434 tablet_copy_source_session.cc:215] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:21:49.327536 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 140904us
W20260709 12:21:49.380575 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 161105us
W20260709 12:21:49.382018 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 165884us
I20260709 12:21:49.383137 32516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f5f1e9d2894583bcc9bc45a5df0112. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:49.394037 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 226643us
I20260709 12:21:49.400962 32516 tablet_copy_client.cc:806] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.401667 32516 tablet_copy_client.cc:670] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.405601 32516 tablet_copy_client.cc:538] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.415591 32516 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:49.431600 32512 tablet_copy_client.cc:806] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.432395 32512 tablet_copy_client.cc:670] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.432999 32514 tablet_copy_client.cc:806] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.438746 32512 tablet_copy_client.cc:538] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.441839 32514 tablet_copy_client.cc:670] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.448251 32512 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:49.456753 32514 tablet_copy_client.cc:538] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.465126 32516 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.466084 32516 tablet_bootstrap.cc:492] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:49.469301 32516 ts_tablet_manager.cc:1403] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.008s
I20260709 12:21:49.475162 32514 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:49.476524 32516 raft_consensus.cc:359] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.497689 32109 raft_consensus.cc:1217] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:49.509200 32516 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:49.510216 32516 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.513844 32516 ts_tablet_manager.cc:1434] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:21:49.517077 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-79f5f1e9d2894583bcc9bc45a5df0112 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:49.517498 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-79f5f1e9d2894583bcc9bc45a5df0112 on tablet 79f5f1e9d2894583bcc9bc45a5df0112 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:49.559850 32512 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.560846 32512 tablet_bootstrap.cc:492] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:49.561594 32512 ts_tablet_manager.cc:1403] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.029s
I20260709 12:21:49.566174 32512 raft_consensus.cc:359] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.567169 32512 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:49.567874 32512 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.573793 32512 ts_tablet_manager.cc:1434] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:21:49.575421 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8b893ed7439d49939f7332cad4722c09 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:49.575850 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8b893ed7439d49939f7332cad4722c09 on tablet 8b893ed7439d49939f7332cad4722c09 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:49.596444 32514 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.597215 32514 tablet_bootstrap.cc:492] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:49.597867 32514 ts_tablet_manager.cc:1403] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.123s	user 0.026s	sys 0.000s
I20260709 12:21:49.600546 32514 raft_consensus.cc:359] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.602097 32514 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:49.602807 32514 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:49.608044 32514 ts_tablet_manager.cc:1434] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:49.609807 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-076aa0801557438fb22bfc7b11769a33 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:49.610257 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-076aa0801557438fb22bfc7b11769a33 on tablet 076aa0801557438fb22bfc7b11769a33 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:50.052961 32109 raft_consensus.cc:1217] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:50.086024 32109 raft_consensus.cc:1217] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:50.109339 32454 raft_consensus.cc:1064] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:50.111601 32454 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.119951 32109 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.123859 31566 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.125043 32520 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.125684 32109 raft_consensus.cc:1217] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:50.128158 32520 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.143690 31424 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.145149 32337 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:21:50.148233 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5060 after lost signal to thread 30274
W20260709 12:21:50.149219 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5740 after lost signal to thread 31356
W20260709 12:21:50.150313 32135 debug-util.cc:398] Leaking SignalData structure 0x7b080031d0e0 after lost signal to thread 31449
W20260709 12:21:50.151327 32135 debug-util.cc:398] Leaking SignalData structure 0x7b0800310940 after lost signal to thread 31524
W20260709 12:21:50.152294 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7be0 after lost signal to thread 31599
W20260709 12:21:50.153276 32135 debug-util.cc:398] Leaking SignalData structure 0x7b080019e080 after lost signal to thread 32138
I20260709 12:21:50.168042 32454 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.180220 31421 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.229043 32112 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.229140 31565 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.229766 31322 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.272274 31496 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.277329 32112 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.278779 32454 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.279220 31565 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.285564 32456 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.287592 32337 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.292335 31566 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.313138 31319 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.314244 32112 raft_consensus.cc:2955] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.331848 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1685dea95ca449998eaf8075418fda96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.350703 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 1685dea95ca449998eaf8075418fda96 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
W20260709 12:21:50.355480 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64705.9us
I20260709 12:21:50.358323 32552 tablet_replica.cc:333] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:50.370828 32552 raft_consensus.cc:2243] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.371819 32552 raft_consensus.cc:2272] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.378335 32552 ts_tablet_manager.cc:1916] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.416623 32552 ts_tablet_manager.cc:1929] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.417110 32552 log.cc:1199] T 1685dea95ca449998eaf8075418fda96 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/1685dea95ca449998eaf8075418fda96
I20260709 12:21:50.418788 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 1685dea95ca449998eaf8075418fda96 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:50.556573 32488 raft_consensus.cc:1064] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:50.559013 32488 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.578337 32112 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.580473 31566 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.580680 32540 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.582584 32540 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.592957 31496 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.601509 32540 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.613055 32540 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.618561 31566 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.635533 32109 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.641489 31319 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.659127 32551 raft_consensus.cc:1064] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:50.660194 31422 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.663146 32542 raft_consensus.cc:1064] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:50.665848 32542 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.669986 32551 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:50.759244 32112 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.772034 31566 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.774776 32540 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.781579 32540 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.798908 32535 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.810562 31565 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.814355 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79f5f1e9d2894583bcc9bc45a5df0112 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.830003 32109 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.830225 31566 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.831724 32521 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.834056 32112 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.838500 32454 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.839268 32337 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.839090 31319 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.844338 31496 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.846194 32451 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:50.850225 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 79f5f1e9d2894583bcc9bc45a5df0112 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:50.867769 32564 tablet_replica.cc:333] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:50.875299 31421 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.878767 32564 raft_consensus.cc:2243] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.879513 32564 pending_rounds.cc:70] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Trying to abort 1 pending ops.
I20260709 12:21:50.879352 32520 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.879887 32564 pending_rounds.cc:77] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305624414444228608 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } } }
I20260709 12:21:50.879920 32109 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.881479 32564 raft_consensus.cc:2917] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:21:50.881963 32564 raft_consensus.cc:2889] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:21:50.882354 32564 raft_consensus.cc:2272] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.888597 32564 ts_tablet_manager.cc:1916] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.906457 31419 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.909885 32550 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.911794 32560 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.917313 31319 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.916980 32109 raft_consensus.cc:2955] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.940227 31419 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.945194 32564 ts_tablet_manager.cc:1929] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.945643 32564 log.cc:1199] T 79f5f1e9d2894583bcc9bc45a5df0112 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/79f5f1e9d2894583bcc9bc45a5df0112
I20260709 12:21:50.947770 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 79f5f1e9d2894583bcc9bc45a5df0112 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:50.953145 31496 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.966917 32109 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:50.976524 32451 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.988137 31319 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.018975 31568 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:51.031421 32109 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:21:51.032509 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46166.5us
I20260709 12:21:51.033424 32560 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:51.034718 31496 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:51.039855 32451 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:51.042375 32561 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.059690 32110 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.061899 31419 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.077740 31566 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.098378 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 076aa0801557438fb22bfc7b11769a33 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:51.113902 31321 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.111436 31496 raft_consensus.cc:2955] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.125756 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 076aa0801557438fb22bfc7b11769a33 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:51.141788 32571 tablet_replica.cc:333] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:51.143016 32571 raft_consensus.cc:2243] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.143739 32571 raft_consensus.cc:2272] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.150167 32571 ts_tablet_manager.cc:1916] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:51.171824 32571 ts_tablet_manager.cc:1929] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:51.172344 32571 log.cc:1199] T 076aa0801557438fb22bfc7b11769a33 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/076aa0801557438fb22bfc7b11769a33
I20260709 12:21:51.174407 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 076aa0801557438fb22bfc7b11769a33 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:51.496956 31496 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:51.513319 32109 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:51.515076 32569 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:51.516796 31421 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:51.526511 32550 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:51.533934 32456 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.544561 32110 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.557188 31422 raft_consensus.cc:2955] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.584661 31319 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:51.586004 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b893ed7439d49939f7332cad4722c09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:51.613675 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b893ed7439d49939f7332cad4722c09 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:21:51.635581 32573 tablet_replica.cc:333] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:51.637750 32573 raft_consensus.cc:2243] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:51.639472 32573 raft_consensus.cc:2272] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:51.644675 32573 ts_tablet_manager.cc:1916] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:51.669947 32573 ts_tablet_manager.cc:1929] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:51.670526 32573 log.cc:1199] T 8b893ed7439d49939f7332cad4722c09 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/8b893ed7439d49939f7332cad4722c09
I20260709 12:21:51.672220 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 8b893ed7439d49939f7332cad4722c09 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:52.043081 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.111325 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1685dea95ca449998eaf8075418fda96"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:52.112030 31498 raft_consensus.cc:606] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:52.116285 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:52.116719 31498 raft_consensus.cc:606] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:52.119915 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:52.120399 31498 raft_consensus.cc:606] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:52.124289 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:52.124904 31498 raft_consensus.cc:606] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:52.130043 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:52.130692 31498 raft_consensus.cc:606] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:52.132261 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:52.137187 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:52.138278 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.239765 32456 raft_consensus.cc:993] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.240280 32576 raft_consensus.cc:1081] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.242406 32110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:52.243039 32110 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:52.243417 32110 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.249835 32110 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.252743 32110 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:52.253938 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:52.254513 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:52.254824 31422 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.255119 31496 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:52.255481 31496 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:52.256232 31496 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.257122 31496 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.261957 31422 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.263337 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:52.264065 31496 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.265228 32577 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:52.267510 32577 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:52.268460 32577 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.280939 31319 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.396713 32576 raft_consensus.cc:993] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.397197 32550 raft_consensus.cc:1081] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.398882 32110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:52.399335 32110 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:52.399657 32110 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.405589 32110 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.408212 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:52.408713 31496 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:52.408885 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:52.409041 31496 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:52.409439 31566 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.409828 31496 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.411051 31496 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.414822 32110 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:52.416136 31566 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.417603 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:52.418502 32577 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:52.418982 32577 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:52.419442 31496 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.419938 32577 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.432060 31319 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.457100 32576 raft_consensus.cc:993] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.457620 32550 raft_consensus.cc:1081] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.459702 32110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1685dea95ca449998eaf8075418fda96"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:52.460332 32110 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:52.460668 32110 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.467216 32110 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.469094 32110 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:52.469496 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:52.469827 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:52.470170 31496 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:52.470361 31566 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.470475 31496 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:52.471292 31496 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.472275 31496 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.477442 31566 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.478951 32079 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:52.479283 31496 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.479915 32577 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:52.480520 32577 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:52.481513 32577 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.496042 31319 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.571624 32550 raft_consensus.cc:993] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.572417 32456 raft_consensus.cc:1081] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:52.573998 32110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:52.574617 32110 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:52.575356 32110 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.584263 32110 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.586508 32110 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:52.586992 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:52.587596 31421 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.588244 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:52.588775 31496 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:52.589052 31496 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:52.589725 31496 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.590860 31496 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.594226 31421 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.595229 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:52.595940 32577 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:52.596376 32577 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:52.597185 32577 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:52.598014 31496 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:52.607399 31319 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:52.691241 31422 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.692621 32577 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:52.706863 31496 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:52.713295 32576 raft_consensus.cc:993] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:52.715579 32576 raft_consensus.cc:1081] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:52.717520 31422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:52.718034 31422 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:52.718417 31422 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.729997 31422 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:52.735744 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:52.736021 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:52.736337 31498 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:52.736584 31568 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.736672 31498 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:52.737552 31498 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:52.739295 31498 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:52.743363 31463 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 519f567f2eff4e55b84df6d3edde6bc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:52.745150 31568 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:52.746742 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:52.748009 31422 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:52.749962 32540 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:52.755586 31497 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.763321 31498 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:52.764097 32540 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:52.764971 32540 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:52.768958 31566 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:52.770025 31422 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:52.772135 32576 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:52.773950 32568 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:52.788558 32576 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.792122 31568 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.801527 32578 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.807307 31421 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.812788 31566 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:52.814409 31319 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.843878 31319 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:52.855993 31537 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97965a28958a4537ae9f58c98ca87319. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:52.859144 31419 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:52.859593 31497 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:52.862418 32451 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:52.863619 32586 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:52.873283 32451 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.879135 31419 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.891669 31498 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.892967 31497 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:52.893781 31321 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.916925 31566 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:52.917232 31463 consensus_peers.cc:597] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70e01c7a1fa14a318bcfcf17308b0c63. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:52.918850 32456 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:52.924842 31419 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:52.927191 32456 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:52.927850 31572 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.929512 32578 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:52.934954 32576 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.936475 31497 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.938835 32578 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:52.946024 31572 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:52.968393 31497 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.970285 32592 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:52.982550 31566 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:52.988835 31571 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:52.990298 32592 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:53.012815 31498 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.014797 31422 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:53.039937 31321 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.046311 32451 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.047691 32586 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:53.053728 31537 consensus_peers.cc:597] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e64b21111bd41639226f8d37505e9a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:53.070895 31419 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.086751 32561 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.094332 31419 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.095557 31498 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.120044 31422 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:53.122701 32610 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:53.136032 31318 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:53.147464 32616 ts_tablet_manager.cc:933] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:53.148083 31498 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:53.152645 32610 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:53.165357 31571 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.167196 32591 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:53.205574 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.214264 31496 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:53.216360 32535 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:53.308243 32616 tablet_copy_client.cc:323] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:53.310460 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 519f567f2eff4e55b84df6d3edde6bc2 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:53.311019 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 519f567f2eff4e55b84df6d3edde6bc2 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-519f567f2eff4e55b84df6d3edde6bc2
I20260709 12:21:53.320835 31510 tablet_copy_source_session.cc:215] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:53.325491 32616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f567f2eff4e55b84df6d3edde6bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:53.354393 32616 tablet_copy_client.cc:806] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:53.355052 32616 tablet_copy_client.cc:670] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:53.359911 32616 tablet_copy_client.cc:538] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:53.371850 32616 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:53.406641 32616 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.407698 32616 tablet_bootstrap.cc:492] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:53.408439 32616 ts_tablet_manager.cc:1403] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.009s
I20260709 12:21:53.410043 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:53.410634 31498 raft_consensus.cc:606] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:53.411749 32616 raft_consensus.cc:359] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.412632 32616 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:53.413327 32616 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.422250 32616 ts_tablet_manager.cc:1434] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:21:53.425230 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-519f567f2eff4e55b84df6d3edde6bc2 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:53.425664 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-519f567f2eff4e55b84df6d3edde6bc2 on tablet 519f567f2eff4e55b84df6d3edde6bc2 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:53.431533 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:53.432070 31498 raft_consensus.cc:606] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:53.435257 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:53.435810 31498 raft_consensus.cc:606] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:53.438479 32616 ts_tablet_manager.cc:933] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:53.443737 32623 ts_tablet_manager.cc:933] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:53.444286 32616 tablet_copy_client.cc:323] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:21:53.446843 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 70e01c7a1fa14a318bcfcf17308b0c63 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:21:53.447405 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 70e01c7a1fa14a318bcfcf17308b0c63 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-70e01c7a1fa14a318bcfcf17308b0c63
I20260709 12:21:53.449147 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:53.449841 31498 raft_consensus.cc:606] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:53.453025 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:53.453713 31498 raft_consensus.cc:606] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:53.455716 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:53.456851 32623 tablet_copy_client.cc:323] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:53.458201 31510 tablet_copy_source_session.cc:215] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:53.458719 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:53.463508 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 97965a28958a4537ae9f58c98ca87319 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:53.464108 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 97965a28958a4537ae9f58c98ca87319 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-97965a28958a4537ae9f58c98ca87319
I20260709 12:21:53.464804 32616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e01c7a1fa14a318bcfcf17308b0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:53.467105 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.502907 31585 tablet_copy_source_session.cc:215] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:53.514210 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97965a28958a4537ae9f58c98ca87319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:53.523499 32616 tablet_copy_client.cc:806] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:53.524179 32616 tablet_copy_client.cc:670] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:53.527944 32616 tablet_copy_client.cc:538] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:53.538486 32616 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:53.578604 32616 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.581152 32616 tablet_bootstrap.cc:492] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:53.582790 32616 ts_tablet_manager.cc:1403] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.000s
I20260709 12:21:53.586573 32616 raft_consensus.cc:359] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.589195 32616 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:53.589892 32616 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.592854 32616 ts_tablet_manager.cc:1434] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:21:53.587632 32623 tablet_copy_client.cc:806] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:53.593622 32623 tablet_copy_client.cc:670] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:53.588698 32626 ts_tablet_manager.cc:933] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:53.599737 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-70e01c7a1fa14a318bcfcf17308b0c63 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:21:53.600256 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-70e01c7a1fa14a318bcfcf17308b0c63 on tablet 70e01c7a1fa14a318bcfcf17308b0c63 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:53.608259 32623 tablet_copy_client.cc:538] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:53.617456 32456 raft_consensus.cc:993] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.618251 32456 raft_consensus.cc:1081] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.619367 32626 tablet_copy_client.cc:323] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:53.620195 31422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:53.620905 31422 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:53.621239 31422 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.622658 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 8e64b21111bd41639226f8d37505e9a7 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:53.623328 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 8e64b21111bd41639226f8d37505e9a7 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-8e64b21111bd41639226f8d37505e9a7
I20260709 12:21:53.628294 31422 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.634835 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:53.635455 31498 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:53.635751 31498 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:53.636533 31498 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.637614 31498 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.647075 32623 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:53.648128 31585 tablet_copy_source_session.cc:215] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:53.649947 31498 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:53.654474 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e64b21111bd41639226f8d37505e9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:53.658586 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:53.659198 31566 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.660915 32611 raft_consensus.cc:993] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.661412 32611 raft_consensus.cc:1081] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.668591 31566 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:53.669834 31421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:53.670409 31421 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:53.670820 31421 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.675063 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:53.675952 32540 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.676461 32540 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:53.677348 32540 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.702771 32623 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.703816 32623 tablet_bootstrap.cc:492] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:53.708424 32623 ts_tablet_manager.cc:1403] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.000s
I20260709 12:21:53.711566 32623 raft_consensus.cc:359] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.712774 32623 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:53.714998 32623 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:53.718011 32623 ts_tablet_manager.cc:1434] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:53.724835 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-97965a28958a4537ae9f58c98ca87319 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:53.725314 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-97965a28958a4537ae9f58c98ca87319 on tablet 97965a28958a4537ae9f58c98ca87319 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:53.738818 31422 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:53.747537 31421 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.749823 31421 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:53.750726 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:53.752450 31496 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:53.752743 31496 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:53.753499 31496 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.755445 31496 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.755724 32109 raft_consensus.cc:1217] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:53.769105 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:53.769668 31568 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.777629 31568 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:53.775713 31496 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:53.779104 32626 tablet_copy_client.cc:806] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:53.779158 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:53.779983 32626 tablet_copy_client.cc:670] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:53.780478 32540 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.780957 32540 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:53.781697 32540 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:53.786964 32626 tablet_copy_client.cc:538] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:53.791610 31319 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:53.803565 32626 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:53.854987 32110 raft_consensus.cc:1217] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:53.897792 32456 raft_consensus.cc:993] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:53.923381 32576 raft_consensus.cc:1081] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:53.941042 32112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:53.941605 32112 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:53.941917 32112 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.957006 32112 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:53.965497 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:53.965615 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:53.966148 31421 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.966210 31498 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:53.966621 31498 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:53.967423 31498 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:53.968267 31498 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.974228 31421 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:53.974784 31498 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:53.975242 32112 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:53.980876 32550 raft_consensus.cc:993] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.983029 32611 raft_consensus.cc:993] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.987344 32110 raft_consensus.cc:1217] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:53.992926 31422 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:53.992086 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:53.994248 32550 raft_consensus.cc:1081] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.997750 32611 raft_consensus.cc:1081] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:53.999362 32578 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:53.999891 32578 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:54.000768 32578 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:54.006194 31422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:54.007150 31422 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:54.007519 31422 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.011324 31421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:54.012166 31421 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:54.012681 31421 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.043350 31422 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:54.046226 31422 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:54.046792 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:54.047466 31498 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:54.047736 31498 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:54.053136 31498 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:54.054522 31498 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.059849 31421 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:54.068324 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:54.068887 31496 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:54.069208 31496 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:54.068912 31421 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:54.102623 31496 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:54.103986 31496 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.106662 31498 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:54.113500 31496 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:54.129015 31390 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:54.130052 32540 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:54.130204 31390 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:54.149734 32591 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:54.175127 32540 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:54.176191 32540 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:54.181710 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.192291 32591 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:54.193531 32591 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:54.196859 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66746.5us
W20260709 12:21:54.201776 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92949.9us
I20260709 12:21:54.204691 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:54.205278 31571 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.206899 31498 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.212478 31571 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:54.215148 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:54.215953 31571 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.235139 32642 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:54.242331 31566 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.257134 32626 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.258152 32626 tablet_bootstrap.cc:492] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:54.259073 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:54.270546 32646 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:54.287315 31319 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:54.288938 31319 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:54.283219 32626 ts_tablet_manager.cc:1403] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.480s	user 0.025s	sys 0.014s
I20260709 12:21:54.290307 31319 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:54.303051 31497 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.296895 32626 raft_consensus.cc:359] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:54.304791 32626 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:54.306903 32626 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:54.321201 32626 ts_tablet_manager.cc:1434] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:21:54.309140 32646 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:54.339161 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8e64b21111bd41639226f8d37505e9a7 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:54.339661 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-8e64b21111bd41639226f8d37505e9a7 on tablet 8e64b21111bd41639226f8d37505e9a7 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:54.352012 32456 raft_consensus.cc:1064] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:54.354393 32456 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:54.377328 32112 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.381417 32576 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.383307 31422 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.387441 31570 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.392427 32456 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.404762 31568 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.412554 32456 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.420055 32646 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:54.432072 32633 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.435468 32109 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.444623 32641 raft_consensus.cc:1064] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:54.447086 32641 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:54.453729 31569 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.465031 32614 raft_consensus.cc:1064] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:54.467682 32614 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:54.481333 31321 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:54.483404 32112 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.487920 31422 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.497869 31420 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.498350 31496 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:54.502741 32561 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.513286 32610 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:21:54.513343 31498 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.508749 32638 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:21:54.520123 31422 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.522182 32456 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.524335 32638 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.528317 31568 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.529062 31420 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:54.537134 32610 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:54.550652 31495 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:54.555553 32576 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:54.556370 32112 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:54.557770 32576 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:54.562251 31421 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:54.564198 32641 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:54.573328 32109 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:54.572625 32611 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.574532 32456 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:54.581565 31424 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.600654 32634 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.602274 32110 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.614283 32109 raft_consensus.cc:2955] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.620834 31496 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.673907 31321 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.644790 32638 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.696830 31498 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.734320 31498 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.764199 31422 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:21:54.812593 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 140276us
I20260709 12:21:54.838546 32113 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.853662 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 519f567f2eff4e55b84df6d3edde6bc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:54.862262 31570 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.862798 31571 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:54.869108 32540 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:54.748875 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.890214 31565 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:54.876540 32678 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:21:54.909152 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49719.5us
I20260709 12:21:55.023999 31322 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:55.041242 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 225508us
I20260709 12:21:55.050900 32113 raft_consensus.cc:1217] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:55.064445 32646 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:21:55.069796 31319 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.064489 32685 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:21:55.113039 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 519f567f2eff4e55b84df6d3edde6bc2 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
W20260709 12:21:55.152251 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 209853us
W20260709 12:21:55.191543 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 291885us
I20260709 12:21:55.198828 31424 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.253247 32697 tablet_replica.cc:333] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:21:55.254451 32697 raft_consensus.cc:2243] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.281867 32697 raft_consensus.cc:2272] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:55.359992 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 74919.6us
W20260709 12:21:55.413596 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 129872us
I20260709 12:21:55.415230 32697 ts_tablet_manager.cc:1916] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.433411 32561 raft_consensus.cc:1064] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:55.441614 32561 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.480495 31500 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:21:55.496614 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44054.3us
I20260709 12:21:55.555176 32109 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.556228 31424 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.561241 32692 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:55.571980 31570 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.581188 31566 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.595042 32614 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.602576 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:21:55.603205 31422 raft_consensus.cc:606] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:55.623104 31500 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:55.634701 32632 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:55.635279 32110 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.651261 31424 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.655668 32111 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.655964 32697 ts_tablet_manager.cc:1929] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:55.656407 32697 log.cc:1199] T 519f567f2eff4e55b84df6d3edde6bc2 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/519f567f2eff4e55b84df6d3edde6bc2
I20260709 12:21:55.657409 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:55.657972 31498 raft_consensus.cc:606] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:55.657882 32632 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.660086 32638 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:55.665738 32638 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.667235 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 519f567f2eff4e55b84df6d3edde6bc2 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:55.668048 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:55.668598 31498 raft_consensus.cc:606] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:55.671890 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:55.677093 31498 raft_consensus.cc:606] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:55.674619 32638 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.675303 32694 raft_consensus.cc:993] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:55.678269 32694 raft_consensus.cc:1081] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:55.677709 32690 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.681032 32113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:55.681515 32113 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.681809 32113 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.693526 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77a183300084f968171dcd68225d026"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:55.694144 31497 raft_consensus.cc:606] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:55.698489 32693 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.700191 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:55.701957 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:55.702879 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:55.703614 32113 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.707054 32109 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.713277 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 70e01c7a1fa14a318bcfcf17308b0c63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.719534 32110 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.722427 32705 raft_consensus.cc:993] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:55.722898 32705 raft_consensus.cc:1081] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:55.726189 31419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e77a183300084f968171dcd68225d026"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:55.726724 31419 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.727048 31419 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.733685 31419 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:55.735917 31419 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:55.738968 31319 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.743146 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:55.740208 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:55.740227 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:55.720028 31321 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.743961 31498 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:55.744614 31498 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:55.745522 31498 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.746601 31498 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.740653 32113 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:55.743750 31500 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:55.747707 31500 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:55.748528 31500 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:55.749624 31500 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.743969 31572 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.752141 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97965a28958a4537ae9f58c98ca87319 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:55.759959 31572 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:55.758919 32687 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.761229 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:55.762051 32578 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:55.762526 32578 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:55.763413 32578 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.773540 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:55.774119 31566 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.782089 31566 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:55.789001 31500 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:55.791217 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:55.792922 32685 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:55.793406 32685 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:55.794185 32685 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:55.793798 31496 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.800846 31572 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:55.801645 31419 raft_consensus.cc:2955] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.802454 32113 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.811326 31571 raft_consensus.cc:2955] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.831328 31498 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:55.829809 31422 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.830458 31322 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:55.870059 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 97965a28958a4537ae9f58c98ca87319 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:21:55.879470 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e01c7a1fa14a318bcfcf17308b0c63 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:55.882555 32721 tablet_replica.cc:333] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:55.888792 32720 tablet_replica.cc:333] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:21:55.897804 32721 raft_consensus.cc:2243] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.899375 32721 raft_consensus.cc:2272] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.894281 31321 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.913164 32456 raft_consensus.cc:993] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:55.921605 32456 raft_consensus.cc:1081] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:55.890393 32720 raft_consensus.cc:2243] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:55.926568 32111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:55.927166 32111 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.927404 32720 raft_consensus.cc:2272] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:55.927578 32111 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:55.930562 32720 ts_tablet_manager.cc:1916] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:55.941426 31318 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.948877 31572 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:55.955953 32109 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:55.957300 32693 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:55.973333 32685 raft_consensus.cc:993] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:55.973996 32540 raft_consensus.cc:1081] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:55.976361 32687 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:55.977409 31571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:21:55.978078 31571 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:55.978451 31571 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:55.985028 31571 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:55.987983 31496 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:56.002766 32456 raft_consensus.cc:993] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:56.003701 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e64b21111bd41639226f8d37505e9a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:56.004057 32696 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:56.006431 32721 ts_tablet_manager.cc:1916] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:56.008679 31571 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:56.015496 31318 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:55.986333 32109 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:56.009990 31496 raft_consensus.cc:2955] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:21:56.003238 32456 raft_consensus.cc:1081] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:56.013757 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:56.020174 31498 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:56.013172 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:56.023139 31419 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:56.023487 31419 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:56.025024 31419 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:56.026355 31419 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:56.027000 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e64b21111bd41639226f8d37505e9a7 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
I20260709 12:21:56.030947 31422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:56.031546 31422 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:56.031886 31422 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:56.036839 31419 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:21:56.039094 32721 ts_tablet_manager.cc:1929] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:56.039633 32721 log.cc:1199] T 70e01c7a1fa14a318bcfcf17308b0c63 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/70e01c7a1fa14a318bcfcf17308b0c63
I20260709 12:21:56.041440 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 70e01c7a1fa14a318bcfcf17308b0c63 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:56.042454 32721 tablet_replica.cc:333] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:21:56.043560 32721 raft_consensus.cc:2243] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.044277 32721 raft_consensus.cc:2272] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.047780 32721 ts_tablet_manager.cc:1916] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:56.053040 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:56.060307 32720 ts_tablet_manager.cc:1929] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:56.060794 32720 log.cc:1199] T 97965a28958a4537ae9f58c98ca87319 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/97965a28958a4537ae9f58c98ca87319
I20260709 12:21:56.026505 31498 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:21:56.063105 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 97965a28958a4537ae9f58c98ca87319 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:56.066918 32721 ts_tablet_manager.cc:1929] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:56.067368 32721 log.cc:1199] T 8e64b21111bd41639226f8d37505e9a7 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/8e64b21111bd41639226f8d37505e9a7
I20260709 12:21:56.069098 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 8e64b21111bd41639226f8d37505e9a7 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:21:56.068996 31422 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:56.071760 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:56.072297 31498 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:56.072572 31498 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:56.073396 31498 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:56.074390 31498 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:56.074899 32693 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:56.075410 32693 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:56.076220 32693 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:56.082216 31498 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:56.083324 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:56.084342 32685 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:56.084811 32685 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:56.085701 32685 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:55.994944 32111 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:56.097934 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:56.098526 31498 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:56.098829 31498 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:56.099677 31498 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:56.102311 31498 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:56.112567 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:56.114877 31571 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:56.121737 31498 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:56.126303 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:56.127331 32578 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:56.150816 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48172us
I20260709 12:21:56.155004 32111 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:56.159897 31422 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:56.173414 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:56.174155 31566 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:56.175210 31571 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:56.184635 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:56.188272 31496 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:56.189376 31318 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:56.190095 32610 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:56.209991 31321 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.215026 32578 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:56.216207 32578 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:56.248265 31566 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:56.274361 32540 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:56.297118 31318 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.339828 31566 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:56.362530 32610 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:56.373339 31496 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:56.376075 32540 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.609180 31421 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:56.619964 32561 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.647193 31496 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:56.669042 32638 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:56.673348 31570 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:56.674834 32610 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:56.678560 31496 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:56.681033 32727 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.741623 31571 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:56.747901 32724 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:56.758762 31498 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:56.763674 32610 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:21:56.877612 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54236.1us
I20260709 12:21:57.020624 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:57.066306 31419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:21:57.066978 31419 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:57.070544 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:21:57.071115 31421 raft_consensus.cc:606] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:57.091873 31572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:21:57.092439 31572 raft_consensus.cc:606] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:57.096588 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:57.097200 31498 raft_consensus.cc:606] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:57.100575 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:57.101187 31498 raft_consensus.cc:606] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:57.103314 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:57.105118 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:57.105839 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:57.196401 31570 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:21:57.205672 31537 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91ffe6e1ad36492d95a9cf3251d2894c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.206785 31500 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.211546 32687 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.213047 31421 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.214818 32687 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.218271 32737 raft_consensus.cc:993] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.218735 32634 raft_consensus.cc:1081] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.234279 32109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:21:57.234864 32109 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:57.235236 32109 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.235400 32745 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.243924 32109 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.246701 32109 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:57.247546 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:57.248073 31498 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:57.248407 31498 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:57.248587 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:57.249164 31419 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.249131 31498 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.250491 31498 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.252616 31500 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.265928 31419 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:57.265977 31424 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:57.246133 31421 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.270666 31498 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:57.274025 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:57.274839 32578 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:57.275408 32578 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:57.269851 31321 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.276298 32578 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:21:57.291628 31387 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1af086d1060473f980f0bed9af34c07. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.310724 31572 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.313504 31498 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.314085 32646 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.316504 32727 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.335141 32646 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.341526 31570 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.354534 31498 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.361765 31318 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.362700 32633 raft_consensus.cc:993] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:57.368571 32633 raft_consensus.cc:1081] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:57.371392 31424 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:21:57.371892 31424 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:57.372232 31424 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.377017 31322 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.377363 31421 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:57.393755 31424 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:57.401340 31570 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:57.402668 31387 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a899a61b216247dbbb91edb923e9eddf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.411899 31496 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.412832 32729 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.414623 32729 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.426594 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:57.427608 31496 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:57.427994 31496 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:57.442885 31496 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:57.444001 31496 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.455431 31424 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:57.455796 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:57.456342 31570 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.459842 31496 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:57.461301 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:57.462716 32727 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:57.463168 32727 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:57.464105 31570 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:21:57.464046 32727 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:57.483086 32685 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.492007 31572 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.493790 31500 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.503248 31322 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:57.508172 31318 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.508863 31572 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:57.519527 31496 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.522825 31424 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:57.524225 32687 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:57.528059 31537 consensus_peers.cc:597] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f42c299f626148ba8af55613ab8e9bc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.531879 32687 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:57.551931 32561 raft_consensus.cc:993] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.552572 32614 raft_consensus.cc:1081] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.557654 32109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55788
I20260709 12:21:57.558207 32109 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:57.557204 32693 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.558562 32109 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.565092 31424 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.576823 32109 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.580399 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:57.582302 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:57.584452 31572 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:57.584765 31572 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:57.585507 31572 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.586501 31572 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.581979 31318 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.582644 31424 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.592710 31572 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:57.582166 32109 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:57.593742 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:57.594605 32578 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:57.595089 32578 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:57.595945 32578 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.605659 31496 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:21:57.609210 32646 raft_consensus.cc:993] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.609684 32646 raft_consensus.cc:1081] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:21:57.610486 31424 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:57.611268 32109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:21:57.611768 32109 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:57.612090 32109 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.620281 31321 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.631489 32109 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.634254 32685 raft_consensus.cc:993] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:57.634739 32685 raft_consensus.cc:1081] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:57.640568 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:57.641130 31424 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:57.641423 31424 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:57.642161 31424 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:57.643901 31424 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.648026 32109 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:57.649942 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:57.650496 31570 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:57.649583 31572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:21:57.652110 31572 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:57.652485 31572 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:57.660218 31572 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:57.664287 31424 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:21:57.665442 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:21:57.666322 32578 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:57.667534 32578 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:21:57.668725 32578 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:21:57.720201 31521 debug-util.cc:398] Leaking SignalData structure 0x7b08001645a0 after lost signal to thread 30274
I20260709 12:21:57.767715 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:57.761111 31570 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
W20260709 12:21:57.765875 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 93202.8us
W20260709 12:21:57.778082 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 100358us
I20260709 12:21:57.759275 31572 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:57.783517 31422 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:57.783938 31422 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:57.784866 31422 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:21:57.787957 31521 debug-util.cc:398] Leaking SignalData structure 0x7b0800179ca0 after lost signal to thread 31356
I20260709 12:21:57.788283 31422 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:21:57.789163 31521 debug-util.cc:398] Leaking SignalData structure 0x7b0800350140 after lost signal to thread 31449
W20260709 12:21:57.790184 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080036c820 after lost signal to thread 31524
I20260709 12:21:57.795238 31322 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.800276 31422 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:21:57.808521 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:57.809108 31496 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:57.816769 31496 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:21:57.826275 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:57.829154 31424 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:57.808116   306 ts_tablet_manager.cc:933] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:21:57.838886 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68213.8us
W20260709 12:21:57.838855 31521 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7240 after lost signal to thread 31599
W20260709 12:21:57.852116 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62020.7us
I20260709 12:21:57.836709 32693 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:21:57.860471 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080036ed80 after lost signal to thread 32138
I20260709 12:21:57.863375 32693 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:57.879492 32693 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:57.879995 31496 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:57.882638 32748 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:57.885689   309 ts_tablet_manager.cc:933] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
W20260709 12:21:57.955822 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 103052us
I20260709 12:21:57.969661 31497 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:57.971310   306 tablet_copy_client.cc:323] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
W20260709 12:21:57.972311 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 132451us
I20260709 12:21:57.981674 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 91ffe6e1ad36492d95a9cf3251d2894c from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:57.982317 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 91ffe6e1ad36492d95a9cf3251d2894c from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-91ffe6e1ad36492d95a9cf3251d2894c
I20260709 12:21:57.982535   315 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:21:57.992641   309 tablet_copy_client.cc:323] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:57.994598   323 ts_tablet_manager.cc:933] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:58.008972 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet a1af086d1060473f980f0bed9af34c07 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:58.009564 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet a1af086d1060473f980f0bed9af34c07 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-a1af086d1060473f980f0bed9af34c07
I20260709 12:21:57.996003 31585 tablet_copy_source_session.cc:215] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:57.996039 32729 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:57.996739 31572 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:58.033582   322 ts_tablet_manager.cc:933] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:21:58.029042 31322 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.064822   306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91ffe6e1ad36492d95a9cf3251d2894c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.072448 31434 tablet_copy_source_session.cc:215] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:21:58.087186 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49434.5us
I20260709 12:21:58.096923   309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1af086d1060473f980f0bed9af34c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.097700 32685 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:58.125767 31572 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:58.127225 32610 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:58.133154 31421 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:58.163154   313 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:21:58.194340 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.179325   323 tablet_copy_client.cc:323] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:21:58.194130   322 tablet_copy_client.cc:323] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:21:58.265131 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet f42c299f626148ba8af55613ab8e9bc4 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:21:58.265753 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet f42c299f626148ba8af55613ab8e9bc4 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-f42c299f626148ba8af55613ab8e9bc4
I20260709 12:21:58.283507 31421 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:58.287777 31568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:21:58.288447 31568 raft_consensus.cc:606] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:21:58.296430 31496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:21:58.297226 31496 raft_consensus.cc:606] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:58.298179 31569 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:58.311674 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet a899a61b216247dbbb91edb923e9eddf from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:21:58.312237 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet a899a61b216247dbbb91edb923e9eddf from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-a899a61b216247dbbb91edb923e9eddf
I20260709 12:21:58.307091   308 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:21:58.327265 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:21:58.327982 31422 raft_consensus.cc:606] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:21:58.323397 31585 tablet_copy_source_session.cc:215] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:58.329448   328 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:21:58.332255   323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42c299f626148ba8af55613ab8e9bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.337248 31434 tablet_copy_source_session.cc:215] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:58.348346   309 tablet_copy_client.cc:806] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.348912   309 tablet_copy_client.cc:670] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.361932 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:58.364113 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:58.365056 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.367573   322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a899a61b216247dbbb91edb923e9eddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.415728   309 tablet_copy_client.cc:538] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.427624 31420 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:58.434296 32693 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.491705 31497 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:58.494220 32693 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:58.478830   309 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:58.538878   306 tablet_copy_client.cc:806] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.539642   306 tablet_copy_client.cc:670] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.512070 32634 raft_consensus.cc:993] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:58.566700   306 tablet_copy_client.cc:538] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.566810 32634 raft_consensus.cc:1081] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:58.632956 31572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48862
I20260709 12:21:58.633711 31572 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:58.634169 31572 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.649421 31572 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.651341 31572 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:21:58.658337   323 tablet_copy_client.cc:806] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.660815   323 tablet_copy_client.cc:670] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.666291   322 tablet_copy_client.cc:806] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.666944   322 tablet_copy_client.cc:670] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.669723   323 tablet_copy_client.cc:538] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.673947 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:58.675621 31497 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:58.675900 31497 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:21:58.671211   322 tablet_copy_client.cc:538] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.684211 31497 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.686028 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:58.695299 31497 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.695439 31420 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.702014 31497 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:21:58.705366   306 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:58.716496 31420 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
W20260709 12:21:58.732005 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54687.3us
I20260709 12:21:58.745311 32561 raft_consensus.cc:993] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:58.745769 32561 raft_consensus.cc:1081] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:21:58.755101 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:58.756673   322 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:58.774423 31420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:21:58.775027 31420 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:58.775370 31420 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.782370 31420 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.785704 31420 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:21:58.786377 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:21:58.786979 31497 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.767676   314 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:58.792218   314 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:58.793100   314 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.805761   323 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:21:58.800513 31497 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:21:58.807662 31390 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:21:58.808573   318 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:58.809028   318 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:58.810638   318 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.821980 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:21:58.822737 31569 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:58.823081 31569 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:58.823874 31569 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:21:58.825111 31569 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:58.844204 32646 raft_consensus.cc:993] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:58.844769 32646 raft_consensus.cc:1081] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:21:58.878270   309 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:58.879662 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:21:58.880295 31570 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:58.905961 31570 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.918488 31569 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:21:58.918862 31322 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:58.924921 31321 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 4, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:58.939226 31570 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:58.943243 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:21:58.944190   309 tablet_bootstrap.cc:492] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:58.948525 31422 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:58.948915 31422 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:21:58.949009   309 ts_tablet_manager.cc:1403] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.488s	user 0.022s	sys 0.010s
I20260709 12:21:58.949875 31570 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:21:58.949676 31422 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:58.951200 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:21:58.951726 32109 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.963388 31422 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:58.975605 31422 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:21:58.976641 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:21:58.977639 32109 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:21:58.980249   345 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:58.980799   345 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:21:58.981715   345 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:58.988065   309 raft_consensus.cc:359] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:58.988936   309 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:58.989583   309 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.044852   309 ts_tablet_manager.cc:1434] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 12:21:59.044948   306 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:59.046403   306 tablet_bootstrap.cc:492] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:59.047842 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-a1af086d1060473f980f0bed9af34c07 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:59.048374 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-a1af086d1060473f980f0bed9af34c07 on tablet a1af086d1060473f980f0bed9af34c07 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:59.047217   306 ts_tablet_manager.cc:1403] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.342s	user 0.048s	sys 0.023s
I20260709 12:21:59.080212   323 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:59.081254   323 tablet_bootstrap.cc:492] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:59.081987   323 ts_tablet_manager.cc:1403] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.276s	user 0.021s	sys 0.015s
I20260709 12:21:59.086202   323 raft_consensus.cc:359] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.095454   323 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:59.091549   306 raft_consensus.cc:359] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.096915   306 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:59.097632   306 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.096222   323 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.105664   306 ts_tablet_manager.cc:1434] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:21:59.114082   323 ts_tablet_manager.cc:1434] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 12:21:59.116519 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-f42c299f626148ba8af55613ab8e9bc4 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:59.116930 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-f42c299f626148ba8af55613ab8e9bc4 on tablet f42c299f626148ba8af55613ab8e9bc4 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:59.120265 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-91ffe6e1ad36492d95a9cf3251d2894c received from {username='slave'} at 127.0.0.1:58364
I20260709 12:21:59.120638 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-91ffe6e1ad36492d95a9cf3251d2894c on tablet 91ffe6e1ad36492d95a9cf3251d2894c with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:59.122215   322 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:59.123241   322 tablet_bootstrap.cc:492] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:21:59.127426   322 ts_tablet_manager.cc:1403] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.371s	user 0.024s	sys 0.011s
I20260709 12:21:59.143566   322 raft_consensus.cc:359] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.144615   322 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:21:59.145381   322 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:21:59.148022   322 ts_tablet_manager.cc:1434] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:21:59.149644 31434 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-a899a61b216247dbbb91edb923e9eddf received from {username='slave'} at 127.0.0.1:50108
I20260709 12:21:59.150060 31434 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-a899a61b216247dbbb91edb923e9eddf on tablet a899a61b216247dbbb91edb923e9eddf with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:21:59.163108 32109 raft_consensus.cc:1217] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:59.213369 31318 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:59.247542 31566 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:59.254141   318 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:59.356006 32109 raft_consensus.cc:1217] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:21:59.463811 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45832.2us
I20260709 12:21:59.505250 32113 raft_consensus.cc:1217] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:21:59.541576 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 139815us
W20260709 12:21:59.576597 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45201.2us
I20260709 12:21:59.579294 32109 raft_consensus.cc:1217] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:59.585879 31420 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:59.586737 31422 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:59.598621 32111 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:21:59.629606 31496 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:59.631104 31496 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:59.632165 32729 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:59.645243 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:59.644472   362 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:21:59.652171   343 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:21:59.681617   344 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:21:59.683797   344 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:59.710150 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54608.9us
I20260709 12:21:59.835583   361 raft_consensus.cc:1064] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:59.849006   361 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:21:59.858078 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 128774us
I20260709 12:21:59.887455   372 raft_consensus.cc:1064] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:21:59.892299   372 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:21:59.984005 31569 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:59.984154 31500 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:59.985495   384 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:59.986362   360 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:59.999680 32113 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.018119   381 raft_consensus.cc:1064] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:00.008039   360 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:22:00.027432 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:00.028028 31421 raft_consensus.cc:606] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:00.040390 32113 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.049306   380 raft_consensus.cc:1064] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:00.020812   381 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.051946   380 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.063310 31498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:00.063961 31498 raft_consensus.cc:606] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:00.063704 32685 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:00.074900 31570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:22:00.075498 31570 raft_consensus.cc:606] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:00.093123 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:00.096447 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:00.097150 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:00.114001 31570 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.136174 32109 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.147164   362 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:00.156607 31497 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.164381   384 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:22:00.174201   392 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:00.180212   318 raft_consensus.cc:993] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:22:00.180876   318 raft_consensus.cc:1081] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:22:00.183369 31500 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:22:00.183885 31500 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:00.184213 31500 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:00.197117   384 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.201045 31500 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:00.204880 31497 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.207418   372 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.211768 31421 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.219436 31498 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.226969   314 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.228400 32685 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.229851   380 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.231266 31497 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.230384 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:00.235848 31423 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:00.234375 31568 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.236596 31500 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:00.236095 31423 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:00.229585 31322 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.247148 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:00.247699 31570 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:00.238535 31423 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:00.260123 31423 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:00.262310 31498 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.263237 31421 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.265735 32113 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:00.270591   364 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.276505   364 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.281451   314 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:00.294840 31570 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:00.298215 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:00.303247   373 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:00.302718 32114 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.320996 31423 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:00.305471   373 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:00.335101   373 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:00.404338   385 raft_consensus.cc:993] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:00.405125   385 raft_consensus.cc:1081] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:00.407034 31568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48862
I20260709 12:22:00.407567 31568 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:00.407896 31568 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:00.409276   402 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:22:00.423017 31568 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:00.424688   407 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:00.426187 31568 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:00.426913 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:00.427462 31419 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.434104 31419 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:00.440526 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:00.442665   314 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:00.443249   314 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:00.439306 32111 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.444278   314 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:00.469784   405 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:22:00.483739 31568 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.504678   386 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.510253   380 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.513813 31419 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:00.505177 31421 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.515610 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:00.516276 31500 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:00.516546 31500 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:00.517274 31500 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:00.525831   409 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:00.530648 31498 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.530351 31496 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:22:00.540588   412 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 12:22:00.543918 31500 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.556165 32111 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.557760 31500 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:00.565652 32114 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.572536 31423 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.607575 31318 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.609290 31318 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.610306 31318 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 3, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.628413 31319 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.655228 31322 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:00.656286 31423 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.660764 31421 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.667353   314 raft_consensus.cc:993] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:00.667814   314 raft_consensus.cc:1081] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:00.669973 32114 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.670924 31568 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.672574 31419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:22:00.673090 31419 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:00.673147 32685 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.673516 31419 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.673684 32114 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.673964 32729 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.675575   384 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.677968 31500 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.680114 31419 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.681712   384 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:00.684185 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:00.684716 31570 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:00.685019 31570 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:00.685755 31570 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.686862 31570 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.696801 31570 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:00.699393 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:00.701601 32729 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.703120 31419 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:00.707186   320 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:00.707693   320 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:00.708896 31572 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.711194 31568 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.712601 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:00.713119 32114 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.713318 31570 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.708530   320 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:00.722285 32114 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:00.726852   311 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.739446 32111 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.745076 32109 raft_consensus.cc:2955] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.747422 32111 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.748984   362 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.750831   362 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.753300 32111 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.758136 31419 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.764544 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a899a61b216247dbbb91edb923e9eddf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:00.768304   386 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.766513 31496 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:22:00.776403   364 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.780792 31419 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.797252 32109 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.808981   380 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:00.809226 31500 raft_consensus.cc:2955] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.839183 32113 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.830274   386 raft_consensus.cc:2955] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.847954 31496 raft_consensus.cc:2955] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.871907 31421 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:00.875828 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f42c299f626148ba8af55613ab8e9bc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:00.876720 31500 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:00.880615   304 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:22:00.818261 31322 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.878142 31321 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 1 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.896178 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91ffe6e1ad36492d95a9cf3251d2894c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:00.885885   364 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:22:00.914140 31568 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:00.914758 31318 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:00.921025 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a1af086d1060473f980f0bed9af34c07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:22:00.922341   305 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:22:00.934832 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet a1af086d1060473f980f0bed9af34c07 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48848
I20260709 12:22:00.944108 31421 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:00.955356 31321 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 3 to 4, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:00.971225 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet a899a61b216247dbbb91edb923e9eddf with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
W20260709 12:22:01.006137 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48989.3us
I20260709 12:22:00.974062   344 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:22:01.014156   423 tablet_replica.cc:333] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:22:01.015235   423 raft_consensus.cc:2243] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:01.028067 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45274.5us
I20260709 12:22:01.032444   423 raft_consensus.cc:2272] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.043308   420 tablet_replica.cc:333] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:22:01.044564   420 raft_consensus.cc:2243] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.045347   420 raft_consensus.cc:2272] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.075454   420 ts_tablet_manager.cc:1916] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.088076   423 ts_tablet_manager.cc:1916] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.103291 31322 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 3 to 4, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 1 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:01.116868 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet f42c299f626148ba8af55613ab8e9bc4 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55326
W20260709 12:22:01.136384 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 100509us
W20260709 12:22:01.152344   419 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.140s	user 0.000s	sys 0.003s
I20260709 12:22:01.195858 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 91ffe6e1ad36492d95a9cf3251d2894c with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48606
I20260709 12:22:01.202913 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:01.214170   420 ts_tablet_manager.cc:1929] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:01.214669   420 log.cc:1199] T a1af086d1060473f980f0bed9af34c07 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/a1af086d1060473f980f0bed9af34c07
I20260709 12:22:01.219630 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet a1af086d1060473f980f0bed9af34c07 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:22:01.223629   423 ts_tablet_manager.cc:1929] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:01.224308   423 log.cc:1199] T a899a61b216247dbbb91edb923e9eddf P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/a899a61b216247dbbb91edb923e9eddf
I20260709 12:22:01.226166 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet a899a61b216247dbbb91edb923e9eddf (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:22:01.266546 32113 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:01.267025   431 tablet_replica.cc:333] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:22:01.268517   431 raft_consensus.cc:2243] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.255442   423 tablet_replica.cc:333] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:22:01.274807   423 raft_consensus.cc:2243] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:01.275648   423 raft_consensus.cc:2272] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.276012   431 raft_consensus.cc:2272] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.278638 32685 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:01.297861 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:01.298508 31497 raft_consensus.cc:606] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:01.299714   423 ts_tablet_manager.cc:1916] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.299803   431 ts_tablet_manager.cc:1916] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:01.301138 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:01.301728 31422 raft_consensus.cc:606] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:01.304575 31572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:22:01.305114 31572 raft_consensus.cc:606] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:01.306243 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:01.309727 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:01.310472 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:01.311260 31572 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:01.312727   320 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:01.332536 32685 raft_consensus.cc:993] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:22:01.333014 32685 raft_consensus.cc:1081] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:22:01.338773   423 ts_tablet_manager.cc:1929] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:01.339205   423 log.cc:1199] T 91ffe6e1ad36492d95a9cf3251d2894c P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/91ffe6e1ad36492d95a9cf3251d2894c
I20260709 12:22:01.340556 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 91ffe6e1ad36492d95a9cf3251d2894c (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:22:01.343011 32111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:22:01.343560 32111 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.343930 32111 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.366458   431 ts_tablet_manager.cc:1929] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:22:01.366966   431 log.cc:1199] T f42c299f626148ba8af55613ab8e9bc4 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/f42c299f626148ba8af55613ab8e9bc4
I20260709 12:22:01.373178 32111 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.375672 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet f42c299f626148ba8af55613ab8e9bc4 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:22:01.391767 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:01.394165 32111 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:01.395592 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:01.407186 31497 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.406481 31421 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:01.409713 31421 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:01.410805 31421 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.414304 31497 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:01.450515 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:01.451372 31421 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.463541   368 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:01.464315   368 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:01.465869   368 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.484491 31421 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:01.513419   364 raft_consensus.cc:993] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:01.514055   364 raft_consensus.cc:1081] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:01.516467 31419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:22:01.517488 31419 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.517976 31419 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:01.536013 31321 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.557442 31419 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.559877 31419 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:01.563156 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:01.563902 31568 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:01.564260 31568 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:01.564141 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:01.565474 32111 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:01.565310 31568 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.566594 31568 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:01.576102 31568 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:01.577929 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:01.579547   384 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:01.580206   384 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:01.581634   384 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:01.584676 32111 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:01.585637 32113 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:01.609239 31321 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 3, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:01.847908   409 raft_consensus.cc:993] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:01.848675   307 raft_consensus.cc:1081] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:01.851148 31568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48862
I20260709 12:22:01.851706 31568 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.852063 31568 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.859108 31568 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:01.861050 31568 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:01.861943 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:01.862059 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:01.862601 31419 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.862736 31496 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:01.863178 31496 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:01.864070 31496 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:01.865468 31496 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.868530 31419 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:01.869846 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:01.872700   314 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:01.874421   314 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:01.875581   314 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:01.881701 31496 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:01.896555 31321 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:01.978767 32111 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:01.980340   384 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:01.996588 31568 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:02.000691   366 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:02.053112 31496 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:02.054749   441 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:02.073114 31419 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:02.076576   368 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:02.252161 31419 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:02.259734 31387 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36ab0d648ab643bf8d74dbe6ee9503d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:02.261075 31497 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:02.261180 31568 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:02.262614   384 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.264055   366 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.281190   384 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.283926 31572 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.325390 31496 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:02.328017 31321 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.339071 31498 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:22:02.344738 31463 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dd7b78d2ef1488c970505878e67c6ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:02.348318 31419 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:02.348903 31572 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:02.349992   307 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.352208   373 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.365435 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:02.368196 31497 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:02.371457   344 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:02.383926   409 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.388430 31421 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.421391 31421 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:02.417975 31570 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:02.429193 31321 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 1 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.436196   459 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:02.492296 31537 consensus_peers.cc:597] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d385c04853e749af8fb00afe40a4a255. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:02.498137 31496 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:02.495790 31570 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.507057   344 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.507709 31419 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:02.517387   458 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:02.543111   458 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:02.547828 31496 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:22:03.630424 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 113110us
I20260709 12:22:03.642164   473 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:03.649979 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1133) took 1116 ms. Trace:
I20260709 12:22:03.842972   475 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:03.843825   475 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:03.847195   479 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:03.847824   479 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:03.850070   479 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:03.852000   471 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:03.852730   471 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:03.766115 31421 rpcz_store.cc:276] 0709 12:22:02.532443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.532641 (+   198us) service_pool.cc:224] Handling call
0709 12:22:02.533082 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:02.533516 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:02.533541 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:02.534602 (+  1061us) log.cc:844] Serialized 513 byte log entry
0709 12:22:02.542273 (+  7671us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:02.542308 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:02.542387 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:03.648362 (+1105975us) raft_consensus.cc:1685] finished
0709 12:22:03.648390 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:03.648509 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":7091,"threads_started":1,"wal-append.queue_time_us":33852,"wal-append.run_cpu_time_us":2308,"wal-append.run_wall_time_us":1080927}
I20260709 12:22:03.791716   473 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:03.968145   475 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.334352   473 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.339848   471 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.403702   482 ts_tablet_manager.cc:933] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:04.408999 32114 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.004s
W20260709 12:22:04.409641 32114 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.009s	sys 0.004s
I20260709 12:22:04.786449   482 tablet_copy_client.cc:323] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:22:04.796449   384 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.797271   384 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.800065   384 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.804885   384 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.805490   384 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.807730   481 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.808279   485 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.808369   384 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.808434   481 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.808902   485 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.809218   384 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.809552   467 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.813295   467 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.811064   481 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.817035   467 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.817543   481 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.817754   467 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.811514   485 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.818061   481 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.819145   485 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.809981   384 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.819702   485 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.821437   481 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.822180   384 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.811568   487 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.806633   486 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.818783   467 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.823544   486 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.824988   467 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.823454   487 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.825613   467 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.825764   486 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.823061   450 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.826377   467 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.826758   450 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.827353   487 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.828835   467 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.829062   450 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.822539   485 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.841161   488 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.841956   488 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.849995   450 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.850593   450 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.851428   489 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.852001   489 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.852664   467 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.852806   450 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.853354   467 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.853935   450 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.854451   450 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:04.855144 31388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.028s	sys 0.048s
W20260709 12:22:04.855469 31388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.028s	sys 0.048s
I20260709 12:22:04.855664   467 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.856220   467 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.856976   450 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.856724   467 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.857470   450 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.857609   489 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.858201   489 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.857968   450 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.859238   467 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.859774   467 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.860244   450 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.860208   467 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.858636   489 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.862275   467 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.863894   489 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.867406   489 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.868144   489 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.868544   366 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.869621   384 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.870208   485 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.870337   384 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.870903   485 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.871299   490 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.871846   490 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.872536   384 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.873064   384 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.873291   485 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.873610   384 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.878579   450 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.869233   366 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:04.879362   450 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.881250   366 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.882443   450 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.875166   487 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.876842   384 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.877506   490 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.883229   487 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.875252   486 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.875687   481 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.884450   486 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.884498   481 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.885535   487 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.886516   481 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.886535   486 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.887560   477 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.888119   477 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.877861   480 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.889861   480 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.892675   478 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.899700   468 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.900543   468 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.903580   468 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.893285   478 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.873907   485 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.907256   477 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.882802   488 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.909873   485 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:04.915318   485 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.912623   478 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:04.907637   486 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.919330   480 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.920295   486 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.922549   486 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.924086   489 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.925084   492 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:04.926205   492 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.929945   480 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.930003   487 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.930586   492 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.930816   480 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.931018   487 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.933185   480 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.933266   487 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.948115   307 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.948774   307 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.949323   494 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.949885   494 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.951288   307 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.951897   307 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.952116   494 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.952450   307 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.954644   307 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.955225   307 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.955730   307 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.958480   307 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.959052   307 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.959641   307 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.961745   307 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.976416   307 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.977069   307 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.979111   307 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.979616   307 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.980115   307 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.985013   307 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.988003   307 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:04.989696   307 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:04.986104   496 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:04.992157   496 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.992983   307 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:04.994712   496 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:04.996567   491 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:04.997165   491 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:04.992856 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.000113 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.000833 31418 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.002280 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.004733   497 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.005354 31418 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.005541   497 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.007239 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.014022   496 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.015950   496 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.011690 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.008598 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.017441 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.018908   368 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.019410   368 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.019814   368 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.019956   441 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.020440   441 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.020802   441 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.012230   491 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.023779   489 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.024349   489 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.024767 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 404) took 1545 ms. Trace:
I20260709 12:22:05.025198 32111 rpcz_store.cc:276] 0709 12:22:03.479363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.023848 (+1544485us) service_pool.cc:224] Handling call
0709 12:22:05.024238 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:05.024424 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:05.024458 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:05.024503 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:05.024536 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.024592 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.024712 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:05.009346   497 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:05.016695 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.990s	user 0.019s	sys 0.043s
W20260709 12:22:05.027176 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.001s	user 0.021s	sys 0.044s
I20260709 12:22:05.018771 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.028276   487 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.029080 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.026466   489 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.029716 31424 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.028865   492 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.030763   492 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.032018   441 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.033825 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.012703   307 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.035008   441 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.035732   441 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.035574   307 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.036466   441 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.036872   441 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.041554   368 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.041975 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.042508 31424 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.015019 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.044656   307 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.028847   487 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.049088   368 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.051578   496 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.054447   487 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.055081   492 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.059307   480 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.060037   480 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.060750 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.061786 31415 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.063932   486 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.064489   487 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.065003   487 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.064500   486 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.067180   487 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.067670   487 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.068118   486 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.069797   486 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:05.070621 31353 debug-util.cc:398] Leaking SignalData structure 0x7b080008a200 after lost signal to thread 30274
W20260709 12:22:05.071758 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08000648e0 after lost signal to thread 31356
W20260709 12:22:05.072070 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08000649a0 after lost signal to thread 31370
I20260709 12:22:05.072528 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:05.073182 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800348200 after lost signal to thread 31449
W20260709 12:22:05.073560 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800347880 after lost signal to thread 31450
I20260709 12:22:05.074999 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.075634 31421 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:05.077549 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.077754 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.079072 31418 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:05.079969 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.080525 31418 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:05.070334   486 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.081048 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.081423 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.082357 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.082757 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.083259   486 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.083439 31418 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:05.068138   487 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.084475 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.084590 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.086601   487 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.088603 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:05.089417 31496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.005s	sys 0.000s
W20260709 12:22:05.089753 31496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.005s	sys 0.000s
I20260709 12:22:05.089682 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.090597 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.091540   496 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:05.091928   496 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.092293   496 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.092353 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.092799 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.093614 31416 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.098606   495 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:05.099189   495 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.099674   495 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.103554   498 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.104000   498 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.104902   498 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.106462   496 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.107625 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.110831   497 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:05.111251   497 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.111637   497 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.090534   494 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.114593 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.114114   494 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:05.115171 31420 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.115770 31321 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 184) took 2646 ms. Trace:
I20260709 12:22:05.116147 31321 rpcz_store.cc:276] 0709 12:22:02.469459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.469582 (+   123us) service_pool.cc:224] Handling call
0709 12:22:05.115680 (+2646098us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:22:05.113875 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1045) took 2569 ms. Trace:
I20260709 12:22:05.113538   496 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.117429 31496 rpcz_store.cc:276] 0709 12:22:02.544182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.545501 (+  1319us) service_pool.cc:224] Handling call
0709 12:22:02.547493 (+  1992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:02.547717 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:03.902380 (+1354663us) log.cc:844] Serialized 14 byte log entry
0709 12:22:05.090312 (+1187932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:05.090370 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:05.090422 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:05.113658 (+ 23236us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.113796 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7685,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":192,"thread_start_us":1187521,"threads_started":1,"wal-append.queue_time_us":629292}
I20260709 12:22:05.080724 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.125507 31415 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:05.123368 31420 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:05.122611   497 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.124452   498 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.126711   495 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.131062   493 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.131604 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.132241 31423 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.131711   493 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.128420 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.128257 31424 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:05.141101 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.129079   479 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.141984   479 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.129303   497 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.143031   497 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:05.143441   497 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.143894   493 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.142896 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.143921   497 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.144515 31424 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.146451   368 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.129539   478 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.147037   368 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.147753   478 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.149621   368 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.150204   368 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.151011   496 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:05.151554   496 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:05.152297   479 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.152484   496 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.129760   498 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.203532 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.221227 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.222031 32111 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:05.062486   480 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.160185   495 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.139875 31423 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:05.153440   368 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.224453 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.225247 32106 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:05.225747   368 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.157209 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.206315 31424 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:05.226217 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.150393   478 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.161237   497 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.227952 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.229501 32111 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:05.230197 31422 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:05.217999 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.231010 31417 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:05.230531 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.232939 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.215224 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.234477   314 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.235031   314 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.235448 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.235594 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.236107 31417 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.236477 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.236994   314 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.237169   366 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.237536   366 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.237865   366 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.240526 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.240866 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.241462 32108 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:05.241997   480 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.242425   480 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.242851   480 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.246848   368 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.247455   368 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.248968 31417 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:05.249185   307 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:05.197379   494 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.228457   497 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.217033 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.250787 32114 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:05.250711 32106 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:05.249733   307 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:05.251784 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.252481 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.187242 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.253623   373 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.254123   373 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:05.255053   373 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:05.250785 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebee0 after lost signal to thread 31524
W20260709 12:22:05.256261 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe220 after lost signal to thread 31525
W20260709 12:22:05.257289 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800048f20 after lost signal to thread 31599
W20260709 12:22:05.257548 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800361660 after lost signal to thread 31600
W20260709 12:22:05.258661 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800347d00 after lost signal to thread 32138
W20260709 12:22:05.259099 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08002591e0 after lost signal to thread 32139
I20260709 12:22:05.261390 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:05.262104 31422 raft_consensus.cc:606] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:05.252113   307 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.264022 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.266119 31466 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.246544 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 296) took 2711 ms. Trace:
I20260709 12:22:05.266821   368 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.267011 31322 rpcz_store.cc:276] 0709 12:22:02.535186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.535394 (+   208us) service_pool.cc:224] Handling call
0709 12:22:05.246345 (+2710951us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2704269,"reported_tablets":2}
I20260709 12:22:05.276719 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.279217 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.280400   468 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.280946   468 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.281688 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.282311   491 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.282310 31420 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.282809   491 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.283217   491 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.281359 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.283990   474 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.284505   474 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.285045   497 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.285445   497 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.285808   497 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.287026 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.288642   489 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.289026   489 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.289374   489 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.287906 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.279496 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.288264 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:05.292909 31318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 271) took 2759 ms. Trace:
I20260709 12:22:05.268240   466 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.293569 31319 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 295) took 2809 ms. Trace:
W20260709 12:22:05.293746 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 162981us
I20260709 12:22:05.294411 31318 rpcz_store.cc:276] 0709 12:22:02.533486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.986058 (+452572us) service_pool.cc:224] Handling call
0709 12:22:05.292737 (+2306679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2243962,"reported_tablets":1}
I20260709 12:22:05.311928 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.320031 31319 rpcz_store.cc:276] 0709 12:22:02.481852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:02.482743 (+   891us) service_pool.cc:224] Handling call
0709 12:22:05.290882 (+2808139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2739757,"reported_tablets":1}
I20260709 12:22:05.291244 31422 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.320287 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.295259   344 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.290697   495 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.290385   496 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.328393 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.288230   498 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.321545   487 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.322925   479 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.323896   384 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.335382   472 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.325174   468 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.322222   474 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.328634   490 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.339773   307 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:05.343144   307 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:05.332810   467 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.351323   366 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.333570   487 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.373188   501 ts_tablet_manager.cc:933] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
W20260709 12:22:05.374637 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44968.3us
I20260709 12:22:05.375322 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.335968   472 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.347299   477 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.377862 31417 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:05.378039   477 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.330497   450 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:05.330219   495 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.355665 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:05.386085   307 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.336784   479 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.378782   314 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.371095   366 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.371315   467 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.380467   487 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.337877   498 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.337734   496 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.328886   466 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.382226   493 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.329835   344 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.391155 32105 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.396353   467 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.398572   474 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.398280   478 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.399672   314 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.396914   441 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.425531   424 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.426113   424 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.426587   424 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.426612   441 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.408780   494 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.395666   499 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.399564   491 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.395560   500 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.434176 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.403237   493 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.438239 31420 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.410573   501 tablet_copy_client.cc:323] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:22:05.448108   384 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.452396   496 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.434114   472 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:05.480337 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 160742us
I20260709 12:22:05.420226   478 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.481137 32110 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:05.420051   474 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.476025   384 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.454469   344 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.481369   477 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.467542   494 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.483237 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.504489 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.505084   479 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.514070 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.494033   495 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.522699   493 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.524880 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.528976 31420 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:05.532194 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.483266   500 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.536922   490 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:05.542209 31420 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.540616 31434 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:22:05.550414 31434 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet 36ab0d648ab643bf8d74dbe6ee9503d8 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-36ab0d648ab643bf8d74dbe6ee9503d8
I20260709 12:22:05.551079 31420 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.546875   494 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.556010 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.560351 32112 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:05.556901 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.550798 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.476526   499 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.558764   498 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.557214 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.563336 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.566666 31424 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:05.571782   314 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.575690 31423 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:05.576341 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.558128   500 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.603513 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.580080   479 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:05.604250   506 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.206s	user 0.004s	sys 0.000s
I20260709 12:22:05.604543   479 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.608446   479 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.608700 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.609436 32110 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:05.537932   490 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.569084   450 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.580435   499 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.616812 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.625262 31415 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:05.626127 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.617674 31424 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.576824   314 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.617403   480 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.624156   384 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.614820   491 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.640633   513 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.640743 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.616055   493 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.645736 31422 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.647508 31570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:22:05.648147 31570 raft_consensus.cc:606] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:05.640071   450 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:05.641263   513 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.651099   307 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.644266   493 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.652894   307 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.654186   478 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.655364   307 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.652580   508 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.656301 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.657686 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet d385c04853e749af8fb00afe40a4a255 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:22:05.643329   314 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.658093 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.658977 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.647547   472 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.646636   494 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.647462   499 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.661705 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.660454 31568 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:05.666419 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet d385c04853e749af8fb00afe40a4a255 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-d385c04853e749af8fb00afe40a4a255
I20260709 12:22:05.666610 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.665673 31569 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.671069 31571 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.676192   520 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.646972   489 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.668828   513 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.676791   520 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.667083 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.670429   307 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.656919   493 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.645298   497 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:05.674991 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:05.679407   373 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.677927   494 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.811985   466 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.704720   307 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.811046 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.701051 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.746130   384 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.666414   507 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:05.822590 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.843536 31568 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:05.837193 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:05.826299 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:05.833214 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 158302us
I20260709 12:22:05.845358 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.823181 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.842447 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:05.838456 31419 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:05.846661 31570 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:05.838225 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.840926 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:05.674508   499 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.851853   307 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.851783 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.845615 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:05.851788 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.886648 31422 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.852955 31420 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:05.678329   508 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.884558 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.889487 31423 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.700022 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.838883   314 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.762538   498 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.773238   503 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.759766   502 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:05.700778   496 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.791062   519 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.934577   508 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:05.745574   509 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:05.940140 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.829999 31434 tablet_copy_source_session.cc:215] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:05.889213   497 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.826040 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.818614 32105 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:05.889204   467 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.838943   466 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.844795   489 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:05.812882   487 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.852062 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.678079   472 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:05.700292   520 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:05.852527   507 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:05.964272 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.935176   513 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.822037 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.929904   479 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.782232   511 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.968135 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:05.930084   344 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:05.999135 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.015647 32113 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.841485   373 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.956568   477 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:06.003371 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:05.965643 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.967628 32108 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.805131   450 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.028324 31421 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:05.986804 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:05.990898   466 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:05.964073   496 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:05.986474   468 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:22:05.965469   498 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:05.970803   314 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:22:05.986691   458 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:22:06.014726   479 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.185727   479 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.188097 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.189673 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.183396 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.108165   307 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:22:06.119195 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:06.087881 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.187340 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.197540 31495 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:05.976805   502 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:06.038463   424 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.008s
I20260709 12:22:06.202838   307 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.204962   307 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:06.205096 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:05.970016   503 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.203338 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.195560   466 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.991195   519 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:06.212874   502 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.212823   467 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.219511   307 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:06.213860 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 238048us
I20260709 12:22:06.198312 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.221783 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.141475 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.202041   507 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.221436   518 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.223482 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:06.210096 31596 debug-util.cc:398] Leaking SignalData structure 0x7b0800139740 after lost signal to thread 30274
I20260709 12:22:06.223204   503 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:06.242214 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080019d360 after lost signal to thread 31356
W20260709 12:22:06.242625 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080019d6e0 after lost signal to thread 31370
I20260709 12:22:06.243362 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.243606   373 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:06.243832 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080022d980 after lost signal to thread 31449
I20260709 12:22:06.015635   509 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.247800   307 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.248533 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.045065   344 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.249109 31497 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:06.246284 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:06.244184 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08002535c0 after lost signal to thread 31450
I20260709 12:22:06.137630   511 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.107368   477 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.237984 31500 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.238116   472 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.239650 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.209239   424 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.240345 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.241726   480 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.241618 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:06.326716   526 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:06.325784 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:06.327360 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.242498 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.327817   526 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:06.328179   477 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.328531 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.328699   477 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.328807   526 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.226785 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:06.253145 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.329157   477 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.329695 31496 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:06.010708   513 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:06.330358 32112 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.330899   509 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.253495 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.258056   507 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.245705   474 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.227860   314 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:06.239871 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.303632 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.313521 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.314231 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.315137 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:06.343063 31421 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.319676 31418 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:06.321065 31416 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.247648   499 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.253980   494 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.331530 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:06.347566 31422 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:06.226822   518 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.333710 32112 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.334167 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.334892 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.335055   496 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.335469   519 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.337970 32110 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.338102 32114 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:06.329232   526 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.339012 31417 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:06.339646 31492 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:06.340507 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:06.340595 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.342227 31497 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:06.345249 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.359493 31421 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:06.251703   516 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:22:06.332093   472 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:06.341012 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7ee0 after lost signal to thread 31524
W20260709 12:22:06.349733 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46165us
I20260709 12:22:06.257860 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:06.334122   487 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.353590 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.344594   480 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.367841 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.368221 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.363986   528 ts_tablet_manager.cc:933] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.312297   521 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:06.330157   477 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:06.353372 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.534s (SENT) [suppressed 2 similar messages]
I20260709 12:22:06.343812 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.372380   501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ab0d648ab643bf8d74dbe6ee9503d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.369808 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.380195 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.370898 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.343963 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.373137 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.341636   314 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.375530 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:06.367264 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080015fae0 after lost signal to thread 31525
I20260709 12:22:06.362187 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:06.364648   472 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:06.376605   474 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.364928 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.375221 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:06.387233 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 268585us
I20260709 12:22:06.387434 31493 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:06.389417 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.390812   516 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:06.390974 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.378129   513 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.383200   519 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.374972 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.397967 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.408994 31496 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:06.416942 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 63592.2us
I20260709 12:22:06.398463   472 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.387262   512 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.391573 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.377461   468 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:06.421365 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.397996   526 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:06.525578 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 100777us
I20260709 12:22:06.423151 32108 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:06.396878   498 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:06.528944 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 130906us
I20260709 12:22:06.419006   477 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:06.525966 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 128071us
I20260709 12:22:06.534795 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.536037 31496 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:06.422868   519 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:06.540910 32111 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.542922 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.531800 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:06.542513   314 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:06.535698 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080037fd20 after lost signal to thread 31599
I20260709 12:22:06.530614   513 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.547113   524 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.536954   512 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:06.548043   424 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:06.553009 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc400 after lost signal to thread 31600
I20260709 12:22:06.570344 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:06.572773 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:06.416146   518 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.576753   489 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:06.577164   489 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:06.577503   489 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.570748   511 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.584542 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:06.587109 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.563053   450 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:06.564116   512 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.589478 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:06.565831   364 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.591007   480 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:06.579197 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.591153   424 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.574200   314 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.579752 31493 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:06.555373   528 tablet_copy_client.cc:323] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:22:06.588693   467 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:06.556327   466 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.590402   450 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:06.609061 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.592527   364 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.629132 31565 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.590140   490 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:06.630003 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080037fa00 after lost signal to thread 32138
I20260709 12:22:06.631965 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.633265 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.634989 31565 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.641175 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:06.637573 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080037f9e0 after lost signal to thread 32139
I20260709 12:22:06.628968   467 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:06.631358 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.630497   450 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.643221 31571 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:06.644486   499 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:06.630450 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.609560   530 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:22:06.589066   519 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.647045 31565 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.648084 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:06.648391   493 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.005s
I20260709 12:22:06.654524   467 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:06.683022 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.656154 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.636171   490 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:06.658941 31466 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:06.662513 31387 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e77a183300084f968171dcd68225d026. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.669165 31585 tablet_copy_source_session.cc:215] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:06.684870 31565 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.670051 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.675323 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.658120   511 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.670375 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:06.637020 32105 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:06.678496 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:06.679482 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 50043.1us
I20260709 12:22:06.656147 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.684237 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.685833 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.686995   307 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.663622   499 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:06.692765 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.693398 31492 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:06.693310   499 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:06.693986   307 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:06.694192 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.694444 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.694620   499 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.688651 31496 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:06.695952 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.696259 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.693336 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:06.698220   529 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.698566   487 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.698659   529 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:06.699116   529 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.686810   493 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.700416 31572 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:06.694897   307 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:06.704221 31585 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:58364 (request call id 134) took 1050 ms. Trace:
I20260709 12:22:06.707396 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.691445   521 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:22:06.710821   373 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:06.711766   496 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.695060 31492 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:06.689409   490 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.712145   496 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:06.715291 32113 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.716588 32107 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:06.723901 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.684374   364 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:06.727555 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.729362 32114 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.704736 31585 rpcz_store.cc:276] 0709 12:22:05.654651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.655787 (+  1136us) service_pool.cc:224] Handling call
0709 12:22:06.668791 (+1013004us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002b9ba0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196dadc0 00007fc11976d4a5 00007fc11976d3ee 00007fc11e703036 00007fc11e70ca3e 00007fc115fd027b 00007fc11e70c9ba 00007fc11e707acc 00007fc11e702c7b 00007fc11e6f78d1
0709 12:22:06.704148 (+ 35357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271146752}
I20260709 12:22:06.732226 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.716965   519 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.723218   509 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.685760   480 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.737174   494 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.728622   503 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.739287 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.712810   489 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.744870   531 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.745095   466 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.732992   493 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:06.753916 31565 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:22:06.756394   458 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:06.754983 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:06.752012   364 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.761117 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:06.761255   482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d385c04853e749af8fb00afe40a4a255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.763177 32110 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.765480 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:06.764429   535 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:06.750875   496 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.779424   344 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:06.781183 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.764133   491 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:22:06.786402 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.762399   472 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:06.806193 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 269447us
I20260709 12:22:06.810216 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.812013   489 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.813581 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.815757 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.816031 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.819152 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:06.819430 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.819841 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.820353 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.820932 31570 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:06.819185 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.822661 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.823714 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:06.819959 31569 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.829236 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.833346 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.833572   472 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:06.834844 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.835500 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:06.836833 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.837440 31570 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:06.837496 31569 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:06.838541 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:06.839268 31569 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.839532 31568 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.839592   489 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.840204   489 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:06.839267 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 135) took 1184 ms (client timeout 1534 ms). Trace:
I20260709 12:22:06.841352 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 143) took 1153 ms. Trace:
I20260709 12:22:06.843186 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.847407 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:06.843210 31572 rpcz_store.cc:269] 0709 12:22:05.655014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.656715 (+  1701us) service_pool.cc:224] Handling call
0709 12:22:06.839076 (+1182361us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001ce654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:06.839197 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355784960}
I20260709 12:22:06.849502 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.848244 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.857789 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.843454 31571 rpcz_store.cc:276] 0709 12:22:05.680550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.680741 (+   191us) service_pool.cc:224] Handling call
0709 12:22:06.239731 (+558990us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:06.832138 (+592407us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001a6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:06.832309 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689074816}
I20260709 12:22:06.861933   490 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.863348 32114 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.861953   525 raft_consensus.cc:993] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:22:06.864729   525 raft_consensus.cc:1081] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:22:06.866212   531 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.867024 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:06.868458 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.872247 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.874854   538 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.878720   518 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.879314 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.888175 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.889438 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.891422 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.841122   489 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.890497 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.894722   538 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:06.894891 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.896687 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.896589   525 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:06.898651 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.903187   525 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.903544   525 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:06.902387 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.901679 31572 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:06.907179 31569 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:06.907563 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.908221 31565 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:06.913468 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.915076 31565 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.911290 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.921767 31571 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:06.923624 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:06.930486 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.935568   307 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:06.862607   450 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:06.951738 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:06.952409 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.953383 31415 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:06.953719 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.956089 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:06.956516 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.957700 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:06.959625   496 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.960407 31498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:22:06.960914 31498 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.961254 31498 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.934895   521 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:22:06.962982 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.963644   521 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.909042 31573 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:06.964007   521 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:06.953577   467 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.954419 31496 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:06.956805 31422 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:06.969539   545 ts_tablet_manager.cc:933] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
I20260709 12:22:06.928090   490 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:06.974993 31565 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:06.975667 31420 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:06.979072 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:06.980799 32108 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:06.984428 31498 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:06.929186   529 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.971999   487 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.984810 32107 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.904403   525 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.988109 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.988592 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:06.982661   507 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.982283 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:06.986649 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:06.990476 31571 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:06.965852   512 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.974355   538 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:22:07.001580 31424 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:07.001782 31568 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.984859   467 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:06.994576   540 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:22:06.995916 31421 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:06.964906   521 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:06.996341 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:06.990476 31498 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.005810 31423 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:07.004859 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.006498 31423 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:07.007602 31423 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:07.008715 31423 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.013543 31565 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:07.017443 32109 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:06.995915 31499 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:07.002337   507 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:07.021720 31423 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
W20260709 12:22:07.027123 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.027031 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.027436 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.040834 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:07.028246 31570 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:07.028788 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.028965 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.030741   480 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:07.047525 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.048873 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.049384 31566 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3. Re-sending same reply.
I20260709 12:22:07.050225 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.051046 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.051707 31570 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:07.052481 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.053412 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.054360 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.042379 31568 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:07.064818   487 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.065222   487 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:07.065331 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.066138 31567 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:07.067051 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.068504   450 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.068076 31319 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.071542 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.071954   501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55792 (request call id 284) took 1905 ms. Trace:
I20260709 12:22:07.072222 31569 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:07.073360 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.039106 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.076066 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.057657 31492 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.059417   529 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:07.073590 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.083488 31495 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.069741 31319 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to <none>, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:22:07.083973 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.085067 31319 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.090148 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.090780 31572 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:07.042695 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:07.088806 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.045051 31571 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:07.092429 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.093047 31566 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.093875 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:07.092445 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.066071   487 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.104897 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.105609 31319 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.108822 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.110093 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.111011 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.112905 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.112851 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.113785 31571 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
W20260709 12:22:07.114856 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 72252.3us
I20260709 12:22:07.117384 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.118773 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.107836 31319 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:07.104151 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.121922 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:07.122632   384 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.123124   384 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.123207 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:07.127084 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.128139 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.129829   384 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:07.130394   384 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.131186 31565 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:07.135530 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.137305 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.138177 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.131495 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.139766 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.140332 31571 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.110769   424 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:07.109018   521 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.136186 31497 raft_consensus.cc:2376] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2. Re-sending same reply.
I20260709 12:22:07.124174   494 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.128017   529 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.147011 31565 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:07.120512   482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55788 (request call id 410) took 3458 ms. Trace:
I20260709 12:22:07.126824 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:07.136641   487 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.152710 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.072381   501 rpcz_store.cc:276] 0709 12:22:05.166647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.208503 (+ 41856us) service_pool.cc:224] Handling call
0709 12:22:05.373533 (+165030us) ts_tablet_manager.cc:934] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
0709 12:22:06.312831 (+939298us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:06.819504 (+506673us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:06.820790 (+  1286us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:07.071151 (+250361us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:07.071469 (+   318us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:07.071792 (+   323us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:07.071863 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11730,"tablet-copy.queue_time_us":163933,"thread_start_us":153678,"threads_started":2}
I20260709 12:22:07.151664   494 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:07.148512 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:07.198720 31571 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.157274 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.158929 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.120322   480 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:07.143589 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.193490 31496 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:07.199779 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.192224   526 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.207129 31565 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.153442   514 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:07.215775 31565 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.216679 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 9dd7b78d2ef1488c970505878e67c6ca from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:22:07.217394 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 9dd7b78d2ef1488c970505878e67c6ca from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-9dd7b78d2ef1488c970505878e67c6ca
I20260709 12:22:07.217572   384 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.197238 31573 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:07.225582 31570 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.227130 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.227807 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:07.224731 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:07.228206 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124163us
I20260709 12:22:07.228013 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.230000 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.236788   538 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:07.237358   538 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:07.202805 31494 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
W20260709 12:22:07.239076 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.238327   538 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.239970   538 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:07.149814   507 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.207713   501 tablet_copy_client.cc:806] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.280593 31565 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.228277 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.253332 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.282166 31571 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:07.259995 31566 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:07.208191   424 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:07.270244 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 143294us
I20260709 12:22:07.289181 31568 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:07.230881   512 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.294513 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.300872 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.271126   514 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.271441   480 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.299037 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.307973 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.303463 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:07.311314 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:07.303243   550 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:22:07.297073   450 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.343501   384 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:07.343925   384 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:07.306595   501 tablet_copy_client.cc:670] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.351413 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:07.352804   551 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:07.353653 31510 tablet_copy_source_session.cc:215] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:07.313944   512 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:07.355508 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.345510   514 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.363710   514 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:07.363932 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.364243   563 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.364701   563 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:07.365149   563 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.364722   514 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.151685   482 rpcz_store.cc:276] 0709 12:22:03.763098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.772840 (+  9742us) service_pool.cc:224] Handling call
0709 12:22:04.404336 (+631496us) ts_tablet_manager.cc:934] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
0709 12:22:06.759298 (+2354962us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:06.875494 (+116196us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:06.875703 (+   209us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:07.054272 (+178569us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:07.054572 (+   300us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:07.098582 (+ 44010us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:07.107863 (+  9281us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":404,"tablet-copy.queue_time_us":547476,"thread_start_us":934836,"threads_started":2}
I20260709 12:22:07.371124   482 tablet_copy_client.cc:806] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:07.327567   480 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.370528   384 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.371826   482 tablet_copy_client.cc:670] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:07.379312   384 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.383035 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79651.7us
I20260709 12:22:07.383852 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:07.385528 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77622.7us
I20260709 12:22:07.387339 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:07.389380 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.302896   494 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:07.397063 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.373591   517 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.405248 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.406119   528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd7b78d2ef1488c970505878e67c6ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:07.408249 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.409246 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.395136   552 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.410548 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.402138   560 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.401038   450 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.412590   552 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:07.337029   424 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.420013 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.406714   517 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:07.420946 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:07.422508 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.438238 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:07.441694 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129183us
W20260709 12:22:07.448292 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.448606 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.450153 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.411918   545 tablet_copy_client.cc:323] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
I20260709 12:22:07.450848 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:07.420213   480 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:07.420547   552 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.458524 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:07.420464 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:07.440829   560 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:07.463771 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.461333 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:07.460278 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:07.466652 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.448221 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.466361 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.468007   557 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:07.467805 31572 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:07.473196 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:07.474524 31498 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.460136   559 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:07.451172   531 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:22:07.479278 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.462769 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.480994 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.485532 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.481117 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.482465 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.479936 31572 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:07.486893 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.490626 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.490487   560 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.491371 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.491565 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.491978 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.492398 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.510097 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:07.513088 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.512976 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:07.513833 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.516026 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:07.493484   518 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.006s
I20260709 12:22:07.486594 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.515456 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.492735 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.519686 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.519203 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.522718 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.523777 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.525264 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.528368 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.532280 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.532820 31572 raft_consensus.cc:2376] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2. Re-sending same reply.
I20260709 12:22:07.532948 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:07.526641 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:07.523864 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.535898 31569 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:07.536572 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:07.537398 31492 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:07.538336 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:07.539239 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.558046 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.562635 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:07.565563 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51249.6us
I20260709 12:22:07.567210 31495 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:07.567370 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.570760 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.570806 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.573799 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.573884 31424 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:07.574410 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.574823 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.575791 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.576082 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.577090 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.577710 31423 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:07.577392 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.581075   384 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:07.582710   384 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:07.487242   517 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.588402 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.561331 31567 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:07.589403 31424 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.594172 31419 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.573952   480 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.564085 32108 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:07.617437   559 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:07.618861   559 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.619216   559 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:07.619989   559 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.621016   559 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:07.622865 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:07.635866 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69344.4us
I20260709 12:22:07.636788 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.630417   559 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:22:07.638134   559 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.638532   559 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:07.639554   559 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.642617   559 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.642944   568 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:07.645872   568 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:07.646765   526 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.647333   526 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:07.646837   568 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.647724   526 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.648255   568 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.593066 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.650520 31422 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:07.603896 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:07.655683   307 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:07.689898 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51810.4us
I20260709 12:22:07.691033 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.634253   480 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:07.693969 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.633898   552 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.690471   482 tablet_copy_client.cc:538] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:07.694932   364 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.695925   525 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.705070 31424 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:07.705628 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.728669 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.733021 31574 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.723891 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:07.735738 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53188.4us
I20260709 12:22:07.736570 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.723054 32106 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:07.739296 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:07.711943 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:07.741050 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.682480   562 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:22:07.745285 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:07.738245   518 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.704406   577 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.737913   571 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.755045 32107 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:22:07.755187   572 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:22:07.745597   578 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:07.760610   490 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:07.749466   364 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:07.761612   498 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:07.749225   577 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:07.748339   563 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:07.808347   563 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.745956 31491 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:07.809229   577 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.806452   576 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:22:07.803485   490 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:07.820696   490 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:07.821856   490 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.823230 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.811863   480 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.763427   571 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:07.813084   552 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:07.812166   498 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.811342   562 raft_consensus.cc:2764] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:07.854846   498 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:07.856925   498 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.846751   571 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.864040 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 171003us
W20260709 12:22:07.866895 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 286167us
W20260709 12:22:07.906416 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.882856 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:07.934904 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62891us
W20260709 12:22:07.935384 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 52644.7us
I20260709 12:22:07.939666 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:07.948345 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 157) took 1352 ms. Trace:
I20260709 12:22:07.957165 31424 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:07.958835 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:07.948920 31574 rpcz_store.cc:276] 0709 12:22:06.595446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.595945 (+   499us) service_pool.cc:224] Handling call
0709 12:22:07.948124 (+1352179us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400262ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:07.948272 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140532992}
I20260709 12:22:07.975126   557 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:07.860569 31415 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:07.990031   539 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:22:07.995754   539 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:07.971220   467 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.002935   491 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:08.003435   491 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:08.004434   491 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:08.017745 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.938599   552 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:07.980590   538 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:08.032126 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:07.998515 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 167) took 1022 ms. Trace:
I20260709 12:22:07.999639 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:08.047493 31423 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.989300   526 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:08.051208 31421 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:08.057852 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.047837   538 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:08.075245 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:08.076202 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:08.075281   384 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:08.051868 31417 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:08.098322 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:08.094281 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:08.112524 31495 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:22:08.126662 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 387416us
I20260709 12:22:08.127694 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.128638   307 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.119342   450 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:08.048137 31415 rpcz_store.cc:276] 0709 12:22:06.966520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.972696 (+  6176us) service_pool.cc:224] Handling call
0709 12:22:07.416463 (+443767us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:07.986826 (+570363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6076160}
I20260709 12:22:08.130746 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.150986 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:08.152927 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.158648 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.119524   498 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:08.161309 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:08.166371   580 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:22:08.166834   584 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.138744   450 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:08.154436   494 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:08.180019 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 433196us
I20260709 12:22:08.183734 31565 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:08.200757 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.229334 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.175509 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.230790 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:08.232040 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56665.4us
I20260709 12:22:08.232862 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.199486   511 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:08.234876 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.239168   582 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:08.242381 31389 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.534s (SENT)
I20260709 12:22:08.251792   518 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.233883   578 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.231739   529 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.250407 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.282286 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.255499 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:08.259749   307 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.265872   521 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.267217   511 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:08.268110 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.272540 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.228755   528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55794 (request call id 526) took 2008 ms. Trace:
I20260709 12:22:08.158241   538 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:08.202919   562 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:22:08.308137 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 369210us
I20260709 12:22:08.277941   482 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:22:08.224447   584 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:22:08.306176   364 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.324185 31495 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:08.323954   559 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:08.332778 31496 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:08.326897 31419 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:08.326653 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:08.337282 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.292785   526 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:08.305925   530 raft_consensus.cc:2764] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:08.308497   511 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:08.309218 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1012) took 1266 ms. Trace:
I20260709 12:22:08.347215   307 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:08.342348 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.344523   592 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:08.345198   591 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:22:08.322381 32108 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
W20260709 12:22:08.352286 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 109928us
W20260709 12:22:08.357486 31389 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.541s (SENT)
I20260709 12:22:08.357990 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.296537   563 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:22:08.352826 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.353399 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.363580   384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50098 (request call id 8) took 2517 ms. Trace:
I20260709 12:22:08.364090 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.347100 31415 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:08.368615 32111 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:08.346980 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:08.350670   568 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.008s
I20260709 12:22:08.380486 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.350605 31491 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:08.387302 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.355392   560 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.392359 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.392400 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.411746 31500 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:08.424032 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.364538   384 rpcz_store.cc:276] 0709 12:22:05.834402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.834543 (+   141us) service_pool.cc:224] Handling call
0709 12:22:05.967419 (+132876us) log.cc:844] Serialized 513 byte log entry
0709 12:22:08.350322 (+2382903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32579,"raft.queue_time_us":136533,"raft.run_cpu_time_us":2428,"raft.run_wall_time_us":114915,"thread_start_us":535181,"threads_started":3,"wal-append.queue_time_us":276504,"wal-append.run_cpu_time_us":1804,"wal-append.run_wall_time_us":1097957}
I20260709 12:22:08.428189 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.430451 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.366089   467 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.435165 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.375197   525 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.376369   424 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.431840 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:08.435777 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.434551 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:08.393829   489 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:08.384501   526 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.436705 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:08.441783 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.436905 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.437937 31574 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3. Re-sending same reply.
I20260709 12:22:08.341856   450 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:08.458998 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:08.461519 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 135463us
I20260709 12:22:08.460507 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.462913 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:08.396473 31492 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:08.463848   595 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:08.464259   595 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:08.385143   512 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:22:08.466949 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:08.483449 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 192023us
I20260709 12:22:08.437891 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.477706 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.484026   554 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:08.439604   489 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:08.486378 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 123561us
I20260709 12:22:08.435983   584 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.443379 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:08.486636 31571 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:08.488021 32113 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:08.501381 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.503379 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.504915 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.457021   530 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:08.494691 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64429.4us
I20260709 12:22:08.525084 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.496718 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.484059 31568 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:08.530484 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.347592 31567 rpcz_store.cc:276] 0709 12:22:07.036002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.066789 (+ 30787us) service_pool.cc:224] Handling call
0709 12:22:08.280833 (+1214044us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54002620d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:08.302634 (+ 21801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121526528}
W20260709 12:22:08.496348 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58817.6us
I20260709 12:22:08.423012   364 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:22:08.487810 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 542) took 1078 ms. Trace:
I20260709 12:22:08.584864 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:08.484426   496 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:08.553993 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.437455   562 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:22:08.575776 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.619863 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.620416 31571 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:08.621322 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:08.459686   514 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:22:08.625787 31497 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:08.628445 31570 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
W20260709 12:22:08.621588 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74328.2us
I20260709 12:22:08.487731   489 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.485185   509 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:08.499784   518 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.536451   507 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.632045 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:08.634622 31463 consensus_peers.cc:597] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.638294 31463 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.637748 31571 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:08.640545 31389 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.617s (SENT)
I20260709 12:22:08.640980 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.311156   528 rpcz_store.cc:276] 0709 12:22:06.219833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.234855 (+ 15022us) service_pool.cc:224] Handling call
0709 12:22:06.375105 (+140250us) ts_tablet_manager.cc:934] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
0709 12:22:07.400666 (+1025561us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:07.802027 (+401361us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:07.808722 (+  6695us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:08.125808 (+317086us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:08.148258 (+ 22450us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:08.201059 (+ 52801us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:08.226063 (+ 25004us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":139606,"tablet-copy.queue_time_us":106591,"thread_start_us":129218,"threads_started":2}
I20260709 12:22:08.620393   557 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.619109   496 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:08.648222 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.650928 31571 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:08.586066 31573 raft_consensus.cc:2376] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2. Re-sending same reply.
I20260709 12:22:08.654170 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:08.545135   531 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 12:22:08.631700 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:08.658357 31574 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:08.642158   563 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.642204   526 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.637522   498 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:08.653192   577 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.002s
I20260709 12:22:08.635686   509 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:08.678959   577 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:08.679591   509 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:08.681319   577 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:08.587103 32106 rpcz_store.cc:276] 0709 12:22:07.409554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.410409 (+   855us) service_pool.cc:224] Handling call
0709 12:22:08.487562 (+1077153us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540049d9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:08.487725 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550383488}
I20260709 12:22:08.672149 32114 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:08.652370   480 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:08.708057 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.658763   496 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:08.709627   583 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
W20260709 12:22:08.712205   594 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:22:08.665603   521 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.740801 31415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:08.741597 31415 raft_consensus.cc:606] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.682623 31573 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:08.622746   595 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:08.743551 31415 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:08.711048   578 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:08.685441   563 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:08.785396 31433 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet e77a183300084f968171dcd68225d026 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:22:08.761022   578 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:08.792326   571 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.855s	user 0.002s	sys 0.008s
I20260709 12:22:08.759555 31418 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:08.764618   593 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.809224 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 264547us
I20260709 12:22:08.748507   521 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:08.827615 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 187080us
W20260709 12:22:08.838279 31389 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.670s (SENT)
I20260709 12:22:08.838985 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.816543   571 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:08.900349 31571 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:22:08.904456   571 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:08.866940 31573 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:22:08.912896 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.836411   593 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:08.916932 31573 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:08.920888   563 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:08.922196   563 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.915421 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.835863 31433 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet e77a183300084f968171dcd68225d026 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-e77a183300084f968171dcd68225d026
W20260709 12:22:08.928846 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 344067us
I20260709 12:22:08.951189 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:08.952507   566 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:08.953074   566 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:08.942039 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.928484 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:08.962199   552 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:08.965960   565 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:22:08.970106 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:08.964398   577 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.971557 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.972146   560 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:08.980630   577 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.939042   531 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.985371   578 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:08.982152 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:08.988966   511 consensus_meta.cc:287] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.634s	user 0.004s	sys 0.006s
I20260709 12:22:09.001309 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.002274 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:09.005533 31422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.013s	sys 0.017s
I20260709 12:22:09.006749 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:08.929147   563 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:09.005833 31422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.013s	sys 0.017s
W20260709 12:22:09.012562 31417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 169) took 2040 ms (client timeout 2018 ms). Trace:
I20260709 12:22:09.012324 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.005084   578 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:09.005386   526 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.006518   571 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.004740   552 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.002960   584 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:09.023236   578 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.992905   560 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:09.013005 31417 rpcz_store.cc:269] 0709 12:22:06.968128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.971375 (+  3247us) service_pool.cc:224] Handling call
0709 12:22:09.004730 (+2033355us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540022ef54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:09.008925 (+  4195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888776448}
I20260709 12:22:09.005206   511 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:09.041579 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.043318 31421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.013s	sys 0.019s
W20260709 12:22:09.044803 31421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.013s	sys 0.019s
I20260709 12:22:09.048842   384 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:08.961941   566 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:09.041548   521 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.060482   607 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.041399   552 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.061419   526 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:09.088066 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 249811us
I20260709 12:22:09.089973 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.091583 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.093639 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.095093 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.047004   584 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.079867   496 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.107676   584 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.113204   612 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.052641   489 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.158692   605 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:09.179188 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.180945 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 85940.4us
I20260709 12:22:09.182176 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:09.187861 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 169943us
I20260709 12:22:09.189725 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.109542   526 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.192296 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:09.194824 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.195952   574 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.196055 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:09.196688 31497 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:09.197110   574 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:09.197901   574 consensus_queue.cc:1243] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:09.199103 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.199928   609 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.202571 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.203867 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:09.193765   578 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:09.202971   584 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.204546 31497 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.210518   560 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:09.198143   563 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.202652   496 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.213668 31422 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:09.221568 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:09.217736   612 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:09.227150   491 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.227356   563 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.231334   613 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.233314 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:09.240198 31571 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.241876 31422 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:09.238417 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.218449   584 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.226495   511 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:09.244529 31569 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:09.251222 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.256155 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.257193 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:09.254721   552 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:09.257175   613 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.265796 31571 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:09.256280   615 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:09.265763   606 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 12:22:09.261118   489 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:09.283421 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:09.281008   584 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.284641   619 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.285897 31493 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:09.286540 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 973) took 1011 ms. Trace:
I20260709 12:22:09.280421 31318 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.282544   613 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:09.284710   518 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.262794 31416 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:09.290030 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:09.281697 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.295620 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.296934 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.290984   553 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.302410 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:09.286901 31493 rpcz_store.cc:276] 0709 12:22:08.274880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.276818 (+  1938us) service_pool.cc:224] Handling call
0709 12:22:09.285495 (+1008677us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:09.285702 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:09.286293 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.286483 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18732800}
I20260709 12:22:09.293500   518 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:09.301651   615 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.302085   584 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.291090   613 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:09.304265 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 174) took 1341 ms. Trace:
I20260709 12:22:09.324345   613 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.305544   586 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:09.319228 31433 tablet_copy_source_session.cc:215] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:09.321341   553 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:09.325603 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:09.329773   621 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.337162   553 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:09.326788   584 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.339478   518 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:09.350694   518 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.342372   531 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.331328   586 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.345014   553 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.324303 31416 rpcz_store.cc:276] 0709 12:22:07.960922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.982397 (+ 21475us) service_pool.cc:224] Handling call
0709 12:22:08.923656 (+941259us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:09.301949 (+378293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4891904}
W20260709 12:22:09.361038 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.363667   627 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.358741   577 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.367069   615 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:09.372146   577 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.365490 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:09.369308 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 173) took 1409 ms. Trace:
I20260709 12:22:09.370121   619 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.375335 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:09.375247 31418 rpcz_store.cc:276] 0709 12:22:07.960491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.973157 (+ 12666us) service_pool.cc:224] Handling call
0709 12:22:09.369138 (+1395981us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540024fc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:09.369250 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786022272}
I20260709 12:22:09.381915   584 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.385998   586 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.374836   615 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:09.387593   615 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.387977   615 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.387234   613 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:09.391999   577 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:09.394179   623 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:09.395041   613 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:09.396808 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:09.371448   627 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.404814   627 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.408006 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 437) took 1068 ms. Trace:
I20260709 12:22:09.408429 32113 rpcz_store.cc:276] 0709 12:22:08.338900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.339018 (+   118us) service_pool.cc:224] Handling call
0709 12:22:08.487827 (+148809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:08.500844 (+ 13017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.407027 (+906183us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540049d9d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:09.407214 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341596928}
I20260709 12:22:09.412065 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:09.405519   538 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:22:09.421483   538 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:09.422027   526 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.425148   384 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:09.425652   384 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.421821   538 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:09.444041 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:09.444933 31496 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.448207 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:09.449824 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.450433 32111 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.450809 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.465330 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.465744 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:09.466886 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.440119   586 raft_consensus.cc:476] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:22:09.468715 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:09.469166 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:09.470007 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.469314 31565 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:09.470916 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2037) took 1080 ms. Trace:
I20260709 12:22:09.471294 31565 rpcz_store.cc:276] 0709 12:22:08.390611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.440733 (+ 50122us) service_pool.cc:224] Handling call
0709 12:22:09.468566 (+1027833us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:09.470859 (+  2293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5667712}
I20260709 12:22:09.438463   630 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.461700   605 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.461550   526 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.492390   384 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.495234   384 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.482547 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:09.484017 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:09.484930 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:09.461305   563 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.485780 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:09.480315 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.479689 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:09.499753 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:09.465425 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.505971 31419 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:09.474568   503 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.474785   521 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.475387   586 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.532843 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2043) took 1115 ms. Trace:
I20260709 12:22:09.464775   615 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:09.533695   589 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.022s	sys 0.032s
I20260709 12:22:09.488929   605 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.545543 31568 rpcz_store.cc:276] 0709 12:22:08.395077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.622483 (+227406us) service_pool.cc:224] Handling call
0709 12:22:08.630495 (+  8012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.633228 (+  2733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.633259 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.633836 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.025185 (+391349us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:09.105439 (+ 80254us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.109330 (+  3891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.109409 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.275461 (+166052us) raft_consensus.cc:1685] finished
0709 12:22:09.275485 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.510102 (+234617us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b54002517d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:09.510272 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5993,"prepare.queue_time_us":185519,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":60202,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":243,"spinlock_wait_cycles":17644416,"thread_start_us":412268,"threads_started":2,"wal-append.queue_time_us":447463}
I20260709 12:22:09.462038   538 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:09.504614   630 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.553647 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:09.503156   619 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:09.554358 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:09.557471   589 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.022s	sys 0.033s
W20260709 12:22:09.541332   482 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:22:09.557118   605 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.543651 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:09.567466 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:09.549470 31572 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.552654 32106 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:09.554332   521 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.552910   503 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.563778   630 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:09.594607 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1057) took 1162 ms (client timeout 1531 ms). Trace:
W20260709 12:22:09.606165 31572 rpcz_store.cc:269] 0709 12:22:08.432142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.435223 (+  3081us) service_pool.cc:224] Handling call
0709 12:22:09.465588 (+1030365us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:09.594550 (+128962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5700480}
I20260709 12:22:09.606666 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:09.590507   593 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:09.581449   619 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.616510   631 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.618114   521 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.625350   615 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.629475   503 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.630158 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:09.604830 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 976) took 1114 ms. Trace:
I20260709 12:22:09.711150 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:09.712881 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 371828us
W20260709 12:22:09.867374 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.898653 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.842559 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.723515 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 284503us
I20260709 12:22:09.904197 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:09.904837 32113 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.744354 31491 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.907837 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:09.908481 32108 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.711480   631 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.911864 31419 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:09.913062 32113 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:09.926397   507 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:09.894837   571 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.928328   571 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:09.929497   553 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.005s
I20260709 12:22:09.929925   553 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:09.930805   571 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.833199   503 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:09.932403   619 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.932471   503 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.935422   503 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:09.937521   548 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:09.939623   548 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:09.940699 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:09.896445   639 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:22:09.943413 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.947180 32113 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:09.943498 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:09.735594   528 tablet_copy_client.cc:806] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:09.947930 31496 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.951179   509 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.894395   518 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.898025   521 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:09.956892 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:09.956811 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:09.957376 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.960251 32110 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:09.812819   450 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:09.962193 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.949172   487 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.968839 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:09.970463 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:09.958642   482 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:09.974229 31422 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:09.976269 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:09.966274   528 tablet_copy_client.cc:670] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:09.976634 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.976907 31496 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:09.980712 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:09.986662   384 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.987313   384 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.971496   615 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.992132 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:09.776966   605 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.007174 31574 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:10.001070 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.972472   487 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:09.902062 31492 rpcz_store.cc:276] 0709 12:22:08.485761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.488057 (+  2296us) service_pool.cc:224] Handling call
0709 12:22:08.488368 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:08.633272 (+144904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.635581 (+  2309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:08.643130 (+  7549us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:08.648090 (+  4960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.594168 (+946078us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400023fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:09.595495 (+  1327us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.598977 (+  3482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308302208}
I20260709 12:22:09.974321   548 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:09.968190 32108 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:10.013756 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.977591   632 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.974115   613 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:10.013433   615 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.028012 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:10.021230 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.022612 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.023164 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:10.035244 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.028546 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.029058   384 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:10.030148 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:09.966035   518 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.025041 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:09.967578   521 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:09.969726   450 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.030877 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:10.040650 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.040990 32114 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:10.039314 31421 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:10.042757 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.057489 32113 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:10.037314 31574 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:10.026499   531 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.026032 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.063386 31568 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:10.031430   632 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:10.024070 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:10.069533 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.005s
W20260709 12:22:10.075313 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.005s
W20260709 12:22:10.075920 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 606793us
I20260709 12:22:10.076987 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:10.078183 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:10.081580 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:10.082348 31498 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:10.084534 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:10.085657 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:10.059649   553 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:10.099958 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 176039us
I20260709 12:22:10.041587   631 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.065683   531 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.026314   630 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.067699   632 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.067091   526 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.133947 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:10.074113 31573 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:10.074226   604 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.174600 31574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39924
I20260709 12:22:10.068418 32105 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:10.099732   503 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.102753   496 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:22:10.260071   604 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:10.259572 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 181448us
I20260709 12:22:10.168566   559 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.167754   531 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:10.167289   482 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:22:10.278494   482 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:10.279933   482 tablet_bootstrap.cc:492] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:22:10.282344   482 ts_tablet_manager.cc:1403] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 2.108s	user 0.030s	sys 0.015s
I20260709 12:22:10.170838   592 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:10.285104   592 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.287961   592 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.288714   592 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:10.172964   571 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.292624   531 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.284030 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:10.271353 31574 raft_consensus.cc:606] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:10.127360   487 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.304553 31574 raft_consensus.cc:614] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:10.306828   526 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:10.311627 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:10.312909 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 179060us
I20260709 12:22:10.314112   581 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:10.298946   591 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.317293 31417 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:10.337105 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:10.338668 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:10.324849 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 305976us
I20260709 12:22:10.316318   632 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.303925   496 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.348222 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:10.354923   519 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.355383   649 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:10.355541 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:10.356679   519 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.327613   424 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:22:10.357528   640 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
I20260709 12:22:10.327396   559 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.343273 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.343816   518 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.345433   531 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.345890   494 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.305788   503 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:22:10.356793   643 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:22:10.302867   615 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.321372   501 tablet_copy_client.cc:538] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:10.325783   581 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:10.364202 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 166097us
I20260709 12:22:10.306475   571 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.379842 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:10.381001 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:10.385160 31423 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:10.361891   664 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.333110   526 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.420881 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:10.421350   424 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.421754   656 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:10.421875   424 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.399856 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:10.367093   605 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.364269   548 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:10.406114 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:10.424844 31422 raft_consensus.cc:2393] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:10.397260 31491 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:10.416608   645 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:22:10.416981   496 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.418924   616 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.419085   648 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:10.342018   591 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.372756   518 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:10.385351   521 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:10.426147 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 65553.2us
W20260709 12:22:10.405454   644 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:22:10.406450   450 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.433650   559 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:10.465651 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:10.553194 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 219698us
I20260709 12:22:10.432089   424 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:10.487330 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:10.573783 32111 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:10.534340   633 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.997s	user 0.018s	sys 0.023s
I20260709 12:22:10.511574   595 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.511545   571 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.511045   668 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.489557   630 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.581488 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:10.511806 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:10.527030   632 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.510535   526 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.542210   518 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:10.485903   511 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:10.504294 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:10.528677   655 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:10.584378 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:10.490572   666 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.527789   661 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:10.575070   503 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:22:10.583299   571 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.582943   656 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:10.607286   673 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:10.608009   673 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:10.609263   673 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.594527 32111 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:10.577387   604 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:10.584828 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 260420us
I20260709 12:22:10.565578   559 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.598078 31465 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:10.490998   616 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.600327 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:10.424284   548 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:10.604540 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 431017us
I20260709 12:22:10.626133 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:10.613693 31416 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:10.596495   526 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:10.586997   665 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.504279   496 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:22:10.432471   581 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:10.596315   511 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.583410   668 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.623829   545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77a183300084f968171dcd68225d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:10.577456   648 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.633144   503 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.635128   591 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:10.619019 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 183719us
I20260709 12:22:10.612783   571 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:10.619992 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.631528   632 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:10.629937   604 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.606475   661 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.637836 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1183) took 1153 ms. Trace:
W20260709 12:22:10.647195   651 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:22:10.605203   666 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.647405   630 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.643610   672 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.624747   518 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.645133   503 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:10.633235   526 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.650197 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:10.653002   632 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:10.653295   604 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.648440   482 raft_consensus.cc:359] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:10.657793   655 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:22:10.720672 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:10.735184   511 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:10.680509   518 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.738621   648 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:10.675981   661 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.744282   668 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.739938 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:10.723507   503 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.695587   559 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:10.741400   632 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.721503   482 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:22:10.731866   501 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
W20260709 12:22:10.746147   509 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.000s
I20260709 12:22:10.666121   656 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.671286 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:10.653189 31416 rpcz_store.cc:276] 0709 12:22:09.483257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.485723 (+  2466us) service_pool.cc:224] Handling call
0709 12:22:10.511635 (+1025912us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:10.636389 (+124754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16105728}
I20260709 12:22:10.668607   630 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.752024   661 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:10.742914   616 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.696064   672 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.763088   661 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:10.773697 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 147026us
I20260709 12:22:10.759404   666 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.801946   661 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:10.834097   604 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:10.768296   482 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:10.813373   592 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 12:22:10.930050 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.825731   666 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:10.957316 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.869791   384 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:10.959019   384 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:10.955523 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 145087us
W20260709 12:22:10.865988   681 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:22:10.964136 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:10.844651   661 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:10.867357   521 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:10.964435   384 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.941123   648 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:10.897068   604 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.977592   384 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.968061   521 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:10.974114   538 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:10.974612   674 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:11.001631 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:10.979853 31418 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:11.023422 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:10.977453   679 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.987715   568 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.987746 32108 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:10.985204   548 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:10.964879   666 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:10.975693   648 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:10.975901   604 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:10.991037   557 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.023609   672 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.028010   563 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.025527   621 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.022169   611 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:10.972411   661 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.079541   548 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.046806   679 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:11.096858 31570 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:11.086563   649 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.053552   568 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.080780   662 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.096215   563 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.044509   674 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:11.118117   577 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.130056   604 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.108775   592 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.109503   621 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.118525   679 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.183432   648 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.187235   482 ts_tablet_manager.cc:1434] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.882s	user 0.014s	sys 0.000s
I20260709 12:22:11.192348   503 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.193552 31496 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.098165   557 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.115656   611 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:11.201624   611 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.202203   611 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:11.187701   482 ts_tablet_manager.cc:1467] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Tablet startup took 888ms
I20260709 12:22:11.210129   563 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:11.203578   482 ts_tablet_manager.cc:1469] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Trace:
0709 12:22:03.763098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.772840 (+  9742us) service_pool.cc:224] Handling call
0709 12:22:04.404336 (+631496us) ts_tablet_manager.cc:934] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
0709 12:22:06.759298 (+2354962us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:06.875494 (+116196us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:06.875703 (+   209us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:07.054272 (+178569us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:07.054572 (+   300us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:07.098582 (+ 44010us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:07.107863 (+  9281us) inbound_call.cc:177] Queueing success response
0709 12:22:08.160786 (+1052923us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:22:10.305377 (+2144591us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:22:10.409872 (+104495us) tablet_replica.cc:261] Starting instrumentation
0709 12:22:10.410504 (+   632us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":404,"mutex_wait_us":27042,"raft.queue_time_us":15615,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1681,"tablet-copy.queue_time_us":547476,"tablet-download-pool.queue_time_us":19523,"tablet-download-pool.run_cpu_time_us":1460,"tablet-download-pool.run_wall_time_us":279736,"thread_start_us":934836,"threads_started":2}
I20260709 12:22:11.167986   577 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:11.160210   662 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.168114   592 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.195281   648 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:11.228571   688 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:22:11.228956   545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55792 (request call id 312) took 4336 ms. Trace:
I20260709 12:22:11.231827 31491 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.232323 31493 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.232606   592 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.246265 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:11.247368 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2134) took 1734 ms. Trace:
I20260709 12:22:11.229331   545 rpcz_store.cc:276] 0709 12:22:06.892771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.892909 (+   138us) service_pool.cc:224] Handling call
0709 12:22:06.985647 (+ 92738us) ts_tablet_manager.cc:934] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
0709 12:22:10.622000 (+3636353us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:10.867587 (+245587us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:10.867730 (+   143us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:11.197101 (+329371us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:11.228439 (+ 31338us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:11.228806 (+   367us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:11.228870 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":24912,"tablet-copy.queue_time_us":39831,"thread_start_us":421572,"threads_started":2}
I20260709 12:22:11.248028 31424 rpcz_store.cc:276] 0709 12:22:09.513109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.534655 (+ 21546us) service_pool.cc:224] Handling call
0709 12:22:11.246050 (+1711395us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:11.247290 (+  1240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4903296}
I20260709 12:22:11.225641   557 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.218219   611 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:11.252494 31415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.004s	sys 0.030s
I20260709 12:22:11.278774 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.280093 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.281399 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.295032 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.306334 31566 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:11.295687 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.309629 31565 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:11.274024   672 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:11.313583   672 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.315289   526 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.315618   672 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.291875   661 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.292440   689 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:11.266583   604 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.233922   648 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.323213   648 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:11.274648   683 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:22:11.292308   666 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.299361   548 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.274796   545 tablet_copy_client.cc:806] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
W20260709 12:22:11.289518 31415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.031s
I20260709 12:22:11.297019   621 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.287070 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.291934 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.298610   674 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:11.324689 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.325188   568 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.319511   604 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.327507 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 994) took 1004 ms. Trace:
I20260709 12:22:11.333431 31420 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:11.328084 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.329114   503 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.348186 31496 rpcz_store.cc:276] 0709 12:22:10.323316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.324732 (+  1416us) service_pool.cc:224] Handling call
0709 12:22:10.889706 (+564974us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:10.889907 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.193918 (+304011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.327270 (+133352us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54000249d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:11.327437 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705096320}
I20260709 12:22:11.333170   545 tablet_copy_client.cc:670] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:11.332160   548 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:11.364154 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.355825   666 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.371417   666 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.371865   662 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:11.373286 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 1.04891e+06us
I20260709 12:22:11.374249 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:11.334775   538 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:11.316701   689 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:11.630755 31466 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.048s
W20260709 12:22:11.581816 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.014s	sys 0.018s
W20260709 12:22:11.452157 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 420577us
I20260709 12:22:11.727869 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.495704 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:11.460422 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.465914 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.612803   698 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.349872   563 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.347764 31567 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
W20260709 12:22:11.741819 31466 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.028s	sys 0.064s
W20260709 12:22:11.761996 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 651412us
W20260709 12:22:11.357285   518 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.007s
I20260709 12:22:11.745401 31496 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
W20260709 12:22:11.741832 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 367641us
W20260709 12:22:11.741984 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.016s	sys 0.023s
W20260709 12:22:11.771756 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 748407us
W20260709 12:22:11.771462 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 307112us
W20260709 12:22:11.741190 31568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.005s	sys 0.007s
I20260709 12:22:11.347647   648 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:11.772946 31568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.006s	sys 0.007s
I20260709 12:22:11.774058 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:11.429979 31491 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:11.775341 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:11.774616 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 215) took 1016 ms. Trace:
I20260709 12:22:11.356072   592 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.777915 31571 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:11.776206 31568 rpcz_store.cc:276] 0709 12:22:10.757898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.758033 (+   135us) service_pool.cc:224] Handling call
0709 12:22:10.759148 (+  1115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.759526 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.759559 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.948823 (+189264us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.774055 (+825232us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:11.774119 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.774213 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.774271 (+    58us) raft_consensus.cc:1685] finished
0709 12:22:11.774288 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.774537 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1787,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":3222,"thread_start_us":824755,"threads_started":1,"wal-append.queue_time_us":802053}
I20260709 12:22:11.763700   593 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:11.783201   593 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.785458   593 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.550804   553 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:11.786108   553 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.659322   668 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:11.404162   672 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:11.788473   647 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:11.788782   672 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:11.741123   632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.010s
I20260709 12:22:11.738384   601 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:11.764014   487 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.599743   604 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.495137 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:11.779693 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.545349   662 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:11.711402   519 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:11.737886   611 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.711926   571 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.545564   621 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:11.793756   632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.002s	sys 0.010s
I20260709 12:22:11.789954   518 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.800299   689 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.762112   538 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.780920   648 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:11.802139   679 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
I20260709 12:22:11.791870   592 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.787899   668 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.803020   672 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.803263   691 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.803452   684 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.830765   684 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:11.794955   553 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.789108   647 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.790269   666 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.762701   548 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.811754   662 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.770999   563 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.755780   698 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.833084   684 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.843071   684 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.848384   668 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.831763   679 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:11.880456 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:11.881850 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.883651 31566 raft_consensus.cc:2410] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:22:11.884047 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.800122 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.797109 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:11.590571 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.772898 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:11.795686 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:11.806977 31574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.015s	sys 0.006s
I20260709 12:22:11.471241 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2142) took 1757 ms. Trace:
W20260709 12:22:11.887596 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115107us
W20260709 12:22:11.888530 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 116376us
I20260709 12:22:11.889842   611 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:11.776841   503 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.818615   621 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.892313   568 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.893148   548 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.919526   568 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:11.893715 31565 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:11.894019   553 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.923790   568 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.895911   592 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:11.896463 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:11.897495 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 216) took 1135 ms. Trace:
I20260709 12:22:11.925298   679 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.807595   519 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:11.926406 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.926987 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:11.927637 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 130496us
I20260709 12:22:11.928098 31567 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.928575   519 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:11.898427   662 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.901957   538 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:11.902334 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.884750 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.905972   689 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.906775 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:11.806414   601 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.909578 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:11.923506   553 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.895524   648 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.929436 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:11.925513 31572 rpcz_store.cc:276] 0709 12:22:10.762309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.762794 (+   485us) service_pool.cc:224] Handling call
0709 12:22:10.770050 (+  7256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.770448 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.770490 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.773153 (+  2663us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.659696 (+886543us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18002316a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:22:11.769559 (+109863us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:11.769621 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.769804 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:11.808055 (+ 38251us) raft_consensus.cc:1685] finished
0709 12:22:11.808083 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.897188 (+ 89105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1512,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":28398,"spinlock_wait_cycles":3885312,"thread_start_us":102743,"threads_started":1,"wal-append.queue_time_us":997623}
I20260709 12:22:11.950858 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:11.942243 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.943964   503 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.950595   577 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:12.001787 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 228820us
I20260709 12:22:12.003274 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:12.008459 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:11.955435   647 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.956192   568 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:11.958107 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2137) took 2391 ms (client timeout 1738 ms). Trace:
I20260709 12:22:11.956815 31415 rpcz_store.cc:276] 0709 12:22:09.710183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.712765 (+  2582us) service_pool.cc:224] Handling call
0709 12:22:10.415559 (+702794us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:10.415847 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.416042 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:10.649441 (+233399us) log.cc:844] Serialized 14 byte log entry
0709 12:22:11.349083 (+699642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.353727 (+  4644us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:11.358847 (+  5120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.384078 (+ 25231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:11.467065 (+ 82987us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1600,"prepare.queue_time_us":296828,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1629,"raft.queue_time_us":14867,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2569,"spinlock_wait_cycles":34284800,"thread_start_us":909693,"threads_started":2,"wal-append.queue_time_us":468636}
I20260709 12:22:11.960328 31496 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:11.961495 31494 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
W20260709 12:22:11.962067 31574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.015s	sys 0.006s
I20260709 12:22:11.962829 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:11.963454 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:11.964834   611 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:11.925299 31573 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.921418   621 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:11.979790 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50634.8us
I20260709 12:22:11.970587   601 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.984146   548 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:11.987154   668 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.988746 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 211) took 1318 ms. Trace:
I20260709 12:22:11.991856 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2051) took 3594 ms. Trace:
I20260709 12:22:11.993853 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:11.975174   679 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.982395   553 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:12.025251 31421 rpcz_store.cc:269] 0709 12:22:09.566219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.567139 (+   920us) service_pool.cc:224] Handling call
0709 12:22:11.957478 (+2390339us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54003539d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:11.957811 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022956928}
I20260709 12:22:12.039063   548 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.040025 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:11.854508   698 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:11.972246 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.032142 31570 rpcz_store.cc:276] 0709 12:22:08.397053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.636714 (+239661us) service_pool.cc:224] Handling call
0709 12:22:08.636885 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.117389 (+2480504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.991127 (+873738us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54002616d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:11.991536 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5635660160}
I20260709 12:22:12.035240   656 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.037360 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.016703 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d385c04853e749af8fb00afe40a4a255 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:22:12.040916 31424 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.031733 31571 rpcz_store.cc:276] 0709 12:22:10.670424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.670981 (+   557us) service_pool.cc:224] Handling call
0709 12:22:11.988169 (+1317188us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002508d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:11.988447 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346000640}
I20260709 12:22:12.041050   496 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.052289 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d385c04853e749af8fb00afe40a4a255 on tablet d385c04853e749af8fb00afe40a4a255 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:12.053383 31568 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.052836   521 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.053743   611 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.055253 31415 raft_consensus.cc:2376] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3. Re-sending same reply.
W20260709 12:22:12.056228 31415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 196) took 1403 ms (client timeout 1867 ms). Trace:
W20260709 12:22:12.056809 31415 rpcz_store.cc:269] 0709 12:22:10.652768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.036731 (+1383963us) service_pool.cc:224] Handling call
0709 12:22:12.056116 (+ 19385us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:12.059280 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 51019.8us
I20260709 12:22:12.058951   679 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.060628   680 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.061100   680 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:12.061165 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:12.061585   680 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.061856   679 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:12.054317   521 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:12.059453 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96383.3us
I20260709 12:22:12.065526   559 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.066728 31421 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:12.066761   563 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.067626 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 199) took 1400 ms. Trace:
I20260709 12:22:12.068070 31421 rpcz_store.cc:276] 0709 12:22:10.667765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.039547 (+1371782us) service_pool.cc:224] Handling call
0709 12:22:12.067570 (+ 28023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.077906 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 450) took 1121 ms. Trace:
I20260709 12:22:12.078439 32106 rpcz_store.cc:276] 0709 12:22:10.956851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.960643 (+  3792us) service_pool.cc:224] Handling call
0709 12:22:11.993352 (+1032709us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:12.077753 (+ 84401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3061632}
I20260709 12:22:12.083107   586 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.083554   548 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.052358   656 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:12.065479 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.514s (SENT) [suppressed 72 similar messages]
I20260709 12:22:12.087395 31573 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:12.100767   665 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.101855   665 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:12.082140 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.102633 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:12.052354   568 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:12.083559   586 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.062359   698 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:12.112841 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.114830   698 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.109202 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.111744   586 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.131006 31318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 297) took 5026 ms. Trace:
I20260709 12:22:12.132969 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2141) took 2497 ms. Trace:
I20260709 12:22:12.133665   494 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:12.134613 31419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2139) took 2529 ms (client timeout 2142 ms). Trace:
I20260709 12:22:12.136092 31422 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.114574   568 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.142122 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:12.141209 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:12.143221 31419 rpcz_store.cc:269] 0709 12:22:09.606219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.606368 (+   149us) service_pool.cc:224] Handling call
0709 12:22:12.134270 (+2527902us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54003ec954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:12.134440 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699927936}
W20260709 12:22:12.147070 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44608.5us
W20260709 12:22:12.145056 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79782.8us
I20260709 12:22:12.149938   698 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.149534   494 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.157104   713 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.157600   713 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.158071 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:12.163825 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51989.4us
I20260709 12:22:12.168488   716 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.159977   713 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.169252   716 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.167979   720 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.167160   679 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:12.171397 31419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 194) took 1523 ms (client timeout 1999 ms). Trace:
I20260709 12:22:12.172384   616 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.172813   647 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.173266 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.151362 31415 raft_consensus.cc:2376] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2. Re-sending same reply.
W20260709 12:22:12.180102 31419 rpcz_store.cc:269] 0709 12:22:10.648147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.150479 (+1502332us) service_pool.cc:224] Handling call
0709 12:22:12.171325 (+ 20846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.177716   720 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:12.184093 31415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 192) took 1586 ms (client timeout 2018 ms). Trace:
I20260709 12:22:12.142868 31418 rpcz_store.cc:276] 0709 12:22:09.643021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.711038 (+ 68017us) service_pool.cc:224] Handling call
0709 12:22:10.724820 (+1013782us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:10.724971 (+   151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.043937 (+318966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.132434 (+1088497us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400148554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:12.132759 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605017728}
I20260709 12:22:12.187188 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1187) took 1228 ms. Trace:
I20260709 12:22:12.184221   647 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.187858   616 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.188575   647 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.179049   665 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.187986 31423 rpcz_store.cc:276] 0709 12:22:10.955459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.172789 (+1217330us) service_pool.cc:224] Handling call
0709 12:22:12.184286 (+ 11497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.200986   494 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:12.187119 31415 rpcz_store.cc:269] 0709 12:22:10.598023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.057900 (+1459877us) service_pool.cc:224] Handling call
0709 12:22:12.184005 (+126105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.209336   684 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.212037   684 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.213801   559 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.225558 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.225764 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:12.141714 31318 rpcz_store.cc:276] 0709 12:22:07.100773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.100904 (+   131us) service_pool.cc:224] Handling call
0709 12:22:12.125974 (+5025070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:09.357495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:09.384752 (+ 27257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:09.384797 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:22:09.384817 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:09.385187 (+   370us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:09.385245 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:09.385277 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:09.385459 (+   182us) tablet.cc:701] Row locks acquired
0709 12:22:09.385476 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:22:09.385620 (+   144us) write_op.cc:270] Start()
0709 12:22:09.385725 (+   105us) write_op.cc:276] Timestamp: P: 1783599729385579 usec, L: 0
0709 12:22:09.385744 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:22:09.623526 (+237782us) log.cc:844] Serialized 539 byte log entry
0709 12:22:10.600627 (+977101us) op_driver.cc:464] REPLICATION: finished
0709 12:22:10.621553 (+ 20926us) write_op.cc:301] APPLY: starting
0709 12:22:10.621635 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:10.621726 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:10.621881 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:10.622066 (+   185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:10.622232 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:10.622285 (+    53us) write_op.cc:312] APPLY: finished
0709 12:22:10.622475 (+   190us) log.cc:844] Serialized 23 byte log entry
0709 12:22:10.622739 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.622895 (+   156us) write_op.cc:454] Released schema lock
0709 12:22:10.622938 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:10.748740 (+125802us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11975ee28 00007fc11d199581 00007fc11d198d58 00007fc11d19d9f1 00007fc11d19d9a9 00007fc11d19d939 00007fc11d19d901 00007fc11d19cb2d 0000000000388634 0000000000388479
0709 12:22:10.748950 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.748979 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1304053,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":20614,"apply.run_cpu_time_us":1784,"apply.run_wall_time_us":1784,"num_ops":1,"prepare.queue_time_us":49406,"prepare.run_cpu_time_us":8122,"prepare.run_wall_time_us":1391443,"replication_time_us":1214686,"spinlock_wait_cycles":453952768,"thread_start_us":36082,"threads_started":2}]]}
I20260709 12:22:12.230718 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1188) took 1268 ms. Trace:
W20260709 12:22:12.230981 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.231761 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.232707 31423 raft_consensus.cc:2376] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2. Re-sending same reply.
I20260709 12:22:12.233305 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 197) took 1575 ms. Trace:
I20260709 12:22:12.233664 31423 rpcz_store.cc:276] 0709 12:22:10.658192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.201239 (+1543047us) service_pool.cc:224] Handling call
0709 12:22:12.233232 (+ 31993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.239416 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.248930   616 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.239832 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.251835 31567 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:12.251513 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1189) took 1293 ms. Trace:
I20260709 12:22:12.253623 31418 rpcz_store.cc:276] 0709 12:22:10.958550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.187682 (+1229132us) service_pool.cc:224] Handling call
0709 12:22:12.251435 (+ 63753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.231132 31419 rpcz_store.cc:276] 0709 12:22:10.957655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.200881 (+1243226us) service_pool.cc:224] Handling call
0709 12:22:12.226454 (+ 25573us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:12.241931 31389 leader_election.cc:336] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.060s (SENT)
I20260709 12:22:12.256171 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:12.259913   593 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:12.260402   593 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.260784   593 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.254951 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.254734 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.273761 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.273957 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.278395 31418 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.254863   528 tablet_copy_client.cc:538] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:12.255815   720 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.280316 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.279047 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1196) took 1300 ms. Trace:
I20260709 12:22:12.285378 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.286423 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.287240 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2150) took 1629 ms. Trace:
I20260709 12:22:12.287585 31415 rpcz_store.cc:276] 0709 12:22:10.657617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.241885 (+1584268us) service_pool.cc:224] Handling call
0709 12:22:12.287180 (+ 45295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.288442 31418 rpcz_store.cc:276] 0709 12:22:10.978871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.254522 (+1275651us) service_pool.cc:224] Handling call
0709 12:22:12.278984 (+ 24462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.288694 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.291266 31497 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
W20260709 12:22:12.291522 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55768.8us
I20260709 12:22:12.292404   668 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.292923 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.293175   668 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.294220 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.294958 31492 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:12.295316   635 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.295936   668 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.267480   616 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.299525 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.299443   616 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.300444 31418 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.300963 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1193) took 1335 ms. Trace:
I20260709 12:22:12.301276 31418 rpcz_store.cc:276] 0709 12:22:10.966053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.296430 (+1330377us) service_pool.cc:224] Handling call
0709 12:22:12.300908 (+  4478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.301976   616 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.302908   627 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.303299 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:12.308137   604 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.308832   604 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.310827   630 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.311343   604 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.312378 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.313395 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1102) took 1058 ms. Trace:
I20260709 12:22:12.313849 31499 rpcz_store.cc:276] 0709 12:22:11.254544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.263998 (+  9454us) service_pool.cc:224] Handling call
0709 12:22:12.312057 (+1048059us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:12.313316 (+  1259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3826560}
I20260709 12:22:12.314313 31415 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:12.319546 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.302409 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.336915 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.276095   559 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.327538   684 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:12.342907 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67572.8us
I20260709 12:22:12.343788 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:12.344007 31420 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2136) took 2790 ms (client timeout 2040 ms). Trace:
W20260709 12:22:12.344460 31420 rpcz_store.cc:269] 0709 12:22:09.553279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.553398 (+   119us) service_pool.cc:224] Handling call
0709 12:22:12.343681 (+2790283us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54003edd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:12.343824 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4039422720}
I20260709 12:22:12.345749 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.346480 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.347896 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.348171 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1099) took 1099 ms. Trace:
I20260709 12:22:12.348636 31493 rpcz_store.cc:276] 0709 12:22:11.248817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.249256 (+   439us) service_pool.cc:224] Handling call
0709 12:22:11.632778 (+383522us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:11.633003 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.930411 (+297408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.930503 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:11.930579 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:11.930636 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.347770 (+417134us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400012554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:12.347815 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.347978 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638928640}
I20260709 12:22:12.350380   480 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.351204   480 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.352430   630 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.352877   630 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:12.346448 31420 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.357040 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1195) took 1381 ms. Trace:
I20260709 12:22:12.357349 31420 rpcz_store.cc:276] 0709 12:22:10.976056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.345377 (+1369321us) service_pool.cc:224] Handling call
0709 12:22:12.356988 (+ 11611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.359958   711 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.360488   711 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.360957   711 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.302173   680 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.362306 31418 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:12.363835 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1186) took 1409 ms. Trace:
I20260709 12:22:12.364079 31418 rpcz_store.cc:276] 0709 12:22:10.954660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.302015 (+1347355us) service_pool.cc:224] Handling call
0709 12:22:12.363781 (+ 61766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.367439 31423 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.369660 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1190) took 1409 ms. Trace:
I20260709 12:22:12.369911 31423 rpcz_store.cc:276] 0709 12:22:10.960761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.255446 (+1294685us) service_pool.cc:224] Handling call
0709 12:22:12.369620 (+114174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.371953 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:12.372342   656 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.371003 31419 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:12.374809 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1191) took 1413 ms. Trace:
I20260709 12:22:12.375146 31419 rpcz_store.cc:276] 0709 12:22:10.961863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.262309 (+1300446us) service_pool.cc:224] Handling call
0709 12:22:12.374755 (+112446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.356251 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2151) took 1619 ms. Trace:
W20260709 12:22:12.395768 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.295964   635 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.398372 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.362066   496 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.401273   496 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:12.402459 31389 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.531s (SENT)
I20260709 12:22:12.356058   586 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.403825 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.404659 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 187) took 1849 ms. Trace:
I20260709 12:22:12.405063 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.405514 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:12.408524 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 185) took 1854 ms. Trace:
I20260709 12:22:12.408614 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.409373 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.362010   559 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.393487 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:12.406216 31420 rpcz_store.cc:276] 0709 12:22:10.554879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.365986 (+1811107us) service_pool.cc:224] Handling call
0709 12:22:12.404593 (+ 38607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.409044 31422 rpcz_store.cc:276] 0709 12:22:10.554205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.554338 (+   133us) service_pool.cc:224] Handling call
0709 12:22:12.135585 (+1581247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.151010 (+ 15425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.408320 (+257310us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003ec950. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:12.408447 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3635559296}
I20260709 12:22:12.354441   713 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.414788 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:12.415386 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.415622 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.416378 31420 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:12.417418 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.396395 31415 rpcz_store.cc:276] 0709 12:22:10.737000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.288372 (+1551372us) service_pool.cc:224] Handling call
0709 12:22:12.342336 (+ 53964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.420650 31423 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
W20260709 12:22:12.421293 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79996.3us
I20260709 12:22:12.365731   630 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.408527   635 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.406246   716 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.426159 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.430154 31420 raft_consensus.cc:2376] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5. Re-sending same reply.
I20260709 12:22:12.425647   494 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.434391   494 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.434733 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:12.427248 31499 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.435402   559 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.424579 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.434849   494 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.433619 31419 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:12.431535   656 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:12.442512 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.427532   592 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.441215 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.444655 31423 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:12.447003   592 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.449499   592 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:12.455345 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:12.458117 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.460074   496 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:12.461637 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62238.2us
I20260709 12:22:12.446516   630 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.472801 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.475662   581 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.479410 31422 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:12.480479 31319 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 296) took 5880 ms. Trace:
I20260709 12:22:12.112515 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.481006 31422 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:12.482134 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:12.484030   726 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:12.474053 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.490502 31419 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:12.490803 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 190) took 1933 ms. Trace:
I20260709 12:22:12.491796 31422 rpcz_store.cc:276] 0709 12:22:10.555712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.480283 (+1924571us) service_pool.cc:224] Handling call
0709 12:22:12.480645 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.488465 (+  7820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.488667 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.441674   593 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.493701 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 186) took 1937 ms. Trace:
I20260709 12:22:12.494643 31419 rpcz_store.cc:276] 0709 12:22:10.554572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.443576 (+1889004us) service_pool.cc:224] Handling call
0709 12:22:12.488760 (+ 45184us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:12.489031 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.491727 (+  2696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.491987 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15168896}
I20260709 12:22:12.496628   665 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.499941 31419 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:12.500067   665 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.500638 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 193) took 1853 ms. Trace:
I20260709 12:22:12.501039 31419 rpcz_store.cc:276] 0709 12:22:10.647545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.499291 (+1851746us) service_pool.cc:224] Handling call
0709 12:22:12.499646 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.500381 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.500570 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.502323 31419 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:22:12.502518 31500 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:12.497646 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.498303 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.507484 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 195) took 1852 ms. Trace:
I20260709 12:22:12.507860 31419 rpcz_store.cc:276] 0709 12:22:10.651953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.501732 (+1849779us) service_pool.cc:224] Handling call
0709 12:22:12.502088 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.502623 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.504071 (+  1448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.486200   647 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.495222 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.497332 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.494180   680 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:12.519500 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.521953 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.522953   713 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.524080   528 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:22:12.525213   586 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.525589 31415 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:12.526942 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.527281 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.527645 31495 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.527659 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.528656 32106 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:12.528720 32111 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:12.529892 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:12.531378   693 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:12.531976   693 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.534889   693 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.507325   665 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.530587 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:12.538017   494 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.541489 32110 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.541904 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.543080 31497 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:12.545368 32114 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:12.544222 32113 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:22:12.541441 31424 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1192) took 1578 ms (client timeout 1556 ms). Trace:
I20260709 12:22:12.539500 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:12.556907 31424 rpcz_store.cc:269] 0709 12:22:10.962621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.265277 (+302656us) service_pool.cc:224] Handling call
0709 12:22:11.962215 (+696938us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:12.541223 (+579008us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400448ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:12.541356 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36310784}
I20260709 12:22:12.538931 31499 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:12.546173 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.568248 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.543862 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.540617   593 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:12.544380 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.576006 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1073) took 1113 ms. Trace:
I20260709 12:22:12.565217 32108 raft_consensus.cc:2368] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:12.583735 31566 rpcz_store.cc:276] 0709 12:22:11.462404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.744226 (+281822us) service_pool.cc:224] Handling call
0709 12:22:12.563590 (+819364us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b54001ccd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:12.575944 (+ 12354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174389632}
I20260709 12:22:12.585001 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.591323 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:12.592038 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.599443 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.565240 31494 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:12.604633 31422 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.602487 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:12.603307 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:12.607647 31421 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:12.608210 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.545383   711 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:12.613718 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1194) took 1639 ms (client timeout 1654 ms). Trace:
I20260709 12:22:12.613833 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 202) took 1640 ms. Trace:
I20260709 12:22:12.614110 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 191) took 2025 ms. Trace:
I20260709 12:22:12.614650 31422 rpcz_store.cc:276] 0709 12:22:10.587518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.504144 (+1916626us) service_pool.cc:224] Handling call
0709 12:22:12.551402 (+ 47258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.607655 (+ 56253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.607823 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:12.614148 31421 rpcz_store.cc:269] 0709 12:22:10.968788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.068814 (+1100026us) service_pool.cc:224] Handling call
0709 12:22:12.579388 (+510574us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:12.608109 (+ 28721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6857088}
I20260709 12:22:12.614208 31424 rpcz_store.cc:276] 0709 12:22:10.973294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.581384 (+1608090us) service_pool.cc:224] Handling call
0709 12:22:12.607419 (+ 26035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.613521 (+  6102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.613547 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.613593 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.613621 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.613686 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.613784 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.614372 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:12.618005 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 87605.3us
I20260709 12:22:12.619345 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.599359 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.629081 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.487434 31319 rpcz_store.cc:276] 0709 12:22:06.600071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.600251 (+   180us) service_pool.cc:224] Handling call
0709 12:22:12.480280 (+5880029us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:07.419060 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:07.471151 (+ 52091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:07.471190 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:22:07.471206 (+    16us) tablet.cc:662] Decoding operations
0709 12:22:07.507120 (+ 35914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:07.507198 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:07.507238 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:22:07.507958 (+   720us) tablet.cc:701] Row locks acquired
0709 12:22:07.507985 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:22:07.508175 (+   190us) write_op.cc:270] Start()
0709 12:22:07.508310 (+   135us) write_op.cc:276] Timestamp: P: 1783599727508120 usec, L: 0
0709 12:22:07.508340 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:22:07.509213 (+   873us) log.cc:844] Serialized 2129 byte log entry
0709 12:22:08.366132 (+856919us) op_driver.cc:464] REPLICATION: finished
0709 12:22:09.396389 (+1030257us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc11d199ef0
0709 12:22:09.581136 (+184747us) write_op.cc:301] APPLY: starting
0709 12:22:09.581232 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:09.592927 (+ 11695us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:09.594062 (+  1135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:09.617179 (+ 23117us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:09.617393 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:22:09.617452 (+    59us) write_op.cc:312] APPLY: finished
0709 12:22:09.617714 (+   262us) log.cc:844] Serialized 47 byte log entry
0709 12:22:09.992163 (+374449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.010903 (+ 18740us) write_op.cc:454] Released schema lock
0709 12:22:10.013645 (+  2742us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:10.026296 (+ 12651us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:10.026326 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":177775,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":1214693,"apply.run_cpu_time_us":86112,"apply.run_wall_time_us":445133,"num_ops":5,"prepare.queue_time_us":200206,"prepare.run_cpu_time_us":23012,"prepare.run_wall_time_us":173872,"raft.queue_time_us":699103,"raft.run_cpu_time_us":60301,"raft.run_wall_time_us":1252789,"replication_time_us":840697,"spinlock_wait_cycles":20150656,"thread_start_us":2220955,"threads_started":6,"wal-append.queue_time_us":676103,"wal-append.run_cpu_time_us":59366,"wal-append.run_wall_time_us":3001957}]]}
I20260709 12:22:12.632051   664 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:22:12.632931   664 consensus_queue.cc:1243] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:12.617566   680 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:12.634634 31421 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:12.633486   664 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:12.638531 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:12.634225 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:12.642050 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.642153   592 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:12.642086   586 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:22:12.645203   501 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:12.645342   592 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:12.645857   592 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:12.646414   501 tablet_bootstrap.cc:492] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:22:12.647323   501 ts_tablet_manager.cc:1403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 1.922s	user 0.052s	sys 0.039s
I20260709 12:22:12.638123 31572 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.651875 31568 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:12.655380 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:12.656641 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.658063 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:12.659238 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.660181 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:12.661388   519 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.661613 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.667161 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:12.673143 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50072.8us
I20260709 12:22:12.640920   664 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:12.651244   680 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:12.675261 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.647092   592 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.650339 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 188) took 2082 ms. Trace:
I20260709 12:22:12.647929 31492 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.669273   559 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.687286 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.672996   503 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:12.691707 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.671310   496 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.691021 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:12.694895 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 168635us
I20260709 12:22:12.673276 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2153) took 1714 ms. Trace:
I20260709 12:22:12.695462   559 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.698254   665 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:12.709060   665 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:12.709439   664 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.710968   664 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.711143 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.715567   711 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:12.718360   680 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.724653 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.725986 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.727028 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.727345 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.728295 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.728582 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.729568 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.731029 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.683795   647 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.700024 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.734308 31500 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:12.737684 31421 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:12.742261 31422 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:12.747682 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.748978 31421 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:22:12.753615   728 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:12.753242   662 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.757319   662 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:12.759008 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:12.702850   509 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.759796 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.760000   509 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:12.760581   509 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.706852   673 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.708027 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.707556   592 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.767041 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.707986   559 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.763815 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.698465   503 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:12.763361 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 200) took 1802 ms. Trace:
I20260709 12:22:12.769250 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.774874 31422 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:12.773669 31423 rpcz_store.cc:276] 0709 12:22:10.960578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.537288 (+1576710us) service_pool.cc:224] Handling call
0709 12:22:12.537710 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.538183 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.538209 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.548118 (+  9909us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.650514 (+102396us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:12.650552 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.650647 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.761441 (+110794us) raft_consensus.cc:1685] finished
0709 12:22:12.761460 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.763299 (+  1839us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1018,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":221,"thread_start_us":48046,"threads_started":1,"wal-append.queue_time_us":166533}
I20260709 12:22:12.775728 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.773669   503 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.777244 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.769371 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.775796 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.781736 31421 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:22:12.782722 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:12.782796 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46082.2us
I20260709 12:22:12.784895 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:12.786228 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45568.5us
I20260709 12:22:12.710556   665 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.787369 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.792238 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.793058 31422 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:12.779433 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.795825 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.796422 31423 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:12.800660   684 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.801115   684 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.699158 31415 rpcz_store.cc:276] 0709 12:22:10.956855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.549985 (+1593130us) service_pool.cc:224] Handling call
0709 12:22:12.607279 (+ 57294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.633725 (+ 26446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.637382 (+  3657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.641194 (+  3812us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:12.650872 (+  9678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.662746 (+ 11874us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.671460 (+  8714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.804965 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.804544 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.806613 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.808068 31423 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:12.688243 31416 rpcz_store.cc:276] 0709 12:22:10.555156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.471359 (+1916203us) service_pool.cc:224] Handling call
0709 12:22:12.547569 (+ 76210us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:12.558000 (+ 10431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.612723 (+ 54723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.613756 (+  1033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.619364 (+  5608us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.621436 (+  2072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.626877 (+  5441us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.637287 (+ 10410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5638912}
I20260709 12:22:12.795231 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:12.804848   684 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.818630 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:12.829397 31496 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:12.830860 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.831449   604 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.831830   604 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:12.832195   604 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.838410 31423 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:12.806924   647 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:12.840742 31421 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:12.845882 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.851900 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 198) took 2188 ms. Trace:
I20260709 12:22:12.852500   566 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:12.854815 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.850970 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58240us
W20260709 12:22:12.859150 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.859583 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.852711 31419 rpcz_store.cc:276] 0709 12:22:10.660552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.508413 (+1847861us) service_pool.cc:224] Handling call
0709 12:22:12.576397 (+ 67984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.612824 (+ 36427us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:12.761936 (+149112us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.848273 (+ 86337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.848324 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.848369 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.848431 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.848530 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162904,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":6872,"thread_start_us":185192,"threads_started":2}
I20260709 12:22:12.842815   647 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:12.853753   668 raft_consensus.cc:2764] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:12.847579   509 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.863516 31423 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:12.865928   647 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.878386 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.889528   668 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.890034   668 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.890389   668 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:12.892359   732 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:12.888409 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.897043 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 201) took 1928 ms. Trace:
I20260709 12:22:12.897424 31417 rpcz_store.cc:276] 0709 12:22:10.968666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.539097 (+1570431us) service_pool.cc:224] Handling call
0709 12:22:12.539513 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.539724 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.539750 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.540300 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.620947 (+ 80647us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:12.621632 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.626925 (+  5293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.893799 (+266874us) raft_consensus.cc:1685] finished
0709 12:22:12.896712 (+  2913us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.896871 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":64124,"threads_started":1,"wal-append.queue_time_us":134782}
I20260709 12:22:12.906013   673 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.908936 31418 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:12.913964   674 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.914384   674 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.914912   674 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.918229 31572 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:12.920751   604 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.924117   630 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:12.932133   509 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:12.936064 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67450.7us
I20260709 12:22:12.935875 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2155) took 1051 ms. Trace:
I20260709 12:22:12.901980 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2157) took 1015 ms. Trace:
W20260709 12:22:12.942725 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54399.5us
I20260709 12:22:12.949065 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.943481 31416 rpcz_store.cc:276] 0709 12:22:11.885206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.824380 (+939174us) service_pool.cc:224] Handling call
0709 12:22:12.855242 (+ 30862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.869443 (+ 14201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.871525 (+  2082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.880813 (+  9288us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:12.882594 (+  1781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.887450 (+  4856us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.900726 (+ 13276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.944547   676 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:22:12.954064   676 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.954455   676 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:12.955017 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.955698 31573 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:12.955368   676 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:12.956434   662 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:12.956707   676 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.950115 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.957199 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.958096 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:12.958313   586 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.958818 31574 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.958981   586 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.943648 31415 rpcz_store.cc:276] 0709 12:22:11.884181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.824278 (+940097us) service_pool.cc:224] Handling call
0709 12:22:12.865879 (+ 41601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.876018 (+ 10139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.879282 (+  3264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:12.883819 (+  4537us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:12.893943 (+ 10124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.901873 (+  7930us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.934279 (+ 32406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:12.959532   586 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.961668   665 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.962107   665 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:12.962448   665 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.963406 31567 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:12.967864 31574 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:12.935863   604 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:12.970496 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:12.978832 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:12.980576 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.981379 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.984491 31569 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:12.986284 32112 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.942060   581 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:12.942179   501 raft_consensus.cc:359] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:12.990250 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:12.980581   673 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:12.995594 31568 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:12.968003   647 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:12.986985   509 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:13.001909 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.004973   658 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:13.006209   658 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.006850   658 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:13.007808   658 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.008083   669 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:22:13.008944   669 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:13.001518 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.009356   669 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:13.010311   669 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.011678   669 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.992671   501 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:22:12.992141   673 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:13.021713 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.023667   714 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:13.031262 32110 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:13.028371 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:13.039561   711 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:13.041323   711 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:13.041106 31318 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:13.043440   720 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:13.043859 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:13.044226   713 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:13.044589 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2156) took 1160 ms. Trace:
I20260709 12:22:13.044896   720 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:13.045074 31418 rpcz_store.cc:276] 0709 12:22:11.884679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.368196 (+483517us) service_pool.cc:224] Handling call
0709 12:22:13.044343 (+676147us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400148054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:13.044527 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133004032}
I20260709 12:22:13.045846   694 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:13.046216   694 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:13.046247   545 tablet_copy_client.cc:538] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:13.047323   694 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.048609   694 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:13.050228 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.045431   713 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.998971 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.051282 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:13.060083 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.056845   593 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.063253   581 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:13.064391   494 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.058940   559 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.071175   559 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.071900 31497 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:13.072300 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.073618 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.073756 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.074399 31499 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:13.074632 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.074908 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.075469 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.077960   647 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.078513   503 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.079670   496 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.065307   658 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.080616   503 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.081588 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.057412   680 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.045296   720 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:13.027626   673 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.086206   665 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.096899 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.104671 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:13.111025 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49704.1us
I20260709 12:22:13.114585 31565 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:13.105788   545 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:22:13.019546   684 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.100630   680 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:13.129799   680 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.133445 31573 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:13.134366   684 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:13.140082 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.142419 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.142861 32107 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.144289 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.144667 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.144894 31573 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:13.145740 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.146325 31567 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.147464 31493 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:13.148526 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.151337   586 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.151880 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.152379 31568 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.152348 31496 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:13.153664   586 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.153764 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.157271 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.098356   665 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.161322 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.168193 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.089640   720 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.177379 31573 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:13.172959   737 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:22:13.184947 31568 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
W20260709 12:22:13.173522 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46718.3us
W20260709 12:22:13.188115 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 96562.6us
I20260709 12:22:13.110811   501 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:13.206127 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.207314   586 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:13.114495   674 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.216758 31496 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:22:13.216553   664 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.002s
W20260709 12:22:13.210660   740 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:22:13.237535 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.213197   657 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.243070 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.243786 31568 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:13.227638   669 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.217310 31567 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:13.248471 31573 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:13.247561 31495 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:13.241389 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.259306 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:13.266981 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.236342   586 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.274573 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.271418   503 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:13.277393 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.277261 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.277580 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.277791 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.278141 31421 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.278218 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.278813 31418 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.280931 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.281479 31422 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.287285 31418 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:13.289119 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:13.289801 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.294343 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.295102 32110 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:13.295423   668 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.296165 31417 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:13.297399 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:13.291916   496 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.298128   665 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.298627   496 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:13.298722   665 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:13.297248 31565 raft_consensus.cc:2368] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3.
I20260709 12:22:13.299659   496 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.290827   503 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:13.299741   665 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.302325   503 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.304018   720 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.307258 31496 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:13.307761   501 ts_tablet_manager.cc:1434] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.660s	user 0.012s	sys 0.000s
W20260709 12:22:13.308082   501 ts_tablet_manager.cc:1467] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Tablet startup took 660ms
I20260709 12:22:13.244642   657 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.311682 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.312469 31572 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:13.312702 31424 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:13.314880 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:13.258986   713 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:13.317826 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:13.318485 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.319571   676 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.314002 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2167) took 1175 ms. Trace:
I20260709 12:22:13.320612   674 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:13.320358 31424 rpcz_store.cc:276] 0709 12:22:12.139160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.837491 (+698331us) service_pool.cc:224] Handling call
0709 12:22:12.837783 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.313041 (+475258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.313765 (+   724us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400148a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:13.313949 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091457280}
I20260709 12:22:13.297248 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:13.323331 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.252548   669 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.325304   669 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.330842   664 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:13.331981 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.332145 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.332639 31500 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.332784 31491 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 1.
I20260709 12:22:13.331501   664 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.333503 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:13.334192 31463 leader_election.cc:400] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:13.334483 31463 leader_election.cc:403] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:13.336207 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.335346 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.338423 31424 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.339255 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.341464 31565 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
W20260709 12:22:13.370128 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.369911 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:13.331503 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.310246 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.375010 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:13.381506 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.386406 31496 raft_consensus.cc:2368] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3.
I20260709 12:22:13.386446 31495 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:13.394991 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 60952.6us
I20260709 12:22:13.395658 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:13.387112 31493 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.409585 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.411296 31565 raft_consensus.cc:2368] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3.
I20260709 12:22:13.407251 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:13.414875 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:13.414739 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.361315   673 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:13.421617   713 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.422299   669 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.423204 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:13.424479 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:13.402827 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:13.388430   647 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:13.416529   662 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.434511 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:13.435339   676 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.435875 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:13.436986 32080 leader_election.cc:400] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3.
I20260709 12:22:13.437304 32080 leader_election.cc:403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:13.419217   693 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:13.486515 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.418284   668 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:13.490316 31421 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:13.493121   680 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.496850 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:13.499095 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.430864   713 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:13.500353 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.436088   694 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:13.503144 32110 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Advancing to term 3
I20260709 12:22:13.504827 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.508518 31422 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
W20260709 12:22:13.509588 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73775.6us
I20260709 12:22:13.514511 31423 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:13.493907   693 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:13.516382 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:13.507042 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:13.502758   586 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:13.522058 31424 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:13.494383   657 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.532292 31500 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:13.533690 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.509469   662 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.509436   713 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.512581   694 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:13.543517 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:13.544170 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.308389   501 ts_tablet_manager.cc:1469] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Trace:
0709 12:22:05.166647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.208503 (+ 41856us) service_pool.cc:224] Handling call
0709 12:22:05.373533 (+165030us) ts_tablet_manager.cc:934] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
0709 12:22:06.312831 (+939298us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:06.819504 (+506673us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:06.820790 (+  1286us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:07.071151 (+250361us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:07.071469 (+   318us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:07.071792 (+   323us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:07.071863 (+    71us) inbound_call.cc:177] Queueing success response
0709 12:22:10.724755 (+3652892us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:22:12.647724 (+1922969us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:22:12.701281 (+ 53557us) tablet_replica.cc:261] Starting instrumentation
0709 12:22:12.702048 (+   767us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":11730,"mutex_wait_us":6104,"raft.queue_time_us":13594,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2900,"tablet-copy.queue_time_us":163933,"tablet-download-pool.queue_time_us":30724,"tablet-download-pool.run_cpu_time_us":1879,"tablet-download-pool.run_wall_time_us":2923634,"thread_start_us":153678,"threads_started":2}
I20260709 12:22:13.525487   693 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.543007   581 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:13.532826   630 raft_consensus.cc:2764] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:13.562716 31565 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.544552   559 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:13.549998   694 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.569047   673 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.571120   664 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:13.571731 31417 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:13.525002   566 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:13.566707   581 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.587602 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:13.545444   586 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.591017 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:13.619680 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85923.2us
I20260709 12:22:13.567840 32105 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Advancing to term 2
I20260709 12:22:13.547410   657 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:22:13.568401   674 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.635214 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:13.646832 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 150052us
I20260709 12:22:13.624109   684 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.654728 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:13.660521 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:13.634075   581 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.670801 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.671012 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.636214   711 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:13.691383 31418 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:13.654369   770 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.654604   586 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:13.698061 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.676533   668 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.709424 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.694885   494 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:13.675577   754 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:22:13.700546   755 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:22:13.692625   684 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.737988 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.730142 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:13.710601 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:13.701206   770 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.718410   668 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.741906 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:13.821903 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.842303   765 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:22:13.814456 32106 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.818588   669 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.895855   684 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:13.896941   757 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:22:13.900096   680 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3.
I20260709 12:22:13.904464   581 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:13.797704   586 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:13.922613 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.961630   720 consensus_meta.cc:287] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.003s
I20260709 12:22:13.961833   694 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.962857   673 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:13.963399   673 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.964241   694 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:13.906437   668 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:13.876432   494 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.012446   693 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:13.914516 31493 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.018666   494 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:14.019759   772 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:22:14.026898   664 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:14.027496   664 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:14.099763 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 302040us
I20260709 12:22:14.121959 32107 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:14.134356 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:14.135073 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.135486 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.136844 31422 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:14.139099   528 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:14.140043   528 tablet_bootstrap.cc:492] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:22:14.140715   528 ts_tablet_manager.cc:1403] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 1.617s	user 0.038s	sys 0.055s
I20260709 12:22:14.141978   770 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.142573   770 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:14.143191   770 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:14.144151 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 167282us
I20260709 12:22:14.145839   668 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.146330   668 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:14.147023 31389 leader_election.cc:336] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.514s (SENT)
I20260709 12:22:14.147550 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.148367   657 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.148566   668 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.152271 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.153409 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.153995 31565 raft_consensus.cc:2410] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:14.154592 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.087631 32106 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:14.163626 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.157613   714 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:14.167770 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.171233 31389 leader_election.cc:336] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.661s (SENT)
I20260709 12:22:14.167270 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.174619 31565 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:14.175591 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:14.176160 31565 raft_consensus.cc:2376] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4. Re-sending same reply.
I20260709 12:22:14.163513   769 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.179633   769 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.155514   694 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:22:14.183355   713 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.002s
I20260709 12:22:14.183753   713 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.183809 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.185900   713 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.187280   693 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.189054 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.191077 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.171748 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.213919   664 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.214954 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:14.215610 31565 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4. Re-sending same reply.
I20260709 12:22:14.216463 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.217031 31565 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.217821 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.218369 31565 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.218936   581 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.221391 31565 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:22:14.221726   657 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:14.226768 31491 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.228761 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:14.231185 31415 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.004s
I20260709 12:22:14.231300 31566 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.231566 31415 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
W20260709 12:22:14.226769 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55568.8us
W20260709 12:22:14.242153 31389 leader_election.cc:336] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.715s (SENT)
I20260709 12:22:14.244451 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:14.253737 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 97608.5us
I20260709 12:22:14.254799 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.252637   657 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:14.261379   714 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:14.287603 32114 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.292044 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:14.291927 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.292383 32112 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.297173 31433 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-36ab0d648ab643bf8d74dbe6ee9503d8 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:22:14.297698 31433 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-36ab0d648ab643bf8d74dbe6ee9503d8 on tablet 36ab0d648ab643bf8d74dbe6ee9503d8 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.298290   770 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.299898 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.300879 31567 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.301064 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.303122 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.303725 31497 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.290503   774 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.307029   774 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.308596   528 raft_consensus.cc:359] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:14.309782   774 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:14.304190 31491 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.293669   776 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.316218 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.316843 31500 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.321779   776 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:14.322814   776 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.327173 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:14.328374 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.007s
W20260709 12:22:14.328696 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.007s	sys 0.007s
W20260709 12:22:14.328974 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 594601us
I20260709 12:22:14.334501 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.335007   714 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.335680 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.336908 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.338011 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.338791 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.339404 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.343952 31567 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:14.344792 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.345853 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:14.309803   528 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:22:14.348985 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.349354 31497 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:14.349735 31415 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 2: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:14.350467 31416 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:14.349759 31423 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:14.326501 31500 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.358832 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.359256 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.359839 31570 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:14.360133 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:14.360602 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.360891   503 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.361423   503 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.361652 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:14.362929 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.363793   496 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:14.364403   545 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:14.366088 31415 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.366910 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.367712 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.367918 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.368163 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:14.368781 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:14.369004 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.369364 31570 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.369390   770 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.369966   770 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.372442   770 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:14.374047   545 tablet_bootstrap.cc:492] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:22:14.374974   528 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:14.387282 31389 leader_election.cc:336] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.523s (SENT)
I20260709 12:22:14.387890 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.388787   658 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:14.391562 31465 leader_election.cc:336] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.510s (SENT)
W20260709 12:22:14.392675 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51752us
I20260709 12:22:14.402482   528 ts_tablet_manager.cc:1434] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.261s	user 0.004s	sys 0.006s
I20260709 12:22:14.375768   545 ts_tablet_manager.cc:1403] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 1.272s	user 0.044s	sys 0.017s
I20260709 12:22:14.410553 31570 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.377200   665 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.411737 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.413400 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:14.422463 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.423224 31497 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.431649 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.423727   665 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.440996 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.441263   668 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:14.432964   789 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:14.441985 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.460978 31571 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:14.461282 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.362355   503 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:14.426110 31491 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:14.426275   720 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.416199   680 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:22:14.425998   784 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.445693 31568 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:14.465021 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.472908 31568 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:14.473155 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.474272 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-9dd7b78d2ef1488c970505878e67c6ca received from {username='slave'} at 127.0.0.1:48102
I20260709 12:22:14.474758 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-9dd7b78d2ef1488c970505878e67c6ca on tablet 9dd7b78d2ef1488c970505878e67c6ca with peer e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:14.477860   794 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.194s	user 0.002s	sys 0.001s
I20260709 12:22:14.447436 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.395399   559 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:22:14.410830   778 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:22:14.409991 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.391369   509 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:22:14.470019 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.484598 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.495522 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.496354 31573 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.463304 31415 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:14.500489 31389 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.140s (SENT)
I20260709 12:22:14.501188 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.503548 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.507300 31570 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.504386 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.511577 31568 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:14.514526 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:14.514606 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 101915us
W20260709 12:22:14.514147 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 50209.7us
I20260709 12:22:14.494181 31567 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:14.530468 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.531598 31572 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:14.520146 31573 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:14.517896 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.533164 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:14.513775   784 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:14.535537 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:14.534467 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54381.8us
I20260709 12:22:14.540271 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.504791   778 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.520279   720 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:14.546039 31465 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.667s (SENT)
W20260709 12:22:14.546181 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 50071.7us
I20260709 12:22:14.539433 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.551391 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.520627   779 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:14.491225   545 raft_consensus.cc:359] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:14.554569 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.552312   673 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.550115   778 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:14.547260   494 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.562768 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:14.557535 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.568961 32106 raft_consensus.cc:1217] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:14.569454   762 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:14.571141   669 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.571589   450 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:22:14.574832   625 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:14.578879   784 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.555960   764 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.580014   764 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.565455   773 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.582749   773 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.583109   773 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.558053   559 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.584874   665 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.557857   545 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:22:14.587080   720 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.587554   814 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:14.588069   814 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:14.588958   814 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.590226   814 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.592672 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.569039   769 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.603574 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.605491 31496 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:14.607694 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:14.610978   801 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:22:14.611837 31540 connection.cc:256] RPC call timeout handler was delayed by -2.2512148470000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:22:14.612353 31540 connection.cc:256] RPC call timeout handler was delayed by -2.1630148469998858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:22:14.612525 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:14.612684 31540 connection.cc:256] RPC call timeout handler was delayed by -2.1036148470002445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 12:22:14.613348   762 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.613729   762 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:14.614111   657 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.614543   762 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.614740   657 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.615929   762 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.616933   657 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.618099 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.618729 31415 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:14.619642 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.620404 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.620874 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:14.621196 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.619668   669 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:14.622464 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.622759   669 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.623559 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:14.619707 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.621001 31423 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:14.621513 31415 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.624213 31418 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:14.644814 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.644815 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:14.646391 31566 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:14.647332 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 86259.1us
I20260709 12:22:14.648250 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.650151 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.652626 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.653788 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.611795 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.654704 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:14.660933 31418 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:14.656270 31423 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:22:14.644821 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59326.9us
I20260709 12:22:14.661568 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:14.622613 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.613749   625 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:14.666716 31419 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:14.567798   494 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:14.673138 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.666966 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.677089 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:14.624893 31540 connection.cc:256] RPC call timeout handler was delayed by -2.0352148470001339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:22:14.667182   665 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:14.725463 31540 connection.cc:256] RPC call timeout handler was delayed by -2.0028148470000815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 12:22:14.741262 31540 connection.cc:256] RPC call timeout handler was delayed by -1.9371148469999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:22:14.741698 31540 connection.cc:256] RPC call timeout handler was delayed by -1.8849148469998909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:22:14.742115 31540 connection.cc:256] RPC call timeout handler was delayed by -1.8012148470002103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:22:14.742481 31540 connection.cc:256] RPC call timeout handler was delayed by -1.7319148470000982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 12:22:14.742947 31540 connection.cc:256] RPC call timeout handler was delayed by -1.7103148470000633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 12:22:14.743335 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6698148469999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:22:14.685787   581 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.662946   673 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.686394 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:14.751343 32106 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
W20260709 12:22:14.731437 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54426.5us
I20260709 12:22:14.753098 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.669148 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.755947 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.756609 31493 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:14.757632 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.732530 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:14.758795 31424 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:14.669368   625 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:14.760203   625 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:14.761270   764 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:14.761482   625 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.733609 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.762817   778 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.666154   807 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.587484   545 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:14.763557   581 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.764676   545 ts_tablet_manager.cc:1434] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.351s	user 0.005s	sys 0.004s
I20260709 12:22:14.684950   657 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.766014   657 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.766412   657 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.748348   786 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.749289 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.769584   720 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.769765   786 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.738905   784 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.770121   720 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.770418   784 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.773016   784 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:14.772927   807 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.773861 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.774335   720 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:14.770785   786 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.776255   807 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:14.780300   819 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:14.754297 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.779752 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.781658 31318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 272) took 2497 ms. Trace:
I20260709 12:22:14.686177   714 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.758354 31499 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.796535 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:14.796875   810 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:22:14.797801 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.799029 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.796535 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.782219 31318 rpcz_store.cc:276] 0709 12:22:12.284901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.285125 (+   224us) service_pool.cc:224] Handling call
0709 12:22:14.781565 (+2496440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:13.205175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:13.255834 (+ 50659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:13.255903 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:22:13.255931 (+    28us) tablet.cc:662] Decoding operations
0709 12:22:13.312361 (+ 56430us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:13.312450 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:13.312489 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:13.312814 (+   325us) tablet.cc:701] Row locks acquired
0709 12:22:13.312851 (+    37us) write_op.cc:260] PREPARE: finished
0709 12:22:13.313033 (+   182us) write_op.cc:270] Start()
0709 12:22:13.313195 (+   162us) write_op.cc:276] Timestamp: P: 1783599733312970 usec, L: 0
0709 12:22:13.313237 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:22:13.340542 (+ 27305us) log.cc:844] Serialized 539 byte log entry
0709 12:22:14.168829 (+828287us) op_driver.cc:464] REPLICATION: finished
0709 12:22:14.400961 (+232132us) write_op.cc:301] APPLY: starting
0709 12:22:14.401041 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:14.401155 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:14.401270 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:14.401522 (+   252us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:14.401790 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:14.401833 (+    43us) write_op.cc:312] APPLY: finished
0709 12:22:14.402088 (+   255us) log.cc:844] Serialized 23 byte log entry
0709 12:22:14.402258 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:14.402335 (+    77us) write_op.cc:454] Released schema lock
0709 12:22:14.402389 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:14.402796 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:14.402827 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":192695,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":227830,"apply.run_cpu_time_us":1802,"apply.run_wall_time_us":1803,"num_ops":1,"prepare.queue_time_us":24361,"prepare.run_cpu_time_us":19188,"prepare.run_wall_time_us":426103,"raft.queue_time_us":414300,"raft.run_cpu_time_us":44199,"raft.run_wall_time_us":88543,"replication_time_us":855428,"thread_start_us":587382,"threads_started":4,"wal-append.queue_time_us":397028}]]}
I20260709 12:22:14.802913   779 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.803731   813 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.805651   789 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.793217   714 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.806578   714 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.783411 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:14.809876 31494 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:22:14.801015   798 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 12:22:14.810894   658 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:14.811446   658 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:14.811931   658 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:14.823905   494 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.832471 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.813192   657 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:14.836859 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:14.860456 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 179476us
I20260709 12:22:14.743889   665 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.854946   625 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.798401   581 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:14.866026 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.826803 31322 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.872852 31322 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:14.881891 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45132.3us
I20260709 12:22:14.884559 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.835742   657 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:14.887243 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.866050   665 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:14.874418   813 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:14.883332 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:14.888099 31498 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.891719 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.879999   779 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.894599 31495 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:14.887512 31322 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 3 to 4, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.901156 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.897852   625 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.893069   813 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:14.909000   664 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.909189   813 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.909426   664 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:14.910215   664 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:14.911206   664 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.911298   581 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.913116 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.914266 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:14.918928 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 249378us
I20260709 12:22:14.922559 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:14.924515 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:14.926589 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:14.920907 31322 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.923326   625 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.932017 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.930234 31322 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.935354 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.937201 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:14.936920 31322 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.926259   779 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.928483   785 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.906208   764 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:14.938462 31322 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.940356 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:14.943531 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 51920us
I20260709 12:22:14.942852   824 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.943046   754 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.946358 31322 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.935253   814 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:14.959860 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:14.962133 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.963821 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.946975   824 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.964903 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:14.942178   586 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.962844 31465 leader_election.cc:400] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3.
I20260709 12:22:14.936563 31415 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:14.943928   785 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.969174 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:14.943661   778 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:14.943785   630 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:14.960896   779 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.960649   814 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:14.984014 31465 leader_election.cc:400] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3.
I20260709 12:22:14.981453 31424 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:14.968326   824 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.973834   785 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.964502   714 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.016536   814 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.028605 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.028923 31419 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:15.015923 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:15.185191 31420 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:14.977669   630 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:15.049826 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.990752   581 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.968946   657 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:15.160116 31496 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.972083   625 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.160809 31465 leader_election.cc:403] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:15.164520 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 134896us
W20260709 12:22:15.208010 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 243144us
I20260709 12:22:15.209115 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:15.187460   773 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.013s
I20260709 12:22:15.166604   668 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.199038   630 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.199757   581 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.232916 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:15.215376   789 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.186621   831 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:15.241595 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 257691us
I20260709 12:22:15.217756   830 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.227200 31415 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:15.205724   658 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.257361   830 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:15.245064   581 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.249775   831 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:15.293584 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 324459us
I20260709 12:22:15.224179   773 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:15.299744 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 87574.7us
I20260709 12:22:15.300652 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.232756   668 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.302470 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.261854   586 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:15.312215   668 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.313494 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.288126   789 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.283478   830 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.293300   837 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.296056   831 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.321261   841 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:15.404615   841 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.407711   841 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.317152   586 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:15.412581 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112009us
I20260709 12:22:15.332283   668 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.413609 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.413936   668 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.414395   668 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.414886   657 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.415134   826 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 12:22:15.415895   657 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:15.416476   827 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:22:15.416365   657 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.416998   657 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.417588   844 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.418035   844 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.418380   844 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.419519 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:15.420023   664 consensus_meta.cc:287] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.006s
I20260709 12:22:15.420890   836 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.422405 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.423545   833 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.424005   833 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.424455   833 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.425971 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.336742   837 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.338526   625 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.477995 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 245517us
I20260709 12:22:15.479966 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:15.320766   789 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:15.431757   819 consensus_meta.cc:287] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.650s	user 0.005s	sys 0.007s
I20260709 12:22:15.413599   586 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.335377   665 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.490586 31418 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:15.480741   813 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.008s
I20260709 12:22:15.476936   841 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:15.480870 31494 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.006s
I20260709 12:22:15.481033   837 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:15.497920 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 184505us
I20260709 12:22:15.340535   843 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:15.513221   842 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:15.509193 31494 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:15.507093 31433 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e77a183300084f968171dcd68225d026 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:22:15.555331 31433 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-e77a183300084f968171dcd68225d026 on tablet e77a183300084f968171dcd68225d026 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.529613   843 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.557312   843 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.557749   811 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.558143   811 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:15.558099   786 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:15.559120   811 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.559675   786 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.560212   811 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.487162   714 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.516897   814 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.518054   658 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.490559   825 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:15.532510 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.486544   625 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:15.538987   820 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.624s	user 0.002s	sys 0.003s
W20260709 12:22:15.584834 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 52428.6us
I20260709 12:22:15.550794 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:15.554345 31500 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.490761   819 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:15.568145 31491 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:15.485978   664 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:22:15.570740 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:15.572392   786 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:15.567117   807 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3.
I20260709 12:22:15.545094   668 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.586247 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1124) took 1007 ms. Trace:
I20260709 12:22:15.591018 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.510190   813 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.591575 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:15.572572 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 350235us
I20260709 12:22:15.620611   813 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.576470   825 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.623656   825 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:15.624512 31566 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:15.591600   832 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.604938 31500 rpcz_store.cc:276] 0709 12:22:14.578595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.578739 (+   144us) service_pool.cc:224] Handling call
0709 12:22:15.531694 (+952955us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:15.531912 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.585911 (+ 53999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.586177 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9486208}
I20260709 12:22:15.627489 31421 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.597220   786 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:15.606004 31415 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:15.602525   789 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.639828 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:15.575827   831 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.637842 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2215) took 1023 ms. Trace:
I20260709 12:22:15.606326   773 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.652312 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.577718   785 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.646665 31573 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.650029 31422 rpcz_store.cc:276] 0709 12:22:14.614282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.614413 (+   131us) service_pool.cc:224] Handling call
0709 12:22:14.614762 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.615162 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.615191 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:14.615639 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:22:14.731519 (+115880us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:14.731558 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.731639 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.538148 (+806509us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:15.627129 (+ 88981us) raft_consensus.cc:1685] finished
0709 12:22:15.627158 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.637756 (+ 10598us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1107,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":3448704,"thread_start_us":115503,"threads_started":1,"wal-append.queue_time_us":249484}
I20260709 12:22:15.631477   832 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.658648   832 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.676678   846 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.677148   581 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.679862   785 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:15.680383 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.681195   630 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.686309 31422 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:15.661916   789 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.688448 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.692384   831 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.695446 31573 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:15.703672 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:15.709914 31574 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:15.714020 31419 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:15.716624 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.720716 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.721652 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.711578   830 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.722500 31416 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.708948 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 285) took 1116 ms. Trace:
I20260709 12:22:15.723871   844 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.730008   833 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.735309   822 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:15.735821   822 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.736541   825 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.736591   837 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:15.692994   846 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.738929   846 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.739267   822 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.702092   630 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.732824 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.699836   789 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.746444   789 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.747004 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.748174   813 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.748799   813 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.749135   813 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:15.749473   813 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.715071   834 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.751008   834 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.754282   789 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:15.756142   824 consensus_meta.cc:287] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.002s
I20260709 12:22:15.756672   824 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.757500   789 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.706069 31415 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:15.717833   819 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:15.761380 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.761554 31572 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.761863 31418 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.731902   831 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.740469   770 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.732280   811 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.738626   825 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.772925   814 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.777029   581 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:15.780203   854 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:22:15.767306   822 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:15.733810 31492 rpcz_store.cc:276] 0709 12:22:14.592222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.595074 (+  2852us) service_pool.cc:224] Handling call
0709 12:22:15.708675 (+1113601us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003bc254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:15.708886 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641305856}
I20260709 12:22:15.761266   843 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.771008   837 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.788566 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.777063   657 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.790868   824 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.791786   831 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.792320   657 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.793030 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.793864   831 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.797228 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.798445   831 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.801949   831 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.803206   814 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:15.803601   814 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:15.804459   814 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.804992 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:15.778581   833 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:15.794663 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.807763 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.809285 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.806866 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.805883   814 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.813153 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:15.826468 31465 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.510s (SENT)
I20260709 12:22:15.831198 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:15.831431 31465 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.580s (SENT)
I20260709 12:22:15.837867 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.828974 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.840175 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:15.841149 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:15.841650 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:15.841723 31498 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:15.842664 31500 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:15.773890   770 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.784646   813 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:15.852267   834 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.823323   819 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:15.865064 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.827538   788 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:15.846791   789 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.873150   864 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.891888   844 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.896183   786 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:15.897346 31494 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:15.904942 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:15.905817 31424 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:15.908241   843 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.909790   830 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.910068   625 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.806548   822 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.920614   822 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.897585   786 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.921037   450 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.921552   450 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.923609   450 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:15.863059 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.912760 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:15.928784   824 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:15.929256   824 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:15.929467   770 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:15.930231   770 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.932406 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1210) took 1316 ms. Trace:
I20260709 12:22:15.932761 31421 rpcz_store.cc:276] 0709 12:22:14.616471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.644880 (+ 28409us) service_pool.cc:224] Handling call
0709 12:22:15.627320 (+982440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.629694 (+  2374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.932217 (+302523us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400212ad0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:15.932348 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229723008}
I20260709 12:22:15.931751 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:15.913198 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:15.937012 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:15.937731 31423 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:15.913893 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:15.927019   668 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:15.930107   824 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:15.885677   788 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:15.873546 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.912948 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:15.912344   811 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.951843 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.952666 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.967410 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 286) took 1101 ms. Trace:
I20260709 12:22:15.947678 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:15.967687 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:15.968431 31493 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:15.969048 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:15.969478 31417 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.969419 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.970171 31493 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.930871   769 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:15.970826   630 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.970773 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:15.956609 31416 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:22:15.971349   630 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.971740   630 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.971854   844 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.972209 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:15.972627 31416 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:15.956784 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:15.973428 31421 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.973847 31416 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.958658 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:15.964473 31569 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:15.975889 31424 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.965111 31422 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.962203 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:15.977444 31419 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.930883   823 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:15.972288   844 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:15.972860 31417 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:15.886456   789 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.960795 32106 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.981379 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:15.999698 31497 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.986294 31421 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:15.989414 31422 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:16.001904 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 161826us
W20260709 12:22:15.995560 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 63879.7us
I20260709 12:22:15.994282 31424 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:16.002534 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:15.998768 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:15.980721 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 148090us
W20260709 12:22:16.005010 31465 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.513s (SENT)
I20260709 12:22:16.005402 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.005648 31424 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:15.967813 31499 rpcz_store.cc:276] 0709 12:22:14.866398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.876304 (+  9906us) service_pool.cc:224] Handling call
0709 12:22:15.956960 (+1080656us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:15.965523 (+  8563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.967100 (+  1577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.967130 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.967169 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:15.967202 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.967254 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.967355 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4668800}
I20260709 12:22:16.013234 31496 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:15.992158   844 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.998657   789 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.991516   822 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:16.015661 32113 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:16.012959 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:15.996117   811 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.036089 32112 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:16.004103 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.019116   519 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:16.023113 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.024533 31499 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:16.013641 32111 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Advancing to term 3
I20260709 12:22:15.988850   668 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.018399 31498 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:16.026381   814 raft_consensus.cc:2764] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:22:16.027849 31465 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.671s (SENT)
I20260709 12:22:16.015367 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:15.995863 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.001294   669 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.033380 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:16.035594 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.037822 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.038511 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.040459 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.000783   586 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:16.058640   843 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.058992 31569 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:16.059379   586 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.059793   586 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.060194   787 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:16.060679   586 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.061890   586 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.051700 31497 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:16.053642 31465 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.741s (SENT)
I20260709 12:22:16.035280   825 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.066022 32106 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:16.067073 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.068001 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.068337   873 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.068763   873 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.069000   843 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.069206   873 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.070115 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.070813   843 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.072691 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.073786 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.028261   808 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:22:16.036854   839 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:22:16.056496 32107 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.040887   823 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:22:16.037293   496 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:16.074631   864 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.090631 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.086875 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 578) took 1419 ms. Trace:
I20260709 12:22:16.041025   840 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:22:16.105792 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.108738 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.056914   593 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:22:16.091012   819 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.113773   496 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.114207   496 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.090600   808 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.118073 31423 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:16.117851   808 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.119099   840 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.119524   840 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.120374   808 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.120656   665 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.127104   788 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.110968   814 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.128588   814 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.128932   814 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.087616   832 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.137246   832 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:16.098345   813 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:16.107295 32105 rpcz_store.cc:276] 0709 12:22:14.667538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.668539 (+  1001us) service_pool.cc:224] Handling call
0709 12:22:15.995450 (+1326911us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:16.082049 (+ 86599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106599808}
I20260709 12:22:16.138659   864 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.140972 31493 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:16.111918   875 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.145404 31491 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.145749   844 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.146824 31422 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.110066   630 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.147845   770 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.148277   770 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.149173   770 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.082458   846 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.151192   494 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.138564   814 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.151674   494 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.152524   494 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.153748   494 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.057121   668 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.120267   840 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.155287   840 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.156379   668 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.158085 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.159662   814 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.164119   770 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.149518   630 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.144796 32107 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:16.151212   844 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.116453   811 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.165746 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.175405 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.175613   788 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:16.175998   788 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.176327   788 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.167918   846 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:16.115042   496 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:16.178895 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.182582 32111 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:22:16.189829 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81189.3us
W20260709 12:22:16.192210 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 106030us
I20260709 12:22:16.193511   843 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:16.195351 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:16.195891 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.196349 31419 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:16.199630 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.200203 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.181949   694 raft_consensus.cc:2764] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:16.205176 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.188225 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.195163   848 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:16.206218 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.205891 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.213439   713 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.213863 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.214376   868 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.227274 31569 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:16.217017   519 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.195031   581 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.194995   814 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.221423 31570 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.222721   496 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.211346   762 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:22:16.203341   658 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.210214 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.196236   669 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.240455 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.243693 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.245671 31574 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.255863 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.264045 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.264783 31569 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.265132 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.265919 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:16.267171 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.267943 31572 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:16.268976 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.256471 31565 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:16.230307   814 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.271114 31568 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.210918 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.271037 31565 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.256721 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.271510 31568 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.273849 31573 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.272248 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.197528   873 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.275071 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.275735 31572 raft_consensus.cc:2368] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:16.277333 31571 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.274430   774 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:22:16.234081   868 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.278862   669 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.282157 31491 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:16.282892   868 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.242534   848 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.284570   848 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.285250   814 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.286628   814 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.287636 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.271796   519 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.289062 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.289592   519 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.289664 31572 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:16.293100   593 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.293653   593 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.294518   593 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.294932   839 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:16.295512   877 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:16.295977   874 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.296420   874 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.296047   877 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.234740   789 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.259343   581 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:16.293133 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.296428 31572 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.300911 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.301033 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.302820 32111 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:16.306344 31572 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.307020 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.313086 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.302415 31568 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.316170 31568 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.313431 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.235045   713 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.263051   658 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.330608 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.334504 31571 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.335129 31568 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:16.336117 32105 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.339080 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.339833 31572 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.342638   876 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.343197   876 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.344017   876 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.346306 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.347018 31491 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:16.352939 32110 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:16.358072 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60342.2us
I20260709 12:22:16.362864 32108 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.329396   846 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.366240 31420 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:22:16.377810   773 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.378880   773 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.367491   846 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.379223   773 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:16.303092   874 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.389283   846 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.402040 31571 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:16.404531 32110 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:16.414179 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.419301   877 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.422360   658 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.425746 31568 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.428746 31571 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.375821   581 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.430581 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.433741 31572 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:16.435674 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.434964 31568 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.436342 31571 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.437422 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.438517 31423 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:16.450803 31569 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.451594 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.451975 31569 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.452867 31497 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.453878 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.457852 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.459090 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.459575 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.460263 31572 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.437685 31568 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.463239 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.463805 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.464004 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.464553 31416 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:16.458717   658 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:16.465337 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.465204   658 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.465658 31497 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:16.467280   658 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.467705 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.468472 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.469028 31424 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:16.474635 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.433180   874 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.463285 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.464397 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:16.477121 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.478392 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.478736 31417 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 2: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:16.481093 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:16.482878   519 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.483166   503 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.483605   503 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.484372   503 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:16.485675   503 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.490799   879 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:16.491322   879 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.493314 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 185) took 6319 ms. Trace:
W20260709 12:22:16.501228 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.502310 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:16.493654   879 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:16.508865   496 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.510972   496 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:16.511088 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.511423   496 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.511777 31569 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:16.513301 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.514008 31572 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.514529 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.514735 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.514850   519 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:16.515365 31572 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:16.515667 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.516165   519 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.516455 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.516939 31568 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.518988 31569 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:16.519920 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.520797 31569 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.521519 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.521404   773 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.516166 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.522832 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.523319 31572 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:16.523602 31569 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.524192 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.524504 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.524724 31572 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:16.525319 31569 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:16.516204 31567 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.532382   496 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.533357   873 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.534408 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.539569   846 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.541828   846 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.543886 31565 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.545527 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:16.506326 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.557997 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.562665 31568 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:16.563081 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.564877 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.460989   789 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:16.567205 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:16.568076 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 150282us
I20260709 12:22:16.574736 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.568269 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.569268 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.576551 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.577243 31497 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:16.578274 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.569612 31570 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:16.579737 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:16.570955   496 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.572319 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.581951 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.583969 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.493649 31322 rpcz_store.cc:276] 0709 12:22:10.232896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.256567 (+ 23671us) service_pool.cc:224] Handling call
0709 12:22:11.931214 (+1674647us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:16.493258 (+4562044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:15.259257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:15.311105 (+ 51848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:15.311148 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:22:15.311170 (+    22us) tablet.cc:662] Decoding operations
0709 12:22:15.312147 (+   977us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:15.312214 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:15.312249 (+    35us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:15.312961 (+   712us) tablet.cc:701] Row locks acquired
0709 12:22:15.312980 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:15.313144 (+   164us) write_op.cc:270] Start()
0709 12:22:15.313266 (+   122us) write_op.cc:276] Timestamp: P: 1783599735313094 usec, L: 0
0709 12:22:15.313288 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:22:15.427469 (+114181us) log.cc:844] Serialized 3242 byte log entry
0709 12:22:15.874231 (+446762us) op_driver.cc:464] REPLICATION: finished
0709 12:22:16.058538 (+184307us) write_op.cc:301] APPLY: starting
0709 12:22:16.058619 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:16.095123 (+ 36504us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:16.106885 (+ 11762us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:16.118463 (+ 11578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:16.118665 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:16.168694 (+ 50029us) write_op.cc:312] APPLY: finished
0709 12:22:16.168988 (+   294us) log.cc:844] Serialized 65 byte log entry
0709 12:22:16.169161 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.169281 (+   120us) write_op.cc:454] Released schema lock
0709 12:22:16.169331 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:16.169723 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:16.169748 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":686864,"reported_tablets":10,"spinlock_wait_cycles":8985984,"child_traces":[["op",{"apply.queue_time_us":184075,"apply.run_cpu_time_us":3100,"apply.run_wall_time_us":111159,"num_ops":8,"prepare.queue_time_us":20622,"prepare.run_cpu_time_us":47431,"prepare.run_wall_time_us":422508,"raft.queue_time_us":92784,"raft.run_cpu_time_us":34949,"raft.run_wall_time_us":164310,"replication_time_us":560797,"thread_start_us":398679,"threads_started":4,"wal-append.queue_time_us":248189}]]}
I20260709 12:22:16.585117 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:16.586020 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.586839 31496 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:16.587133 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 80883.6us
I20260709 12:22:16.547256   773 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.587963 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.594825 31465 leader_election.cc:400] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:16.589604 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.597849 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.594854 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.600701 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.601604 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.603699 32111 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.601984 31497 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:16.606241 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.591239 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.608903 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.609512 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.610164 31495 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:16.573002   837 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.621613 32114 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:16.591842   835 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.612948 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.572988 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.623500 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.589104   494 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.581017   844 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.619263 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.629370 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.631654 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:16.588423   754 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:16.592197   625 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.602025 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.645435 32111 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:16.645704 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.592073   873 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:22:16.627795   846 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.615787   789 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.623914   496 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.635251   586 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.627390 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.634505   848 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:16.658564   665 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.648478   581 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:16.664179 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.639552   879 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.639144 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.647001   658 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.689241   658 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:16.689693   658 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.639182   778 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:22:16.628161   877 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:22:16.652678   840 raft_consensus.cc:2764] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:16.648324   754 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:16.630069   839 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:22:16.694852   754 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.683928 31567 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:16.697940 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.700515 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.681262   586 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.701663   586 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.686640   581 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.703061   581 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.665769   846 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.705767   846 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.677213   494 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:16.713495   823 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.713995   823 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.715139   823 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.715737   625 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:16.687361   879 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:16.716400   625 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.717094   879 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.722900 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.721629 31424 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:16.724823   811 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.725363   811 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.725580   625 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.726444   811 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.724093 31537 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:16.662271   788 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.685272   789 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:16.747924 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162878us
I20260709 12:22:16.753830 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.754614   835 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.755113 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:16.755892   835 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.756074 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.756286   835 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:16.760195 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 128569us
I20260709 12:22:16.682332 31497 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:16.763289 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.747916   868 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:16.767391 31499 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:16.768997 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.775494 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.783596 32109 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:16.761941   835 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.771240   625 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.786123   789 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.792536   900 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.792440   581 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.793212   900 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:16.776619 31494 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:16.795109   581 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:16.806936 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 234665us
I20260709 12:22:16.808094 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:16.839920 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71047.7us
I20260709 12:22:16.794230   900 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:16.842906 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 201760us
I20260709 12:22:16.803359   848 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:22:16.836961   754 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.849203 31496 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:16.852994 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.861330 31498 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:16.847416 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:16.865589   789 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.856103   847 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:22:16.864440   868 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.839679   846 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.854601   808 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.854522   665 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.875155 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 99773.8us
I20260709 12:22:16.878427   906 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:16.894223 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.879019 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:16.884016 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:16.855917 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:16.889794   868 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.898594 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:16.888952   846 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.892025   788 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:16.902220 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.922785 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.923110 31567 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:16.932998   905 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:16.899099   665 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.936491   665 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.939357 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.941262   586 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.942286 31500 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.942903   630 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.944240   713 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.939483   914 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.946693   914 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.947552   914 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.950845 31500 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:16.953745 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.951619 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:16.957198   807 raft_consensus.cc:1064] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:16.960566   807 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:16.902877   902 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:22:16.963762   823 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.963968   496 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.964217   902 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.930711   906 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.965039   496 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.966378 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.967008 31568 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.967974 32114 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:16.921867   778 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.977852   658 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.975155 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.979367 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.980425   909 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:16.980587   846 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:16.976827   824 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:16.981273   824 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.982184   824 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:16.985370 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:16.986191 31491 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:16.987044   658 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:16.980434 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.978210   778 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:16.990324 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.991381 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.993822 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:16.973287 31568 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:16.965440   906 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:16.976227   630 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.002556   778 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.007017   586 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:17.000362 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:16.927217   789 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:16.965509   496 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:17.016026 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:16.989068   901 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.992213   814 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.027361 31422 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:17.016587 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:17.001001   846 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.966193   665 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:22:17.010977   906 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.965551   835 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.016813   907 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:17.049427 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56699.4us
I20260709 12:22:17.023159   901 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:17.054666 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:17.055292 31570 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:17.055608 31574 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:17.054724 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84259.3us
W20260709 12:22:17.036536   503 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:22:17.058547   665 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:17.061995 31572 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:17.057791 31569 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:17.065115 31570 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:17.066386 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.057552 32108 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:17.069469 31418 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:17.036008   586 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:22:17.070389 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.084846   901 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.086848   901 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:17.102818   898 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.446s	user 0.004s	sys 0.000s
I20260709 12:22:17.070323 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1047) took 1265 ms. Trace:
I20260709 12:22:17.114270 31492 rpcz_store.cc:276] 0709 12:22:15.803172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.824534 (+ 21362us) service_pool.cc:224] Handling call
0709 12:22:15.863835 (+ 39301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.004096 (+140261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.012747 (+  8651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:16.023180 (+ 10433us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:16.023227 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:17.052530 (+1029303us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003b9f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:17.055655 (+  3125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:17.068290 (+ 12635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294528640}
I20260709 12:22:17.118517 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:17.119405 31566 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:17.120285 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:17.124279 31565 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:17.125252 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.125798 31565 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:17.130911   787 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:17.134485 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:17.064962   879 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.136310 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.137373 31566 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:17.065467   496 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.114991   789 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.153664   906 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.166779 31495 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:17.144145   908 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:17.159353   581 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:17.184195   879 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:17.190176   837 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.001s
I20260709 12:22:17.178073   908 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.192879   908 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:17.193486   874 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 12:22:17.171607   754 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:17.209468   879 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.190590   837 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.211691 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:17.216959 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:17.222390 31422 raft_consensus.cc:606] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:17.222846 31422 raft_consensus.cc:614] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:17.211153   754 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.232228 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:17.230186   754 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:17.242210 32106 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:17.249349 31574 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:22:17.275632 31465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.223s (SENT) [suppressed 51 similar messages]
I20260709 12:22:17.213470   835 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.277271   754 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:17.280026   920 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.107s	user 0.005s	sys 0.000s
I20260709 12:22:17.212442   879 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.286509   906 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:17.296878   913 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.365s	user 0.003s	sys 0.000s
I20260709 12:22:17.304499 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:17.309515   902 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:17.310249 31565 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:17.310173   902 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.289572   754 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.313709   902 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:17.314208   754 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.313958 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:17.316715 32109 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:17.322305   839 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.322867   839 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:17.323673   839 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.327935   879 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:17.312031 31565 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:17.334262 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:17.339478 31500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:17.340255 31500 raft_consensus.cc:606] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:17.341095   901 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.348742   901 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:17.348191   911 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
I20260709 12:22:17.349378 32109 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.376049   770 raft_consensus.cc:1064] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:17.412180   807 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.416764   807 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:17.437851 31418 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.439386 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.440829 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:17.443102 31497 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.444643   907 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.449515   879 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.450187   879 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:17.451037   906 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:17.451799   778 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.451330   879 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.455415 31463 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:17.455848 31463 leader_election.cc:403] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:22:17.472163 31499 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.486188 31422 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:17.487020 31500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:17.489812 31418 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.487663 31500 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:17.492653 31500 raft_consensus.cc:614] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:17.428390   835 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:22:17.496953 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.487329   791 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.011s
W20260709 12:22:17.502985   791 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.012s
I20260709 12:22:17.487102   927 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:17.506331   694 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:22:17.491878   714 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:22:17.488919   906 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:22:17.492113   877 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:22:17.512378   844 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.513927   844 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.516851   844 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.518172 31500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:17.518851   769 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:17.521885 31500 raft_consensus.cc:606] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:17.522083 32106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 377) took 1339 ms (client timeout 1517 ms). Trace:
W20260709 12:22:17.522585 32106 rpcz_store.cc:269] 0709 12:22:16.182185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.188286 (+  6101us) service_pool.cc:224] Handling call
0709 12:22:16.700380 (+512094us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:17.521894 (+821514us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54006be9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:17.522017 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154054784}
I20260709 12:22:17.524339 31568 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:17.524415 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.525364   844 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.463779   807 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:17.525985   844 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:17.528019   844 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.531097 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:17.531824 31418 raft_consensus.cc:606] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:17.532166 31418 raft_consensus.cc:614] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:17.551779 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:22:17.552079   934 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:22:17.553778 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.549074   625 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:17.555269   625 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:17.554574 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.557926   625 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.561954   754 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.564697   754 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:17.546082   900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.012s	sys 0.030s
W20260709 12:22:17.565982   900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.030s
I20260709 12:22:17.563663   788 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.569475   788 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.571595   788 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.545804   877 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:22:17.584004 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.587334 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.589844 31499 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:17.590904 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.591981 31499 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:17.593928 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.619347   754 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.624298 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:17.620095   791 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:17.625123 31500 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.662330 31500 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:17.622586   754 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:22:17.592978   901 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:17.641826   791 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:17.644856 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:17.687743 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 93043.7us
W20260709 12:22:17.709460   910 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.784s	user 0.004s	sys 0.006s
I20260709 12:22:17.704933   877 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.714815   877 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.717250   877 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:17.722945   791 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:17.728945   791 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:17.730850 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.731607 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.704843   916 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.737355   916 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:17.738308   916 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.739698   916 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.740578 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.741732   788 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:17.743537   625 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.744027   625 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:17.705430   908 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:17.744999   625 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.746026 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:17.746292   837 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.746774   837 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:17.747684   837 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.752106 31491 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:17.753439 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.754063 31500 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:17.756731 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.758234 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:17.776535 32114 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEARNER]: Advancing to term 4
I20260709 12:22:17.785744 31418 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.782042   945 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.790413 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.791726 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.792461 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:17.793032 31465 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:17.793058 31574 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:17.794119 31570 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:17.794245 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.794718 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:17.794940 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99119.5us
I20260709 12:22:17.795303 31565 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:17.780265 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:17.796595 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.798745 31571 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:17.798430 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.795645 31390 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:17.800009 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:17.801383 31574 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:17.800688 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.801707 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:17.802202 31423 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:17.802865 31569 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:17.802875 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:17.803838 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.804430 31424 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:17.804376 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.805162 31565 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:17.805516 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:17.806063 31424 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:17.806145 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.806222 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.800696 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.806864 31574 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:17.776484   773 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:17.827407 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.826743 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:17.828625 31424 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:17.807937 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:17.806938 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.831432 31570 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:17.811636 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:17.804507 31569 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:17.832595 31418 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:17.837193 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.783390   901 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:17.840994 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:17.799021   450 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.798525   946 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:17.802819   879 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:17.798537   903 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.828469   915 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.833326   902 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.798870   754 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:17.851178   950 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.851429   789 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.829308   773 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.854802   835 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.826618   914 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.827817   927 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.826853   907 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:17.856724 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59477us
W20260709 12:22:17.849188 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49073.2us
I20260709 12:22:17.833863   909 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:17.861786 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61322.1us
I20260709 12:22:17.843258   811 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:17.845464   788 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:17.896726 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96118.1us
I20260709 12:22:17.834923   665 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:22:17.855576   901 raft_consensus.cc:2764] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:17.896754   754 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:17.899194 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.905653   950 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:17.788477   945 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.911540 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:17.845118   906 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:22:17.865577   879 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.855800   949 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.913959   773 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.939668   811 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:17.862442   946 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.903303 31415 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:17.862382   903 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:17.952885 31492 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 3
I20260709 12:22:17.939249   907 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:17.960016 31418 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:17.963227 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:17.968519 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:17.968557 31500 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.898737   902 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.970439 31498 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.950819   665 consensus_queue.cc:1243] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:17.947779   954 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:17.947408   844 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:17.980020 31419 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.987244 31492 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:22:18.000120   496 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.999895   840 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:18.001065   950 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:17.973424   811 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.951716   788 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.003192   955 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:17.967018   503 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:22:18.005342 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:17.985134   909 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.016230 31495 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:18.017148 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48585.7us
I20260709 12:22:18.019097   915 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.021030   901 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.008517   908 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.013505 31492 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:18.012744 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:18.047446 31495 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:18.006974   959 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.012006   665 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:22:18.069907   949 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:18.074539 32114 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:18.017258   965 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.041376   915 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.084657   914 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:18.013949   844 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.088689 31423 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:18.104406 31499 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.105031 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:18.105263 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 264310us
I20260709 12:22:18.091426 31424 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:18.106860 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.092372   586 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:18.094509   807 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.076543   956 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:18.101454 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.085017   773 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.012359   954 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:18.124778 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.079216   945 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.099787   915 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:18.142338 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.053777   908 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.133354   956 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:18.149529   960 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:22:18.149396   956 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.154875 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:18.177415   902 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:18.200023 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 177593us
W20260709 12:22:18.202931 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.177513   835 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:18.205992   954 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.207620   907 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.199206   945 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.100693   965 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:18.212862   965 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.044008   909 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:18.142004   754 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.214534   625 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.268285 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.272471   909 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.208141   773 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:18.277814 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 117366us
I20260709 12:22:18.278975 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:18.281520 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.283622 31499 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:18.262869   847 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.219067 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:18.291301 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 317725us
W20260709 12:22:18.292721 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 484838us
I20260709 12:22:18.293601 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:18.340925 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:18.349098 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.363680 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 84797.2us
W20260709 12:22:18.364066 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 71894.8us
I20260709 12:22:18.150208   949 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:18.364599 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 66233us
I20260709 12:22:18.272491   844 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:18.375348 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:18.376354 31499 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:18.377300 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:18.377919 31499 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:18.365278   970 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:18.278515   754 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:22:18.365010   965 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:18.362744   665 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:18.286617   879 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.311432   847 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:18.384945   788 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.365624   778 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.378499   908 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.400666 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:18.413357 32114 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:18.424688 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:18.423791 31499 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:18.425513 31498 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.366700 31493 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:18.363965   901 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:18.454962 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:18.460999 31498 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:18.465034 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64452.1us
I20260709 12:22:18.465965 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:18.430303   908 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.409715   788 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:22:18.410534   915 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.472651 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:18.480185 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.481289 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.481871 31423 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.482069 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:18.482795 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.483188 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.484117 31418 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:18.483357 31423 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:18.459347   902 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.409039   778 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.486517 31423 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:18.487133 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55360.5us
I20260709 12:22:18.494246 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:18.469496   965 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.471489   900 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:18.448976   879 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:22:18.494088 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.452508   907 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:22:18.489912   847 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.519062   847 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.519742   879 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.520308   879 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:18.514698 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52448.6us
I20260709 12:22:18.515172 31418 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:18.523331 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.523558 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:18.524159 31418 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.522430   879 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.527102 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:18.527896   973 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.528546   973 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.530828   972 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:22:18.533098   978 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.533638   978 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.499943   965 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.534981   965 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:18.534981   964 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:22:18.534000   909 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:18.467993   914 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:22:18.539742 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:18.555137 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:18.544080 31418 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:18.557324 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.558115 31570 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:18.558960 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.560020 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.560181 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.560745 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:18.514436 31567 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:18.476321   908 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.561688 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:18.562062 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67895.1us
I20260709 12:22:18.490262   868 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:22:18.508975   950 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.562669 31565 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:18.527544 31423 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:18.538841   972 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.576323   962 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.576936   980 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:18.535899   978 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.499114   839 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:22:18.556216   496 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
W20260709 12:22:18.564324   811 consensus_meta.cc:287] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 12:22:18.496313   902 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.564268   879 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.576570   972 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.577450   980 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.600747 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.603981 31571 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:18.585048   876 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.604861   876 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.563446   969 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 12:22:18.589841   754 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.590176   973 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.592666   950 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.592340   879 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.592867   972 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.601321   900 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.635648   773 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.636055   773 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:18.637147   773 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.639263   915 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.630980   754 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:18.645196   754 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.645928   876 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.629019   844 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:22:18.590787   811 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.649791   811 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.638406   773 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.651531   902 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:18.624745 31494 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:18.652312 31494 pending_rounds.cc:85] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:22:18.652581 31494 pending_rounds.cc:107] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:18.652853 31494 raft_consensus.cc:2889] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:18.663827 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.668236 31566 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.669234   965 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.671666   965 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.653515   972 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:18.682607 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 279381us
I20260709 12:22:18.677277   907 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.690104 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:18.632018   879 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.691134 31574 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.684530 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:18.653363   900 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:18.707567 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.712320 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:18.682286   778 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:18.684248   694 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:18.690168   914 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.709775   907 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.717731   808 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:22:18.720934 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.758697 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:18.728384 31574 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:18.760046 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:18.760768 31574 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:18.761489 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:18.761659   981 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:22:18.762074 31574 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:18.718068   586 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.631400   950 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.763126   586 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.764776   950 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.691069   811 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:18.765676   811 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.766589 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:18.741587 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.771656 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.750085   914 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.757478   907 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.712276   902 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.722250   971 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:18.721299   908 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.805290 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:18.805758 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.805964   927 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.806401   927 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:18.807260   927 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.808501   927 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:18.804890   807 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.001s
I20260709 12:22:18.810891 31497 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:18.813524   946 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.822170   837 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.823748   914 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.815496   959 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.824625   959 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:18.777262   811 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:18.801043   915 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.802402   906 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:18.839571   983 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 12:22:18.835724   914 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:18.856976 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 275310us
I20260709 12:22:18.838372   811 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:18.859956 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:18.860579 31419 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:18.853292   824 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:18.842852   915 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.845515   906 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:18.880282 32110 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:22:18.867875   625 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 12:22:18.858564   962 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:18.869163   980 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:18.862499   811 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.863418   914 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:18.912606   915 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.914420   906 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:18.900717   992 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.012086   811 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.012934 31566 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:18.926786   994 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.926251   993 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:19.015355   916 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.916519   992 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.017544 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:19.023901   914 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.019729 31319 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:19.025751   959 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.026317   995 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.027493 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.020488 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 601) took 1291 ms. Trace:
I20260709 12:22:19.044898 31319 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:22:18.935726   962 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.054576 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.065577 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.054901 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.067768 31498 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:19.069752 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.070283   987 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.070392 31500 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:19.071379 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.071975 31500 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:19.048820   900 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.043674   811 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.069245 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.046154   980 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:19.072690 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56316.3us
I20260709 12:22:19.051683 31319 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.069203   959 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.078548 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:19.084095 31498 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:19.082998 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.081152 31319 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 3, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.050189 32109 rpcz_store.cc:276] 0709 12:22:17.725742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.726204 (+   462us) service_pool.cc:224] Handling call
0709 12:22:18.682134 (+955930us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:18.682342 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.682569 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:18.841032 (+158463us) log.cc:844] Serialized 14 byte log entry
0709 12:22:19.016775 (+175743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.016829 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:19.016875 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.016979 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.017123 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":222383,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1558,"raft.queue_time_us":7796,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":23409536,"thread_start_us":300609,"threads_started":2}
I20260709 12:22:19.085711 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.086845   908 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.086305 31319 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 3, term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to <none>, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:19.087232   908 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:19.087636   908 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.087985 31319 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 4, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.089564 31319 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 reported cstate change: leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:19.091177 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.092527 31500 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:19.093140   999 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.004s
I20260709 12:22:19.047441   916 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.070922   987 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:19.093986 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.086499 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.077665   980 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.041709   879 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:19.077054   914 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:19.121443   625 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:19.125624 31491 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:19.092919   972 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.127115 31496 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:19.123127 31319 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:19.129761 31500 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:19.130352   586 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.078444 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:19.129866 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.078300   811 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.146605 31565 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:19.135843   980 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.074271   995 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.133934   824 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.160758 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:19.150355 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:19.139907 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53475.1us
I20260709 12:22:19.093760   959 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.140568   946 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:19.076210   994 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.156603 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 386) took 1383 ms. Trace:
I20260709 12:22:19.166000 31390 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.154381 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:19.139705   625 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:19.178853 31419 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:19.179597 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:19.054522   993 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.170827   987 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:19.184715 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.180526 31499 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:19.196633 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:19.197310 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:19.171402  1007 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:22:19.175583   946 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.201937   996 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.197327 31419 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
W20260709 12:22:19.218935 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.196663 31421 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:19.139004   914 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.216687 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:19.199335   988 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.605s	user 0.002s	sys 0.000s
I20260709 12:22:19.234499 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:19.235359 32109 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:19.257664   972 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.258235   992 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.258597 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.259368   994 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.177109 32108 rpcz_store.cc:276] 0709 12:22:17.773604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.779423 (+  5819us) service_pool.cc:224] Handling call
0709 12:22:18.900549 (+1121126us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:18.906318 (+  5769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.014922 (+108604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.014962 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.015480 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.073943 (+ 58463us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:19.076591 (+  2648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.078330 (+  1739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.156284 (+ 77954us) raft_consensus.cc:1685] finished
0709 12:22:19.156311 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:19.156540 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108614,"raft.queue_time_us":103882,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":22008064,"thread_start_us":30384,"threads_started":1,"wal-append.queue_time_us":77910}
I20260709 12:22:19.216797   946 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:19.261415  1004 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:22:19.166836 31567 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
W20260709 12:22:19.262823  1005 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:22:19.259310 31491 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:19.263926 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.264791 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.200006   907 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.203220   839 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.194027   658 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:19.192284   625 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.276046 31500 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:19.354409 31570 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:19.351399 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.221336   965 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:19.281703 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.171505   824 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.344846 32111 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:19.192821  1001 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.198660   982 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
W20260709 12:22:19.365697 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.346747 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:19.366145 31568 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:19.221612   874 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:19.385830 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.399603 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:19.223757   868 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 12:22:19.410887 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:19.345363   972 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.411836 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:19.359193   949 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.344442   994 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.416661 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.417241 31573 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:19.382814   658 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.393893 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:19.403537   773 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:19.394277   665 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.405772   778 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.442101   778 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:19.442579   778 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.403743   839 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.441150   914 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.282543   996 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.422237   658 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.397739   907 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.407482   927 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:22:19.471212 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 71892.7us
I20260709 12:22:19.414728   986 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:22:19.405293   874 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:19.459112  1006 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:22:19.435948  1019 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:19.473079  1011 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:22:19.451614   993 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.470199   879 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.414247  1001 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.422581   972 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.424809   949 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.448073   773 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.420380   994 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.461934  1017 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.450109   665 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.480394  1018 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:19.525940 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:19.529685 31418 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:19.494807   811 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.505339 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:19.507717   839 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.539608   824 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.543921   773 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:19.544382 31417 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:19.546303   972 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.547884   949 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:19.518960   586 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.551123 31420 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:19.525511   959 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.501156  1019 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:19.595400  1013 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:22:19.598274 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.599185 31574 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:19.525523  1017 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.542569   778 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:19.567021   586 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.538475  1018 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:19.684465 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.615511 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.787657 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.917474 31574 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:19.918494 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2169) took 1052 ms. Trace:
I20260709 12:22:19.918922 31574 rpcz_store.cc:276] 0709 12:22:18.865729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.683040 (+817311us) service_pool.cc:224] Handling call
0709 12:22:19.917206 (+234166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.918237 (+  1031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.918436 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:19.941315 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2162) took 1220 ms. Trace:
I20260709 12:22:19.943629 31567 rpcz_store.cc:276] 0709 12:22:18.721170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.758411 (+ 37241us) service_pool.cc:224] Handling call
0709 12:22:19.941131 (+1182720us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400262fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:19.941252 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916151168}
I20260709 12:22:19.947165   916 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.950824 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.951754 31390 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:19.952735   949 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:19.953132   949 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.953471   949 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.954881   986 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:19.955302   986 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:19.955652   986 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.971413   949 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.973978   949 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:19.976492 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1158) took 2182 ms (client timeout 1790 ms). Trace:
W20260709 12:22:20.087662 31566 rpcz_store.cc:269] 0709 12:22:17.794464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.794573 (+   109us) service_pool.cc:224] Handling call
0709 12:22:18.635748 (+841175us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b54003170a8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f5405f4 00007fc11e729227 00007fc11e728ab8 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:19.976282 (+1340534us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5400317254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:19.976387 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45693056}
I20260709 12:22:20.089217 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:19.979400 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.983043   965 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.989650   995 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.994505   986 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.996622   993 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.003726   927 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.004070 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.004662   959 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.008881 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:19.893115   665 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.010169 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:20.011405   625 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
W20260709 12:22:20.011538   770 raft_consensus.cc:1068] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Unable to promote non-voter e166c1cb41f04d55a85e6c0d7966e32e: Illegal state: Replica b6bc3d9dbfb44e81b63071002a011f71 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:20.011687   996 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.007792   519 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.015424  1001 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:20.017388   658 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.000s
I20260709 12:22:20.018987   586 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.019797 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:20.121563 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 101832us
I20260709 12:22:20.121690 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2167) took 1331 ms. Trace:
I20260709 12:22:20.122008 31573 rpcz_store.cc:276] 0709 12:22:18.790659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.593209 (+802550us) service_pool.cc:224] Handling call
0709 12:22:19.593873 (+   664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.594319 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.594355 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.595623 (+  1268us) log.cc:844] Serialized 572 byte log entry
0709 12:22:20.035961 (+440338us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.036015 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.036107 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.121464 (+ 85357us) raft_consensus.cc:1685] finished
0709 12:22:20.121487 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.121633 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":439967,"threads_started":1,"wal-append.queue_time_us":524302}
I20260709 12:22:20.124084 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.124682   665 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.111361   927 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.125116   665 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.125483   665 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.125872   788 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.126358   788 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.020620 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2286) took 1540 ms. Trace:
I20260709 12:22:20.126900   927 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:20.020231   980 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.854s	user 0.009s	sys 0.002s
I20260709 12:22:20.116233   625 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:20.021875 31420 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2272) took 2235 ms (client timeout 2218 ms). Trace:
I20260709 12:22:20.024492 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.127641   980 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.025112   987 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:20.026185 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.129295 31574 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:20.022125   972 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:19.849167   824 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.025789   909 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:22:19.731977   967 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:19.576558   908 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:19.897359   874 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:19.899183  1019 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:20.040970   990 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.034s	sys 0.029s
I20260709 12:22:20.050441   903 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.135921   903 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.137463   908 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.053311 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 343) took 1373 ms. Trace:
I20260709 12:22:20.135334   967 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.138818 31571 rpcz_store.cc:276] 0709 12:22:18.679437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.679553 (+   116us) service_pool.cc:224] Handling call
0709 12:22:20.052538 (+1372985us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:20.052756 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.052960 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.052989 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.053036 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:20.053073 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.053131 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.053250 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17987328}
I20260709 12:22:20.056864   956 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.140719   967 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:20.140949 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2172) took 1116 ms. Trace:
I20260709 12:22:20.141371 31571 rpcz_store.cc:276] 0709 12:22:19.024782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.140116 (+1115334us) service_pool.cc:224] Handling call
0709 12:22:20.140453 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.140625 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.140653 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.140696 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:20.140725 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.140782 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.140895 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.059229 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 344) took 1306 ms. Trace:
I20260709 12:22:20.143251   994 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.144407   980 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.142822 31570 rpcz_store.cc:276] 0709 12:22:18.752668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.404517 (+651849us) service_pool.cc:224] Handling call
0709 12:22:19.404769 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.486516 (+ 81747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.486546 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:19.486586 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:19.486614 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.058486 (+571872us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54002503d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.058537 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.058661 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187575168}
I20260709 12:22:20.145263 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.146051 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.146839 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.147526 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 316) took 2690 ms. Trace:
W20260709 12:22:20.148471 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.149204   927 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.149591   927 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.149910   927 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.150291 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.151515   586 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.151958   586 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.152012  1019 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.152446   586 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.152595  1019 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.154855   770 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.044965 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.070822 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1076) took 2487 ms. Trace:
I20260709 12:22:20.155754 31496 rpcz_store.cc:276] 0709 12:22:17.583487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.584808 (+  1321us) service_pool.cc:224] Handling call
0709 12:22:17.585088 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.138550 (+1553462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.070489 (+931939us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002e7a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.070719 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3545619328}
I20260709 12:22:20.155300   770 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.156935   770 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.157076 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.072755 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:20.059717   992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.051s	sys 0.093s
W20260709 12:22:20.159446   992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.052s	sys 0.093s
I20260709 12:22:20.159668 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1179) took 1474 ms. Trace:
I20260709 12:22:20.160070 31565 rpcz_store.cc:276] 0709 12:22:18.684881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.685032 (+   151us) service_pool.cc:224] Handling call
0709 12:22:20.159501 (+1474469us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54001cdc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:20.159615 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007629696}
I20260709 12:22:20.148072 31494 rpcz_store.cc:276] 0709 12:22:17.457482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.458749 (+  1267us) service_pool.cc:224] Handling call
0709 12:22:17.459443 (+   694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:18.712817 (+1253374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.147197 (+1434380us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003bc254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.147446 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2598568320}
I20260709 12:22:20.161991 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.166942   581 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:20.155821   916 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.176987   916 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.180315   916 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.181059 31496 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:20.100201   778 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.100843   965 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:20.061669   946 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.000s
I20260709 12:22:20.210377   946 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.212620   946 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:20.101727 31497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1079) took 2500 ms (client timeout 1861 ms). Trace:
I20260709 12:22:20.213864   965 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.110749 31499 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:20.092111   848 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.215094   848 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.215404 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.217094   848 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.111864 31500 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:20.217628 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2283) took 1738 ms. Trace:
I20260709 12:22:20.218626 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.219332 31500 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.219472 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:20.119966   658 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:20.113095   959 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:20.128350 31420 rpcz_store.cc:269] 0709 12:22:17.786639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.789431 (+  2792us) service_pool.cc:224] Handling call
0709 12:22:17.911333 (+121902us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:20.021678 (+2110345us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003ee254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:20.021804 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771750144}
I20260709 12:22:20.220686 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.222916   835 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:20.129334   625 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.021914 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.126694   788 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.225425   625 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:20.225775   625 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:20.226125   625 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.126835 31424 rpcz_store.cc:276] 0709 12:22:18.480136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.480252 (+   116us) service_pool.cc:224] Handling call
0709 12:22:18.480530 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:18.507791 (+ 27261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.507820 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:18.516316 (+  8496us) log.cc:844] Serialized 26 byte log entry
0709 12:22:18.600724 (+ 84408us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:18.600762 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.020232 (+1419470us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54003eb554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.020279 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.020323 (+    44us) raft_consensus.cc:1685] finished
0709 12:22:20.020346 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.020564 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79193,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4947,"spinlock_wait_cycles":61880704,"thread_start_us":69653,"threads_started":1,"wal-append.queue_time_us":208785,"wal-append.run_cpu_time_us":1868,"wal-append.run_wall_time_us":1053461}
I20260709 12:22:20.228348 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.229334   844 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:20.132143 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 348) took 1223 ms. Trace:
I20260709 12:22:20.229807   848 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.230417   848 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.229912 31573 rpcz_store.cc:276] 0709 12:22:18.908547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.131538 (+1222991us) service_pool.cc:224] Handling call
0709 12:22:20.131820 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.131936 (+   116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.131950 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.131986 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:20.132003 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.132036 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.132104 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.232683 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.229825   844 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.233479   844 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:20.238489   789 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.239082   789 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:20.239899   789 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.786145   970 raft_consensus.cc:1064] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:20.117089   519 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.134840   824 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.155288  1019 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:20.218024 31415 rpcz_store.cc:276] 0709 12:22:18.478932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.485086 (+  6154us) service_pool.cc:224] Handling call
0709 12:22:18.538702 (+ 53616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.016082 (+477380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.016125 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.016635 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.084213 (+ 67578us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:19.407013 (+322800us) log.cc:844] Serialized 14 byte log entry
0709 12:22:19.526810 (+119797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.217239 (+690429us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b540013a720. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196e041d 00007fc119766a57 00007fc119763dde 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:20.217305 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.217351 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:20.217434 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.217571 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4295,"prepare.queue_time_us":338163,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":40418,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":29095,"spinlock_wait_cycles":21782912,"thread_start_us":693301,"threads_started":4,"wal-append.queue_time_us":207505}
I20260709 12:22:20.246996   950 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:20.247983   950 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:20.249404   950 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.189381   665 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.191458 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 349) took 1106 ms. Trace:
I20260709 12:22:20.302134 31571 rpcz_store.cc:276] 0709 12:22:19.085023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.143308 (+1058285us) service_pool.cc:224] Handling call
0709 12:22:20.190763 (+ 47455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.191012 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.191050 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.191110 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.191153 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.191228 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.191389 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:20.195488   586 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.201308  1017 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.201553   503 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.205778   770 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:20.081830 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.014s
W20260709 12:22:20.315349 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.014s
W20260709 12:22:20.315750 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 817355us
I20260709 12:22:20.110844   993 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.251436   778 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.223444   835 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.267088   907 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.271570  1018 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.277047   658 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.278585   965 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.278566   900 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.280036 31499 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:20.388576 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:20.389420 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.389732 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.390295 31499 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:20.281459 31494 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:20.391676 31491 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:20.282241   519 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.292178   848 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:20.293573 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 271709us
I20260709 12:22:20.296175   824 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:20.188632  1016 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.711s	user 0.009s	sys 0.018s
I20260709 12:22:20.104135 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.327481   503 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.318204 31500 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:20.214054 31497 rpcz_store.cc:269] 0709 12:22:17.586312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:17.593649 (+  7337us) service_pool.cc:224] Handling call
0709 12:22:20.086546 (+2492897us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000235d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:20.086797 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752342912}
I20260709 12:22:20.392102 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.410243 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.410408 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.410930 31497 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:20.314914 32077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.003s	sys 0.013s
W20260709 12:22:20.411689 32077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.013s
W20260709 12:22:20.330540   914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.008s	sys 0.010s
I20260709 12:22:20.333642   839 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.335074 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:20.336095  1027 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:20.338526 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 182655us
I20260709 12:22:20.420331 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:20.358817 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 336) took 1500 ms. Trace:
W20260709 12:22:20.358937 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 143644us
I20260709 12:22:20.309933  1019 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.314670   994 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.327745  1017 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.326182   946 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:20.433130 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.364013 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:20.414124   914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.008s	sys 0.010s
I20260709 12:22:20.317430 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:20.386739   990 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:20.414147   907 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:20.445508   990 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:20.446812  1012 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.063s	user 0.000s	sys 0.011s
W20260709 12:22:20.447541 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 130182us
I20260709 12:22:20.415910 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:20.448577   997 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:20.448964   997 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.449091 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:20.449365   997 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.449499   519 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:20.449874   788 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.450209   519 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.450958 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.451567 31500 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:20.406669  1018 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.451756   903 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.452164  1018 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.452934   770 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.453651  1041 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.424997 31495 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:20.364557   778 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.454173   665 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.454355 31495 pending_rounds.cc:85] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:22:20.454741 31495 pending_rounds.cc:107] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:20.454998 31495 raft_consensus.cc:2889] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.455493 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.455973   778 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.456676 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.457430 31492 raft_consensus.cc:2368] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:20.428403 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.458199 31419 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:20.429839 31573 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:20.419896 31494 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.458884 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.459095 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 351) took 1177 ms. Trace:
I20260709 12:22:20.459599 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.430958 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.459486 31567 rpcz_store.cc:276] 0709 12:22:19.281288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.160125 (+878837us) service_pool.cc:224] Handling call
0709 12:22:20.160379 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.391700 (+231321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.391752 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.391823 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.391873 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.458887 (+ 67014us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001ccd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.458933 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.459047 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521394432}
I20260709 12:22:20.460590 31569 raft_consensus.cc:2376] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3. Re-sending same reply.
I20260709 12:22:20.460662   946 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.461107 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.461542 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.461875 31567 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:20.399880   986 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.431187 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.433564 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.437127   848 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.433531 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.408361   658 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.438482 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.434031  1019 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.454142  1041 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.437346   994 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.462658 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.468540   586 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.469007 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.469360   503 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.433368  1027 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.469743 31569 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:20.462911   946 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.463418 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.472059   959 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.472144 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2289) took 1332 ms. Trace:
I20260709 12:22:20.472535 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.473256 31420 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:20.474103 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.464113   658 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.438395 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.441749   876 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:20.476603   876 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.477073 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.477703   658 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.477782 31415 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:20.440322   840 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.424846   839 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.444056 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.444345  1017 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.443327   835 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.414019   909 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:22:20.464501 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.450273 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1173) took 1893 ms. Trace:
I20260709 12:22:20.452402 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.505357 31574 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.480371 31571 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:20.464964 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.460116 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.427424 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:20.426110 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 91170.6us
I20260709 12:22:20.509529 31421 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:20.505211 31572 rpcz_store.cc:276] 0709 12:22:18.557233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.558784 (+  1551us) service_pool.cc:224] Handling call
0709 12:22:18.559201 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:18.668312 (+109111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.668358 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.926153 (+257795us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b2c0010e118. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:19.022418 (+ 96265us) log.cc:844] Serialized 52 byte log entry
0709 12:22:19.075199 (+ 52781us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:19.075235 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.075305 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.390413 (+1315108us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:20.450052 (+ 59639us) raft_consensus.cc:1685] finished
0709 12:22:20.450074 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.450211 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1431,"raft.queue_time_us":48290,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13075,"spinlock_wait_cycles":34266240,"thread_start_us":137643,"threads_started":2,"wal-append.queue_time_us":149158}
I20260709 12:22:20.510443 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.511335 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.511777 31421 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:20.463866 31418 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:20.465529 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 345) took 1700 ms. Trace:
W20260709 12:22:20.509521 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45106.5us
I20260709 12:22:20.447611   990 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.423552 31497 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:20.512471 31568 rpcz_store.cc:276] 0709 12:22:18.764899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.404015 (+639116us) service_pool.cc:224] Handling call
0709 12:22:19.404287 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.506927 (+102640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.506956 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.510329 (+  3373us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.589923 (+ 79594us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:19.589976 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.590076 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.465327 (+875251us) raft_consensus.cc:1685] finished
0709 12:22:20.465349 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.465475 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1100,"raft.queue_time_us":97747,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":13398,"spinlock_wait_cycles":1941376,"thread_start_us":153168,"threads_started":2,"wal-append.queue_time_us":840578}
I20260709 12:22:20.515077 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.515342 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.400661 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.460178 31573 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:20.467671 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.515842 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.516618 31568 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:20.517117 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.472609 31423 rpcz_store.cc:276] 0709 12:22:19.139460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.139610 (+   150us) service_pool.cc:224] Handling call
0709 12:22:19.141039 (+  1429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.141341 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.141365 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.158899 (+ 17534us) log.cc:844] Serialized 572 byte log entry
0709 12:22:19.280896 (+121997us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:19.280940 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.281015 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.187864 (+906849us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:20.471838 (+283974us) raft_consensus.cc:1685] finished
0709 12:22:20.471867 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.472083 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10464640,"thread_start_us":85196,"threads_started":1,"wal-append.queue_time_us":242896}
I20260709 12:22:20.474123 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.506803 31424 raft_consensus.cc:2368] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:20.517625 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.507350 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.490257 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.518476 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.487478 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.513684 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.475616   789 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.434353   962 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:20.519629 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45578.6us
I20260709 12:22:20.471396 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.607757 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.607853 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.608173 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.608496 31497 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.608814 31491 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:20.609328 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.609727 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.480119   839 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:20.462980  1042 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.610999 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.611584 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.605713 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.612703 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.613807 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.614316 31571 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.614771   946 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.615257   946 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:20.612932 31424 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:20.616114   946 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.616823 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.617362 31417 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.617583 31572 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:20.619704 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.606215   625 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:20.620759 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.620911 31422 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.621666   625 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.622097 31421 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:22:20.622270 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84527us
I20260709 12:22:20.452169   903 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.623900 31422 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:20.606519 31390 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.624313 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.625633 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:20.618389 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:20.464087  1045 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:20.624066   903 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.617003 31424 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:20.628166 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.610395 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.544857 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.631304 31569 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 2: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:20.643658 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 136359us
I20260709 12:22:20.637148 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.624452 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:20.645279 32110 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.645388 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.620770 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.537284 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:20.638850 31572 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:20.615510 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.644086 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.639362 31420 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 1.
I20260709 12:22:20.538511 31496 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:20.646435 31574 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:20.640336 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1164) took 2477 ms. Trace:
I20260709 12:22:20.639314 32109 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:20.651417 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.454200  1018 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:20.644086 31497 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:20.645496 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.656267 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.467907  1041 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.646893 31423 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.624980 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.639889 31419 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:20.466818  1019 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.652235 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.662830 32114 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.662998 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.466197 31494 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:20.655560 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:20.663580 31497 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:20.663811 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:20.663987 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.502475   916 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.458201 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.625404 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.467196   927 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:20.678804 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53246.5us
I20260709 12:22:20.538687   835 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.478650   876 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.463490   848 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:20.467883   994 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:20.520045   993 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.666725 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:20.666961 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 153344us
I20260709 12:22:20.719449   625 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.667484 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:20.655962   907 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:20.720497   907 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.720379   625 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.720927   907 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.650573 31495 rpcz_store.cc:276] 0709 12:22:18.162859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.163053 (+   194us) service_pool.cc:224] Handling call
0709 12:22:18.163496 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.455605 (+2292109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.640121 (+184516us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400013e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.640283 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5200160000}
I20260709 12:22:20.471364  1027 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.504254 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.676959 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.677090 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.722966 31497 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.722962 31415 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:20.677434 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:20.725838 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48490.1us
I20260709 12:22:20.727031 31568 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.727877   778 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.728403   778 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.728816   778 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.679332 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.672330 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.732978 31424 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.681088 31419 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:20.733467   586 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:20.638175   503 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.666028 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.659711   909 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.658342   900 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:20.734658   503 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.735152   909 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.738786   909 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.735513   900 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:20.734696 31466 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:20.744382   586 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.744766   586 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.745173   586 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.741801   900 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:20.744859 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.478781   840 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.657866  1029 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:20.769327 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82652.6us
W20260709 12:22:20.770241 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.025s
W20260709 12:22:20.775169 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.004s	sys 0.026s
I20260709 12:22:20.675014   992 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:20.772789 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 323759us
I20260709 12:22:20.471352   844 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.675526 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:20.770591 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 93715.8us
I20260709 12:22:20.701745 31566 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:22:20.783437 31465 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:20.682896  1041 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:20.787806 31540 leader_election.cc:400] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:20.794890 31540 leader_election.cc:403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:20.796432 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:20.611022  1042 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.689735   990 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.642236   962 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.803462 32111 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:20.804477 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.809530 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.772269 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.812633 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:20.809697 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.781551   993 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:20.817366 32110 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:20.682299   916 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.822172 31418 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:20.814296  1019 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.826164  1019 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:20.826318  1051 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:22:20.826606  1019 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.827529   848 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.828374   788 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.830150 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.798446  1050 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.807595  1041 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:20.832086  1050 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.832769  1041 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:20.834915   986 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:20.811071   992 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:20.836494   844 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.786317  1029 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:20.837356   503 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.837368 32108 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:20.836573 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:20.810999 32105 raft_consensus.cc:2410] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:20.840760   788 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:20.843104 31494 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:20.843951   811 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:20.805398   990 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.845419   990 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.842368   658 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:20.807835 32107 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:20.847918   927 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:20.848047 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.818576   993 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:20.849128   993 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.849656 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.813720   625 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.850926   914 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:20.851430   914 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.851871   914 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.857805  1058 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:20.858464  1058 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:20.730971   770 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:22:20.889998 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64574.2us
I20260709 12:22:20.840731 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.903090 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.829129 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:20.913365 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:20.910089   776 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:22:20.906035   625 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:20.920432 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.822750  1001 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:22:20.928735 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.952924 31420 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:20.930402 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.955262 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.955967 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:20.909467 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:20.964309 31422 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:20.912348 31492 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:20.836449   992 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:20.936604 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.968617 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59230.7us
I20260709 12:22:20.969579 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:20.919608 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.423060 31493 rpcz_store.cc:276] 0709 12:22:18.858370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.859816 (+  1446us) service_pool.cc:224] Handling call
0709 12:22:19.983834 (+1124018us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663ef8c 00007fc11663eef6 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:19.983974 (+   140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.243403 (+259429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.243450 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.244004 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.356247 (+112243us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.356298 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.358413 (+  2115us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400024ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:20.358465 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.358522 (+    57us) raft_consensus.cc:1685] finished
0709 12:22:20.358548 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.358740 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":454,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":611998848,"thread_start_us":111789,"threads_started":1,"wal-append.queue_time_us":112157}
I20260709 12:22:20.957065 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.951534   959 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.984176 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.960132   916 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:20.977630 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:20.981732 31423 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
W20260709 12:22:21.002717 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.994285 31568 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:20.967833   789 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.013969 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:20.970937   965 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:20.978274   956 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:21.007731   997 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.558s	user 0.003s	sys 0.018s
I20260709 12:22:21.015384 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2284) took 2535 ms. Trace:
I20260709 12:22:21.085142   965 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.006666   994 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:21.085770 31416 rpcz_store.cc:276] 0709 12:22:18.479573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.484990 (+  5417us) service_pool.cc:224] Handling call
0709 12:22:19.984305 (+1499315us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:19.984441 (+   136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.370827 (+386386us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:20.421213 (+ 50386us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.791317 (+370104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.826010 (+ 34693us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.826152 (+   142us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.826193 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.826283 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.015062 (+188779us) raft_consensus.cc:1685] finished
0709 12:22:21.015170 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.015323 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6840,"prepare.queue_time_us":26329,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":32,"raft.queue_time_us":97050,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":7358,"spinlock_wait_cycles":39674752,"thread_start_us":668536,"threads_started":2,"wal-append.queue_time_us":554014}
I20260709 12:22:21.087569   965 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.023419 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.088310 32106 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:21.089345 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.089985 32106 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:21.090906 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.024418 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.025296 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.034409 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.093638   840 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.046406 31498 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:21.010190   959 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.006932   844 raft_consensus.cc:2764] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:21.102301   503 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.020416  1050 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.003672  1042 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.103816 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.036197   956 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.105196   956 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:21.107995 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138521us
I20260709 12:22:21.115069 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.116067 31571 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:21.114131 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.120132 31568 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:21.120855 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 353) took 1527 ms. Trace:
I20260709 12:22:21.123034 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1109) took 1095 ms. Trace:
I20260709 12:22:21.123451 31495 rpcz_store.cc:276] 0709 12:22:20.027313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.092105 (+1064792us) service_pool.cc:224] Handling call
0709 12:22:21.122553 (+ 30448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.122720 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.122744 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.122778 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.122805 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.122851 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.122936 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.124668 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.125715 31495 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:21.135946 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:21.183085 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:21.187582 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 51742.5us
I20260709 12:22:21.160899 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.163095 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.121335 31565 rpcz_store.cc:276] 0709 12:22:19.593919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.162130 (+568211us) service_pool.cc:224] Handling call
0709 12:22:20.162370 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.162543 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:20.690270 (+527727us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.120455 (+430185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.120519 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.120576 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.120656 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.120791 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221002,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1799,"thread_start_us":818354,"threads_started":2}
I20260709 12:22:21.195878 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.196491 31495 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:21.197299 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.197805 31495 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:21.198751 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.201788 31495 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:21.037539   789 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:21.138878   840 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.193169   965 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:21.204852   946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.044s
I20260709 12:22:21.195688   916 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:21.196679  1042 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.201175 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:21.254597 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 53529.5us
I20260709 12:22:21.229219  1017 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.205854 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.150880   997 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.231566 31493 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:21.215638   811 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.210139 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.272395 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:21.256829 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.213920  1058 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.283707 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:21.253747   916 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:21.297421 32109 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:21.280655 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:21.218163   789 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.274979  1017 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.279332 31567 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:21.317306 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.011s	sys 0.011s
I20260709 12:22:21.301880  1058 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:21.269405  1042 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.254710   965 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:21.323640 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.011s	sys 0.012s
W20260709 12:22:21.324277 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 501915us
I20260709 12:22:21.304257   916 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:21.327788 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 531420us
I20260709 12:22:21.324991 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 345) took 1004 ms. Trace:
I20260709 12:22:21.291312   811 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.332320  1074 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.332803  1074 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:21.333196  1074 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:21.333604  1059 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:22:21.316499  1001 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:21.329573 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.351756 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:21.367801 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.325522   824 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:21.371066 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 87443.8us
I20260709 12:22:21.313779  1017 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.385370 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.386713   950 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:21.387373   950 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:21.388582   950 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:21.377918 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.373840   519 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:21.321938  1072 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:22:21.378008   876 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.377429  1073 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.418835  1073 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:21.372915   824 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.419198   965 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.419791   824 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:21.420496  1065 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:21.396057 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.371039  1076 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.423225  1076 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:21.423557  1076 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:21.423622  1084 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:21.423771   914 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.002s
I20260709 12:22:21.424575 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1115) took 1254 ms. Trace:
I20260709 12:22:21.425042 31497 rpcz_store.cc:276] 0709 12:22:20.169721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.092718 (+922997us) service_pool.cc:224] Handling call
0709 12:22:21.118515 (+ 25797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.118930 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.118984 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.119480 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.311508 (+192028us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:21.311548 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.311612 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.424329 (+112717us) raft_consensus.cc:1685] finished
0709 12:22:21.424352 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.424507 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15313,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":18120,"thread_start_us":191203,"threads_started":1,"wal-append.queue_time_us":278648}
I20260709 12:22:21.428248 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:21.403968   959 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:21.393718   909 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.012s
I20260709 12:22:21.435185  1017 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.434908   909 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.435732  1017 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.436211  1017 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:21.432646   903 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.762s	user 0.005s	sys 0.008s
W20260709 12:22:21.392000   778 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.663s	user 0.016s	sys 0.006s
I20260709 12:22:21.437244   903 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.437484   778 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.438277  1017 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:21.417565   586 consensus_meta.cc:287] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.008s
I20260709 12:22:21.399184  1042 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:21.436147  1019 consensus_meta.cc:287] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.004s
I20260709 12:22:21.443471   965 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:21.458051   965 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:21.457871  1019 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.458956   965 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.460062  1019 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.399225   811 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.439388   903 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.439648   778 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.439920   789 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:21.463410   907 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.008s
I20260709 12:22:21.463798   907 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.464793 31574 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:21.464540   586 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.440128 31569 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:21.440536 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 349) took 1112 ms. Trace:
W20260709 12:22:21.467377   993 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.006s
I20260709 12:22:21.441437  1076 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.440748   997 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.416544  1072 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.469151  1072 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.469595  1072 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.442310 31500 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:21.466938   907 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.372584  1001 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.396745   519 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:21.444850 31497 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:22:21.450286 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.452561 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.454748 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.419262  1073 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.437249   909 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.463119  1084 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:21.468374  1076 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.475370 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1168) took 1064 ms. Trace:
I20260709 12:22:21.476044 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 1.
I20260709 12:22:21.484787  1001 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.486832 31497 rpcz_store.cc:276] 0709 12:22:20.410766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.429834 (+1019068us) service_pool.cc:224] Handling call
0709 12:22:21.430209 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.475035 (+ 44826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.475302 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:21.477809 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 144883us
I20260709 12:22:21.453902 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:21.458058   990 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 12:22:21.467504 31493 rpcz_store.cc:276] 0709 12:22:20.328305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.322360 (+994055us) service_pool.cc:224] Handling call
0709 12:22:21.381216 (+ 58856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.396084 (+ 14868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.397436 (+  1352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.424715 (+ 27279us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.440230 (+ 15515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.440327 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.440457 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.438359   956 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.487526 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.503165 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:21.504598 31493 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:21.505317 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1171) took 1080 ms. Trace:
I20260709 12:22:21.504083   990 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.505676 31493 rpcz_store.cc:276] 0709 12:22:20.424522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.503979 (+1079457us) service_pool.cc:224] Handling call
0709 12:22:21.504337 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.505033 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.505257 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.507248   586 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.501784 31497 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:21.507355 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2312) took 1002 ms. Trace:
I20260709 12:22:21.509300 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1170) took 1086 ms. Trace:
I20260709 12:22:21.509068 31418 rpcz_store.cc:276] 0709 12:22:20.504827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.514713 (+  9886us) service_pool.cc:224] Handling call
0709 12:22:21.507184 (+992471us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400147b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:21.507295 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410592000}
I20260709 12:22:21.510113 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1185) took 1081 ms. Trace:
I20260709 12:22:21.503645 31572 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:21.511934 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.510582 31566 rpcz_store.cc:276] 0709 12:22:20.428649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.428768 (+   119us) service_pool.cc:224] Handling call
0709 12:22:20.434050 (+  5282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:20.467716 (+ 33666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.467749 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:20.468878 (+  1129us) log.cc:844] Serialized 539 byte log entry
0709 12:22:20.701486 (+232608us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.809782 (+108296us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.821540 (+ 11758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.505504 (+683964us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b18001cbd60. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:22:21.506472 (+   968us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400318b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:21.506523 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.506572 (+    49us) raft_consensus.cc:1685] finished
0709 12:22:21.506589 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.510050 (+  3461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11495,"raft.queue_time_us":13522,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":177,"spinlock_wait_cycles":147467392,"thread_start_us":232148,"threads_started":1,"wal-append.queue_time_us":547778}
I20260709 12:22:21.513753 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.514730 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:21.483935 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:21.508615   770 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.009s
I20260709 12:22:21.432921   914 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:21.531623   914 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.533114 31573 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3.
I20260709 12:22:21.485677 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:21.585915  1077 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.586423  1077 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.467839   993 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:21.594787 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 77826.6us
W20260709 12:22:21.594359 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69042.1us
I20260709 12:22:21.509792 31497 rpcz_store.cc:276] 0709 12:22:20.423037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.501214 (+1078177us) service_pool.cc:224] Handling call
0709 12:22:21.501559 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.509020 (+  7461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.509249 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.607915 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.608214 31540 leader_election.cc:400] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:21.608723 31540 leader_election.cc:403] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:21.608805 31497 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:21.609599 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.609731 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1173) took 1170 ms. Trace:
W20260709 12:22:21.610437 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 153734us
I20260709 12:22:21.610278 31497 rpcz_store.cc:276] 0709 12:22:20.438916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.608041 (+1169125us) service_pool.cc:224] Handling call
0709 12:22:21.608501 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.609391 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.609660 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.613778 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.474640   519 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.705425 31571 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:21.594623   914 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:21.708293 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90887.7us
I20260709 12:22:21.596374  1077 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:21.710333 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96645.4us
I20260709 12:22:21.716233 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.710542 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:21.518728  1074 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.708036 32106 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:21.613505   909 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.703470   789 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.667085   907 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.720896 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:21.735095 32110 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.035s
W20260709 12:22:21.735704 32110 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.035s
I20260709 12:22:21.722330   586 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:21.701987   959 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.720312  1019 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.719825 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.705813   916 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.724102   519 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:21.721436 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.717661   811 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.745630 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:21.748878 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.731182 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:21.754284 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.757570 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.758188 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:21.763388  1088 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:22:21.764858   950 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:21.765538   950 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.767282   990 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.735225   789 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.773195   789 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.775660 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.776748 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2174) took 2684 ms. Trace:
I20260709 12:22:21.721603   914 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.781584   914 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.744989   959 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.782099   959 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.783129  1069 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.783546   916 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.784788 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.785353 31418 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.777109 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.754181 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.792420 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:21.777140 31570 rpcz_store.cc:276] 0709 12:22:19.092242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.145457 (+1053215us) service_pool.cc:224] Handling call
0709 12:22:20.145726 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.146089 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:20.409355 (+263266us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.273397 (+864042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.279668 (+  6271us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.280226 (+   558us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:21.280271 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.280365 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.776535 (+496170us) raft_consensus.cc:1685] finished
0709 12:22:21.776554 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.776681 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155547,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":356023,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":42609,"thread_start_us":1031641,"threads_started":3,"wal-append.queue_time_us":1286291}
I20260709 12:22:21.742832  1017 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:21.806928 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 48848.2us
W20260709 12:22:21.807339 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.803483 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1185) took 1361 ms. Trace:
I20260709 12:22:21.807942 31500 rpcz_store.cc:276] 0709 12:22:20.441958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.665724 (+223766us) service_pool.cc:224] Handling call
0709 12:22:21.803287 (+1137563us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540007e9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:21.803424 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626374016}
I20260709 12:22:21.809819 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1125) took 1035 ms. Trace:
W20260709 12:22:21.809957 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55850.9us
I20260709 12:22:21.811280 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 491) took 1041 ms. Trace:
I20260709 12:22:21.811684 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:21.810181 31500 rpcz_store.cc:276] 0709 12:22:20.774540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.809024 (+1034484us) service_pool.cc:224] Handling call
0709 12:22:21.809329 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.809518 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.809545 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.809583 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:21.809615 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.809667 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.809764 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.817539 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1127) took 1026 ms. Trace:
I20260709 12:22:21.817850 31500 rpcz_store.cc:276] 0709 12:22:20.791340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.816823 (+1025483us) service_pool.cc:224] Handling call
0709 12:22:21.817192 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.817330 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.817345 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.817371 (+    26us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:21.817391 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.817424 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.817494 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.819145 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:21.820627 31496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1119) took 1594 ms (client timeout 1918 ms). Trace:
W20260709 12:22:21.821275 31496 rpcz_store.cc:269] 0709 12:22:20.226242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.232399 (+  6157us) service_pool.cc:224] Handling call
0709 12:22:21.820407 (+1588008us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400276fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:21.820565 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700918528}
I20260709 12:22:21.811652 32114 rpcz_store.cc:276] 0709 12:22:20.770115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.770250 (+   135us) service_pool.cc:224] Handling call
0709 12:22:20.840926 (+ 70676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.841133 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:21.216475 (+375342us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.327637 (+111162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.327686 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:21.327737 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.327799 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.811123 (+483324us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b5400425ed0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:21.811222 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":467264,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1436,"raft.run_cpu_time_us":2689,"raft.run_wall_time_us":21920,"spinlock_wait_cycles":189794048,"thread_start_us":485171,"threads_started":2,"wal-append.queue_time_us":180482}
I20260709 12:22:21.823776 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:21.798446  1078 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:22:21.799094  1090 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:21.799494 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.828162 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.801468 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1124) took 1110 ms. Trace:
I20260709 12:22:21.813273   946 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.788465   811 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.799770   907 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:21.795015  1019 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:21.753409  1087 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.835916 31418 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:21.837416 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.839586 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.782094   914 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.797684   789 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:22:21.820499  1069 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.825609   965 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.823678   916 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:21.847435 31423 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:21.849839 31496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:21.848258  1087 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.843550   907 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.841023   956 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.843227   778 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.852572   950 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:21.854456  1074 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.830166   993 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:21.855002 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61026.4us
I20260709 12:22:21.855149 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:21.798175  1072 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.842857 31493 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:21.797780  1017 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:21.820184   824 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.843050 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.874656 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 399) took 1038 ms. Trace:
I20260709 12:22:21.846244   927 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.862072  1087 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.877622 31496 raft_consensus.cc:606] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:21.878060 31496 raft_consensus.cc:614] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:21.840507 31494 rpcz_store.cc:276] 0709 12:22:20.773310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.829901 (+ 56591us) service_pool.cc:224] Handling call
0709 12:22:21.801292 (+971391us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b540007e4d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:21.801405 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28172160}
I20260709 12:22:21.871100 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.861234   916 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:21.866709   907 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.851130 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:21.858484  1073 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.880484 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:21.886031 31567 raft_consensus.cc:2368] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3.
I20260709 12:22:21.886456  1072 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.887180  1073 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.887915 31572 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:21.883275  1074 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.878237   927 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.893163   927 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.868674   778 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.876691 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:21.900203 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.899520 32113 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:21.900900 31416 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:21.901917 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.903780 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.905085 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.905953 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.906291 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.906754 31420 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.905278 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.883414   916 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.914810 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.918553 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.930342 31422 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.918270 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.915179 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:21.917081 31418 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:21.934360 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:21.935971 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.938226 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:21.939604 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82037.8us
W20260709 12:22:21.940877 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.915587   946 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.957587 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.929476  1099 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:21.945196 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:21.928799   950 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.947983 31420 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:21.931354   909 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:21.963572  1099 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.969686  1099 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.965865   993 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:21.970723   993 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:21.971210   993 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.931977  1017 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:21.974790   811 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.964934  1102 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:21.978201  1017 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.978672  1017 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:21.979735  1017 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.981472  1017 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.981699   778 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:21.941781   625 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.986943   625 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.987294   625 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.987454   824 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:21.939883  1096 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:22:21.932529 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:21.988812 31415 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.992201  1077 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:21.940246   970 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:21.999495 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 393) took 1216 ms. Trace:
I20260709 12:22:22.000018 32112 rpcz_store.cc:276] 0709 12:22:20.782951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.783090 (+   139us) service_pool.cc:224] Handling call
0709 12:22:20.801692 (+ 18602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.803146 (+  1454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.803180 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.803219 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.803246 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.999206 (+1195960us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b540049e654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:21.999264 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.999411 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2914560}
I20260709 12:22:21.932992 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:21.939160   965 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:22.072284 31494 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:21.957495   946 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.034512 31418 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:22:22.037228 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 73938.2us
I20260709 12:22:22.079576 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:22.076238   778 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.121414   778 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.073503   965 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.123693   965 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.124300 31415 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:22.116986   946 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.134836 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.135938 31494 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:22.127701  1099 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:22.026069 31422 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:21.980754   959 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.180495 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.171789   778 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.172611 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.137244  1077 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:22.139478  1099 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:22.123076  1076 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.002s
I20260709 12:22:22.196959   789 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.216575   789 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.217724   959 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.209040   625 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.210114 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.212097 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.224802   946 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.224766 31494 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:22.226440 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.227696 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.224162   789 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.229112 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.231465 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.213164   986 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:22.215011 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:22.269747 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54840.8us
I20260709 12:22:22.230540   625 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.174171   916 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:22.241724 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.264215 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1172) took 1831 ms. Trace:
W20260709 12:22:22.265355 31491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1187) took 1822 ms (client timeout 2215 ms). Trace:
I20260709 12:22:22.267967 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.233330 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.242537 31570 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:22.218946  1099 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.275133   986 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:22.275892  1087 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.278087 31568 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:22.232364   907 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.286485 31390 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:22.288651 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:22.294001 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.274154   625 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:22.280928 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.283051 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:22.299386 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 279519us
I20260709 12:22:22.279332 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:22.277315 31491 rpcz_store.cc:269] 0709 12:22:20.442605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.609452 (+166847us) service_pool.cc:224] Handling call
0709 12:22:22.265089 (+1655637us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54002e7f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.265272 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713947392}
I20260709 12:22:22.289813 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:22.294878 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 111571us
I20260709 12:22:22.299764 31568 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:22.279997 31566 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:22.302882 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.303529 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.285986   916 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.318706 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.307279 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:22.308079 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.304745 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.323522 31568 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.298154   959 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:22.313378 31566 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:22.303764   824 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:22.328539 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.322958 31570 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:22.329344   824 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.329869   824 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.330621 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.332412 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.334025 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.335568 31570 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:22.293573   992 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:22.337240 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.303941   625 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:22.337817 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.323159   927 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:22.340590 31570 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:22.342360 31566 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:22.318461 31494 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:22.326243   519 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:22.343972 31568 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:22.346204 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:22.341732  1058 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.013s	sys 0.015s
I20260709 12:22:22.346515 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.326733  1087 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.347496   625 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.343621   916 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.344463 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.304189   965 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.355855 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:22.356890 31570 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:22.340975   993 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.345782 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.337921   959 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:22.356047 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.365373 31565 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.344995   927 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:22.434554 31568 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 1.
I20260709 12:22:22.436002 31566 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.371613 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:22.436900 31568 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:22.437042 31540 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 2.013s (SENT) [suppressed 5 similar messages]
I20260709 12:22:22.359390 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:22.438055 31570 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 2.
I20260709 12:22:22.349325   519 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:22.396946  1058 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.018s
I20260709 12:22:22.345937  1076 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:22.359047  1102 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:22.360025   789 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:22.369469   946 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.363380   907 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:22.439584   927 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.439126  1017 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:22.355074  1074 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:22:22.443445  1058 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:22.448697  1076 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:22.449913  1102 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:22.450953  1115 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:22.459903  1115 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.460852  1102 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.461781  1099 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.441165 31568 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.440924 31570 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:22.450747   824 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:22.508986 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 206622us
I20260709 12:22:22.543674 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1209) took 1089 ms. Trace:
I20260709 12:22:22.610105 31572 rpcz_store.cc:276] 0709 12:22:21.481077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.515698 (+ 34621us) service_pool.cc:224] Handling call
0709 12:22:21.594064 (+ 78366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.888340 (+294276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.542954 (+654614us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002620d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:22.543330 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675338624}
I20260709 12:22:22.274389 31493 rpcz_store.cc:276] 0709 12:22:20.433041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.506576 (+1073535us) service_pool.cc:224] Handling call
0709 12:22:21.823590 (+317014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.874455 (+ 50865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.263882 (+389427us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400276fd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.264121 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722029312}
W20260709 12:22:22.507805 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 205370us
I20260709 12:22:22.541399 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 348) took 2215 ms. Trace:
W20260709 12:22:22.536330 31499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1179) took 2095 ms (client timeout 2013 ms). Trace:
I20260709 12:22:22.361732   916 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:22.521224 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.462867  1115 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.617184 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 488) took 1944 ms. Trace:
I20260709 12:22:22.452656   959 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.617657 32109 rpcz_store.cc:276] 0709 12:22:20.672688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.672909 (+   221us) service_pool.cc:224] Handling call
0709 12:22:20.907054 (+234145us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:20.907287 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.303074 (+395787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.616405 (+1313331us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54003f8c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:22.616852 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902524160}
I20260709 12:22:22.523543 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.548743   993 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.453959  1017 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.443234   519 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.521015 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.625490 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.626375 31494 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:22.460954  1076 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:22.571364  1058 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.628749   986 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.629421   789 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:22.612159 31499 rpcz_store.cc:269] 0709 12:22:20.440470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.610781 (+170311us) service_pool.cc:224] Handling call
0709 12:22:22.535786 (+1925005us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002e6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.536065 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517387520}
I20260709 12:22:22.631282   789 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.633311 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.634071 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:22.614483 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.635674 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:22.636094 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.635841 31493 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:22.637023   877 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:22.637440 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.611805 31495 rpcz_store.cc:276] 0709 12:22:20.325817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.213423 (+887606us) service_pool.cc:224] Handling call
0709 12:22:22.538966 (+1325543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.539606 (+   640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.539638 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.539715 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:22.539763 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.539910 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.540980 (+  1070us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002e6150. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.541134 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3047631232}
I20260709 12:22:22.638561 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1203) took 1206 ms. Trace:
I20260709 12:22:22.637501   877 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:22.639346   877 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.639573 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.640614 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1204) took 1194 ms. Trace:
I20260709 12:22:22.621661 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 392) took 1839 ms. Trace:
I20260709 12:22:22.595916  1113 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.642817 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 368) took 1803 ms. Trace:
I20260709 12:22:22.621906 31491 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.638255   956 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:22.640666 31495 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.648856  1099 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.647239   956 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.649494   956 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.647958  1113 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.643237 31569 rpcz_store.cc:276] 0709 12:22:20.839578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.839724 (+   146us) service_pool.cc:224] Handling call
0709 12:22:20.889520 (+ 49796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.467209 (+577689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.642322 (+1175113us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54003dbdd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:22.642604 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265825152}
I20260709 12:22:22.602996 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.654522  1017 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.639217 31567 rpcz_store.cc:276] 0709 12:22:21.445896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.449538 (+  3642us) service_pool.cc:224] Handling call
0709 12:22:22.637674 (+1188136us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400260cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.638254 (+   580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672344320}
W20260709 12:22:22.657750 32106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 400) took 1821 ms (client timeout 2239 ms). Trace:
W20260709 12:22:22.658321 32106 rpcz_store.cc:269] 0709 12:22:20.836246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.090644 (+254398us) service_pool.cc:224] Handling call
0709 12:22:22.657180 (+1566536us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400241b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.657496 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036350848}
I20260709 12:22:22.659351  1113 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.660218  1113 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:22.661651   824 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.662992  1113 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:22.664551  1113 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.641288 31571 rpcz_store.cc:276] 0709 12:22:21.446354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.448868 (+  2514us) service_pool.cc:224] Handling call
0709 12:22:22.640115 (+1191247us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001a6654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.640401 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524386560}
I20260709 12:22:22.638850 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:22.674868 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 237741us
I20260709 12:22:22.675467   965 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.643860   916 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.640058 31565 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:22:22.694100 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 170941us
I20260709 12:22:22.671505 31493 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:22.699924 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 136924us
I20260709 12:22:22.641542 32108 rpcz_store.cc:276] 0709 12:22:20.782570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.786233 (+  3663us) service_pool.cc:224] Handling call
0709 12:22:20.837169 (+ 50936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.838812 (+  1643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.621022 (+1782210us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b54006be9d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.621406 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6755200}
W20260709 12:22:22.701694 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64748us
I20260709 12:22:22.708842 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.712162   962 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.713225   916 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:22.712661   877 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.713708   916 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:22.714133   916 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.715190 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:22.716748   927 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:22.723665 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 104664us
I20260709 12:22:22.725623   962 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:22.726172 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.728324 31571 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.728945   877 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.726122   962 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.730044   962 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.732100 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.734839 31571 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.736071   877 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:22.746758 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.748539 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.748688 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.749399 31420 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:22.750205 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.751349 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.752203 31424 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:22.752534  1115 raft_consensus.cc:2764] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:22:22.742175   877 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:22.753064   877 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:22.756458 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.759910 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.760074 31422 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.760948 31571 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:22.790390 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.791191 31420 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:22.791661 31424 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:22.763562  1029 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.761492 32106 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEARNER]: Advancing to term 5
I20260709 12:22:22.798141 31494 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:22.799582 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.800987 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:22.802349 32109 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:22.759775 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.803526 31420 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:22.766209 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:22.762780  1018 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:22.812081 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.812081 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:22.812928   927 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.813855 31495 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:22.827792  1115 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.829464 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.830096 32106 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:22.758486 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:22.839406 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75002.2us
I20260709 12:22:22.768265 31491 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:22.758977   986 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:22.845722 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46394.4us
I20260709 12:22:22.851435 31422 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:22.847961 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.839061  1018 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:22.757126   877 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.850289   824 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:22.860267 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.860479 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.861634 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.861757 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:22.862353  1101 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.742s	user 0.001s	sys 0.000s
I20260709 12:22:22.862493 31419 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:22.862833 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:22.863193  1029 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:22.863306 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:22.863520 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:22.864264  1112 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.518s	user 0.000s	sys 0.000s
I20260709 12:22:22.864728 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.864929  1126 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:22.865689 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:22.852164 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.857889   824 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:22.854063 31416 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.873906 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:22.875541 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.329573 31498 rpcz_store.cc:276] 0709 12:22:20.320507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.184000 (+863493us) service_pool.cc:224] Handling call
0709 12:22:21.184280 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.184482 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:21.195299 (+ 10817us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.324495 (+129196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.324570 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:21.324677 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.324768 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.324934 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12276,"prepare.queue_time_us":11062,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":8041,"thread_start_us":126999,"threads_started":1}
I20260709 12:22:22.887565  1113 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.897146 31498 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:22.897904 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:22.882635 31567 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:22.884066 31494 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.900658 31492 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:22.900976 31494 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:22.903553 32111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 611) took 2279 ms (client timeout 1727 ms). Trace:
W20260709 12:22:22.904021 32111 rpcz_store.cc:269] 0709 12:22:20.624408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.624749 (+   341us) service_pool.cc:224] Handling call
0709 12:22:22.903112 (+2278363us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54005c94d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.903293 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334724864}
I20260709 12:22:22.891461  1018 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:22.911914  1018 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:22.916801 31573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1207) took 1462 ms (client timeout 1845 ms). Trace:
W20260709 12:22:22.917339 31573 rpcz_store.cc:269] 0709 12:22:21.453758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.502920 (+ 49162us) service_pool.cc:224] Handling call
0709 12:22:22.916282 (+1413362us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54001964d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.916600 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61292416}
I20260709 12:22:22.891878   824 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:22.892815 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.888127 32109 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:22.898494 31498 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:22.870661 31493 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:22.890026 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.920953 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:22.925967 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:22.927424   791 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.927767  1126 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:22.928216  1126 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:22.928077   791 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.929306   998 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:22.929512  1126 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.930723   998 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:21.877554 32110 rpcz_store.cc:276] 0709 12:22:20.835958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.211716 (+375758us) service_pool.cc:224] Handling call
0709 12:22:21.212047 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.212284 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:21.736225 (+523941us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.873365 (+137140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.873437 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:21.873508 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.874421 (+   913us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.874581 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96319,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":357,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3340,"thread_start_us":633649,"threads_started":2}
I20260709 12:22:22.932175   998 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.933961   998 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.862527 31415 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:22.949925 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.938949   519 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.940961 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:22.941516   916 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:22.883569   789 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:22.955772   789 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.958271   789 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:22.944208  1126 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.890816   927 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.945245   877 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.960585 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2314) took 1140 ms. Trace:
I20260709 12:22:22.961011 31423 rpcz_store.cc:276] 0709 12:22:21.820111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.829076 (+  8965us) service_pool.cc:224] Handling call
0709 12:22:21.847264 (+ 18188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.861419 (+ 14155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.960158 (+1098739us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54003e8d50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:22.960393 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31091072}
I20260709 12:22:22.964201 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:22.944883 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55063.5us
I20260709 12:22:22.946062 31420 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
W20260709 12:22:22.946332 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48529.9us
I20260709 12:22:22.946611  1017 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:22.947136   665 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:22.948468 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:22.950934 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 357) took 1761 ms. Trace:
W20260709 12:22:22.952739  1085 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 1.538s	user 0.003s	sys 0.011s
W20260709 12:22:22.952931  1091 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.189s	user 0.003s	sys 0.015s
I20260709 12:22:22.938380 31422 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:22.972431 31495 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:22.973980 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2316) took 1149 ms. Trace:
I20260709 12:22:22.975358   503 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.978900 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:22.978971 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:22.994962   916 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:22.996320  1102 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:22.981192  1017 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:22.998659  1017 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.000964   994 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:22.954581   956 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:22.980064 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:23.002851 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.003022   994 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.003541   956 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.004031   994 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.004012  1099 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.004730   994 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:22.983409   665 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.015682 31416 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:22.987247   844 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.019304 31499 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:23.007232   503 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.026939   962 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.030236   962 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.033226   665 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.031397   994 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.039672   994 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:23.038101 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 147561us
I20260709 12:22:22.986979 31417 rpcz_store.cc:276] 0709 12:22:21.824507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.826613 (+  2106us) service_pool.cc:224] Handling call
0709 12:22:22.963875 (+1137262us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:22.973877 (+ 10002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11158784}
I20260709 12:22:22.983739 31500 rpcz_store.cc:276] 0709 12:22:21.189653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.819697 (+630044us) service_pool.cc:224] Handling call
0709 12:22:21.819922 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.840268 (+ 20346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.840298 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.843583 (+  3285us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.936523 (+ 92940us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:22.323331 (+386808us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.327100 (+  3769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.327183 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.861604 (+534421us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:22.948745 (+ 87141us) raft_consensus.cc:1685] finished
0709 12:22:22.950576 (+  1831us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.950773 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23412,"prepare.queue_time_us":420268,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":23652,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":18551,"spinlock_wait_cycles":12420480,"thread_start_us":453750,"threads_started":2,"wal-append.queue_time_us":233951}
I20260709 12:22:23.056006 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.057124  1120 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.057648 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.058486  1120 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.043435 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:23.005237  1099 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.066224 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 72918us
W20260709 12:22:23.069775 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 121406us
I20260709 12:22:23.013571   791 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:23.076406 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.077425  1069 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.077934  1069 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.078333  1069 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.079330 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:23.080886 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:23.081198  1068 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:23.083953   998 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:23.084540   998 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.087838 31415 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:23.092128  1099 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:23.094945   998 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:23.096175   986 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.100098  1089 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.100221   778 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.101977  1068 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.094431  1099 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:23.103897  1068 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:23.105556  1068 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.107921 31424 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:23.109416   824 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.109941  1068 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.114058  1115 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:23.114784 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:23.116151 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2315) took 1292 ms. Trace:
I20260709 12:22:23.116365   986 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.116859   986 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.116712 31421 rpcz_store.cc:276] 0709 12:22:21.824211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.824353 (+   142us) service_pool.cc:224] Handling call
0709 12:22:23.114427 (+1290074us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663ee9c 00007fc11663ea5b 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:23.116070 (+  1643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5723648}
I20260709 12:22:23.117918   986 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.119575   986 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.120930 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.122797 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.123136 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.124418 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 363) took 2638 ms. Trace:
I20260709 12:22:23.124663 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.124977 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.126307 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.122361 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.127969 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.128877 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.128862 32106 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:23.124787 31574 rpcz_store.cc:276] 0709 12:22:20.485680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.653305 (+167625us) service_pool.cc:224] Handling call
0709 12:22:20.653589 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.465202 (+811613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.124003 (+1658801us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400058554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:23.124227 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865196288}
I20260709 12:22:23.132827 32110 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:23.137872  1110 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.138553  1110 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.139780  1069 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.141390  1110 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:23.142493   844 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.143148   844 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.143285 31424 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.145218 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.146169   824 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:23.146800 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 69690.8us
I20260709 12:22:23.148399 31421 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:22:23.148512   903 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:23.149318  1110 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.149588   903 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.150055  1110 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.150054   903 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:23.152207  1110 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:23.152791 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77473.9us
I20260709 12:22:23.153656 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.153298   903 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.154518   992 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:23.156044   903 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.156221 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.156493   992 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:23.157639   970 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.157977   992 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:23.158736   992 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:23.159425 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 78546us
I20260709 12:22:23.159893   992 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:23.152273 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 149532us
W20260709 12:22:23.187915 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.172878 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:23.203717 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.211582 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:23.212430 31573 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.212519   503 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:23.223654   503 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.223824 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:23.224009 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.225064   519 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:23.226248 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 72674.8us
I20260709 12:22:23.227958 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:23.232954 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.240178 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:23.246176 31318 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 3, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 3 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:22:23.281769 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.238899  1057 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:23.291890 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 119918us
I20260709 12:22:23.292541 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.292593 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:23.312721 31318 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.313489 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:23.291973 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:23.314643 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95010.9us
I20260709 12:22:23.314924  1069 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:23.315275 31499 raft_consensus.cc:2410] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:23.316509   998 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:23.316740 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.317672   811 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:23.317903 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:23.318064   811 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:23.318188   998 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.318504   811 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:23.318668   998 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:23.319094 31567 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.319828   998 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.321122   998 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.322975  1018 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:23.297652 31319 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 298) took 9067 ms. Trace:
I20260709 12:22:23.318737 31492 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:23.327536   970 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.328141  1116 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:23.328496   970 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.298748 31571 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:23.329118  1116 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:23.300302 32105 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:23.329739  1116 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.303198 32110 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:23.307775 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.310043 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.331413  1120 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.312831   665 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.328508   950 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.329160   970 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.332408  1120 consensus_queue.cc:1243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:23.333130   965 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:23.333599   965 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.333441   970 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.334825   965 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.337152  1116 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.302328 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.339776   986 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.306340 32111 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:23.340296   986 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:23.340927   986 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.341089 31498 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:23.341531 31500 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:23.343108 31498 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:23.345870 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.325229 31319 rpcz_store.cc:276] 0709 12:22:14.230263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.239318 (+  9055us) service_pool.cc:224] Handling call
0709 12:22:23.297443 (+9058125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:19.518135 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:19.912746 (+394611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:19.916329 (+  3583us) write_op.cc:435] Acquired schema lock
0709 12:22:20.001275 (+ 84946us) tablet.cc:662] Decoding operations
0709 12:22:20.013174 (+ 11899us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:20.013254 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:20.013287 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:20.013904 (+   617us) tablet.cc:701] Row locks acquired
0709 12:22:20.013955 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:22:20.014117 (+   162us) write_op.cc:270] Start()
0709 12:22:20.014231 (+   114us) write_op.cc:276] Timestamp: P: 1783599740014070 usec, L: 0
0709 12:22:20.014255 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:20.046409 (+ 32154us) log.cc:844] Serialized 3405 byte log entry
0709 12:22:20.625170 (+578761us) op_driver.cc:464] REPLICATION: finished
0709 12:22:21.285042 (+659872us) write_op.cc:301] APPLY: starting
0709 12:22:21.285154 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:21.285419 (+   265us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:21.285617 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:21.286760 (+  1143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:21.287050 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:21.287118 (+    68us) write_op.cc:312] APPLY: finished
0709 12:22:21.287438 (+   320us) log.cc:844] Serialized 65 byte log entry
0709 12:22:21.287598 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.287754 (+   156us) write_op.cc:454] Released schema lock
0709 12:22:21.287817 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:21.288556 (+   739us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:21.288597 (+    41us) write_op.cc:454] Released schema lock
0709 12:22:22.950148 (+1661551us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11976032a 00007fc1196e5f14 00007fc1196e5ec3 00007fc1196e5e38 00007fc1196e5df3 00007fc1196e50dc 00007fc11970ee16 00007fc1196f6cbb 00007fc1196e139d 00007fc1196e4d75
Metrics: {"mutex_wait_us":36986,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":659568,"apply.run_cpu_time_us":3169,"apply.run_wall_time_us":3474,"num_ops":8,"prepare.queue_time_us":296459,"prepare.run_cpu_time_us":33233,"prepare.run_wall_time_us":846243,"raft.queue_time_us":125129,"raft.run_cpu_time_us":62395,"raft.run_wall_time_us":2471061,"replication_time_us":504545,"spinlock_wait_cycles":52958976,"thread_start_us":966810,"threads_started":4,"wal-append.queue_time_us":292826,"wal-append.run_cpu_time_us":19302,"wal-append.run_wall_time_us":1978746}]]}
I20260709 12:22:23.327524 31318 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.361099 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1201) took 1451 ms. Trace:
I20260709 12:22:23.361548 31491 rpcz_store.cc:276] 0709 12:22:21.909989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.871696 (+961707us) service_pool.cc:224] Handling call
0709 12:22:22.903595 (+ 31899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.904712 (+  1117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.904780 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.984083 (+ 79303us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.104163 (+120080us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:23.236111 (+131948us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b1800064cc0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:23.255663 (+ 19552us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.351134 (+ 95471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.351242 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.351299 (+    57us) raft_consensus.cc:1685] finished
0709 12:22:23.351424 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.361036 (+  9612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50081,"prepare.queue_time_us":44006,"prepare.run_cpu_time_us":3044,"prepare.run_wall_time_us":81138,"raft.queue_time_us":50939,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":207,"spinlock_wait_cycles":12176640,"thread_start_us":44987,"threads_started":1,"wal-append.queue_time_us":184097}
I20260709 12:22:23.363852   927 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.363816   811 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.365604 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:23.366916 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.367748 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51086.3us
I20260709 12:22:23.297256 31497 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:23.369292 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67021.2us
W20260709 12:22:23.378166 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.338636  1116 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.363937   965 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.386648 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:23.388200 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.388612 31573 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:23.389147 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.393219 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:23.397893 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:23.395759 31500 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:23.400467 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.381515   778 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.381258   665 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.401286 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.383246   811 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:23.408195 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:23.426206 31569 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:23.393869 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.426091 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:23.435254 31420 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.412981 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.415570  1099 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:23.450932 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.423214 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.410081  1029 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:23.455194  1017 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.453598 31491 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:23.494117 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 143613us
I20260709 12:22:23.441761  1126 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:23.501379 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 118048us
I20260709 12:22:23.456405   970 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.502420 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.491045 31417 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:23.488767 31318 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 2, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.516746 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.435081   778 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.524159 31423 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:23.525175 31424 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:23.521209 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1121) took 2841 ms. Trace:
I20260709 12:22:23.532339   990 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:23.532646 31497 rpcz_store.cc:276] 0709 12:22:20.679655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.683743 (+1004088us) service_pool.cc:224] Handling call
0709 12:22:21.684150 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.384775 (+1700625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.513020 (+128245us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002e7054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:23.521150 (+  8130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3545478016}
I20260709 12:22:23.507699 32106 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:23.488021  1120 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:23.534672   839 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.510025   811 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.504011  1099 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:23.557090   994 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.006s
I20260709 12:22:23.512775   900 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.181s
I20260709 12:22:23.589118 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:23.560149 31318 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 3 to 4, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.513270   844 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.541435 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.556077 31567 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:23.556844 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162315us
I20260709 12:22:23.570135 32112 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:23.571053  1141 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:22:23.572194  1138 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.572633 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.573120   990 consensus_queue.cc:1243] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:23.561074 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:23.576007   839 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:23.598225 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57995.2us
I20260709 12:22:23.521238  1126 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.604363 31466 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.610396 31420 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:23.616416 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:23.607162  1120 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:23.597675  1138 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:23.609565  1089 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.627648  1120 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.636713 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.625430  1110 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:22:23.637306 31318 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 4 to 5, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 5 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.639778   773 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.649279   773 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:23.641134 31389 leader_election.cc:400] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3.
I20260709 12:22:23.651656  1152 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:23.643532 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.597537   986 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.644660 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:23.647275 31497 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.651288 31389 leader_election.cc:403] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:23.645845  1143 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:23.633019  1087 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.629554   927 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.643059  1069 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:22:23.646353  1089 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:23.655303  1146 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:22:23.651875 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.669239 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:23.671001 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.652231   519 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:22:23.678210 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.678442 31417 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:23.679783 32106 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:22:23.665956   903 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.680668 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.688637 32110 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.650619   773 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.659413  1087 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.667090  1089 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.682487 32109 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:23.691282 31420 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:23.668251   927 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:23.694548 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.693078 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:23.681953 31318 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.693264  1087 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.666325  1152 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.698916  1150 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:22:23.683763   950 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:22:23.720350 31318 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:23.726080 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55183.5us
I20260709 12:22:23.704931   903 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:23.708945   994 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.710546  1057 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.733163 31318 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.723141   844 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:23.731623  1018 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.737692 32106 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 1 LEARNER]: Advancing to term 3
I20260709 12:22:23.739043 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:23.739948 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:23.740931  1154 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:23.732666   994 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.741569   994 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.722385  1157 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3.
I20260709 12:22:23.742655  1149 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.743057  1149 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.743899  1149 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.746793   903 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:23.748378 32106 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:23.748955  1149 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.750797 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.731591  1099 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:23.753934 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.740859 32107 raft_consensus.cc:2376] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3. Re-sending same reply.
W20260709 12:22:23.752854 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 111904us
I20260709 12:22:23.740278 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:23.761571 31418 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:23.696779  1120 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.705125   839 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.759815 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.765933 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.739475  1150 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.781296 32113 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:23.755439  1018 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.791417 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.739622  1057 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.737977   927 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.762650   844 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:22:23.796368 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.844008 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:23.798972  1126 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.802772   959 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:22:23.803257   900 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:23.806103 32106 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:23.770891  1017 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.808058 32108 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:23.809006 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:23.858115 32113 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:23.814882  1138 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.819644  1152 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:23.786087   986 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:23.769019  1058 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:23.842180 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102237us
I20260709 12:22:23.829296 31389 leader_election.cc:400] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 2 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3.
I20260709 12:22:23.843827 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:23.794952  1120 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.852303 32110 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
W20260709 12:22:23.853835 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.823203  1150 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.809996  1099 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:23.777350   824 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:22:23.884725 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:23.890149 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 97418.3us
I20260709 12:22:23.885390 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:23.853025   900 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.853067 32106 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:23.902460 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:23.846624  1018 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.853024 32107 raft_consensus.cc:2376] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5. Re-sending same reply.
I20260709 12:22:23.899789  1068 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:23.894912 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:23.914079 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84417.9us
I20260709 12:22:23.897377 31415 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:23.901153 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:23.906425   811 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.926985   811 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:23.927974   811 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:23.928678   965 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:23.929049   965 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:23.929807   965 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:23.933243  1156 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:22:23.934199 31567 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:23.935683 32106 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.936705  1138 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.937240 32106 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.918419 31495 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.916109  1068 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:23.940737 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:23.911741  1162 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.941606  1162 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:23.941955  1162 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:23.943797  1142 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.451s	user 0.006s	sys 0.000s
I20260709 12:22:23.924261   778 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:23.940241  1068 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:23.946851 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.922494   900 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:23.895970   992 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:23.955067  1068 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:23.956889 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.966915 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:23.952527   965 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.976182 31495 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:23.977063 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:23.954074 31493 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.984760 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:23.983364 31492 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.991664   824 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:24.025735 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75439.8us
I20260709 12:22:24.027423  1158 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.027245   625 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:22:24.000195   970 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:22:24.034211   811 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:24.017786  1116 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.001s
I20260709 12:22:23.988373   950 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:22:24.000291 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.048611 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.038534  1158 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:24.061338 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 76649.4us
I20260709 12:22:24.061578  1170 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.062508  1170 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.064888 31420 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:24.065802 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.065943 32107 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:24.067802 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.068910 31492 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:24.074015 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.071313 31417 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:24.057747  1160 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:24.085091 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 131107us
W20260709 12:22:24.087040 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96946.2us
I20260709 12:22:24.091249 31420 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.091732  1116 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.098150 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.077901 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.056392  1057 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:24.064030  1158 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.101534  1018 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.101925 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.094041   959 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:22:24.107402 31419 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.107949 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.109326 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:24.093400 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:24.094965   927 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.126909 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.095538  1160 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:24.063566   811 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.100757  1116 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:24.113860 31500 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:24.139124 31496 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:24.139430 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.144243 31421 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:24.145422   927 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.145936  1171 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:24.146624 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.147483 32080 connection.cc:256] RPC call timeout handler was delayed by -1.3086633980001352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:22:24.147819   927 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:24.151019 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 86427.8us
I20260709 12:22:24.153035 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:24.153203  1087 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.134145  1018 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:24.154974  1160 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:24.156764 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.147894 32080 connection.cc:256] RPC call timeout handler was delayed by -1.3068633980001323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:22:24.157080 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.157343 32080 connection.cc:256] RPC call timeout handler was delayed by -1.0620633980001912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:22:24.158399 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.159165 31422 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:24.163360 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:24.136255 32106 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:24.136116  1170 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.142550 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.158241  1150 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:24.188293  1024 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:22:24.188562 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:24.189821   994 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.192293  1089 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.156348  1160 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.182076   927 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:24.155038  1018 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.222040 31423 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:24.223448 31571 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:24.184199   839 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:24.230106 31499 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.177755  1099 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:22:24.176214  1171 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:22:24.246060 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 150083us
I20260709 12:22:24.247994 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:24.245669 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57239.7us
I20260709 12:22:24.222829   998 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.225492   927 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.243283   839 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.225401  1170 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:24.250923  1176 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:22:24.278242 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.278858 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:24.261279   998 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:24.284196   998 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.284587   994 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.272187   927 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:24.223969  1116 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.294507  1177 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.296294  1029 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.297030  1180 raft_consensus.cc:2764] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:24.297046  1115 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:24.286538   811 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.300655  1087 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.275131  1138 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:24.289387  1170 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:24.297173  1163 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.386s	user 0.000s	sys 0.003s
I20260709 12:22:24.324316   992 raft_consensus.cc:1064] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:22:24.324807   992 raft_consensus.cc:1068] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Unable to promote non-voter e166c1cb41f04d55a85e6c0d7966e32e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:24.299508  1017 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.299117 31493 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:24.335510 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.336711 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65759.3us
I20260709 12:22:24.304677  1177 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.350529  1089 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.351356  1177 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.352064  1116 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.334085  1162 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.357369  1170 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.346479  1164 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:24.361117  1164 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.361974   900 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.363286  1164 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.341368  1115 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.368729  1115 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.330103  1017 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:24.373183 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.302947  1158 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:24.378496 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97335.5us
I20260709 12:22:24.381812 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.386415 31421 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:24.386814 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.387198 31422 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:22:24.388654 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:24.388756 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.389178 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.389541 31419 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:24.390399 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.392105 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.393045 31494 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:24.393131 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.393368 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.393831 31418 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:24.393987 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.391171 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.391873 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.394516 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:24.393141  1177 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:24.393993 31498 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
W20260709 12:22:24.405135 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55684.9us
I20260709 12:22:24.406049 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.409294  1017 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.411441 31420 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:24.415416 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.395243 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.416095 31491 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.418879 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.419821 32108 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:24.420832 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.421654 31492 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.411118  1150 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 12:22:24.424554 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.401502  1149 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.442394 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:24.441972  1186 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.449783  1087 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:24.449908  1186 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.450404  1087 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.452472  1186 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.452514  1087 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.454125 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.454284 31422 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:24.454826 31498 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:24.455724 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:24.402252  1068 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:24.431715  1017 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.465457 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:24.398998  1177 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.429879   992 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:22:24.477880  1018 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.481530  1057 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.483600 31492 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
W20260709 12:22:24.486296  1182 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 12:22:24.440685   839 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.470125 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:24.490579 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.491559 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60134.5us
I20260709 12:22:24.494967  1018 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:24.495399  1018 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:24.495790  1018 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.506922 31416 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:24.469779   773 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:24.471967  1186 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:24.538785 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.552055  1192 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:24.552743  1192 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.491185  1057 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:24.555717  1057 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.557929  1177 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.562777  1186 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.563448 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.461313   998 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:24.508935 31463 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.727s (SENT)
W20260709 12:22:24.565196 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 106983us
I20260709 12:22:24.566042 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.508097   773 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:24.568550   773 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.568614  1192 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:24.572098 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75405.1us
I20260709 12:22:24.516028  1120 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.573983 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.600049   839 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:24.610541 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:24.622885 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 129932us
I20260709 12:22:24.573230  1177 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:24.629271 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.598202  1116 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:24.638077 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.633644 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.639433 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:24.609107  1164 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.617990  1192 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.648128 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.652663 31574 raft_consensus.cc:2410] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:24.633876  1159 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.633074  1087 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.635537  1174 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.619446   811 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:24.617754  1120 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.667129 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.631649  1171 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:24.643098   970 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.669528 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.684502   998 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:24.686395 31500 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:24.687239 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.687953   811 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.688356   811 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:24.662160  1087 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.692104 31569 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:24.692880 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.648656  1116 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.663735  1138 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:24.693709   839 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.689922 31416 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:24.668787  1160 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:24.695853  1087 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:24.734242  1187 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:22:24.669339  1174 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:24.749874 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123284us
I20260709 12:22:24.689251   811 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:24.668664  1159 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.755887 31565 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:24.744068  1153 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:24.680878   970 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.734611  1164 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.730751  1186 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:24.760862 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.761107 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.761296  1018 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.744254   839 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:24.763000 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.763201   839 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.764371   839 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.765172  1116 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.765723 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.766012 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.766849 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.767035  1174 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.767649 32106 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:24.767786 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.768085  1024 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:24.769207 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.769268  1024 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.770527  1024 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:24.771423  1024 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.771876 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.764400 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.774542 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.777644  1164 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.781471 32110 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:24.776208 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.785552   970 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.755424  1160 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.786911   811 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.787495  1158 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.788465 31491 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:24.789173 31416 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.788439  1024 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.755017 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.793042 31420 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:24.797571 31573 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:24.811537 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.811758 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.860906 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.904201 32114 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:24.883673 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.904557 32113 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
W20260709 12:22:24.889475 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.907992   900 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.008s
I20260709 12:22:24.861495 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.861145 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:24.880760 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:24.913259 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 135138us
I20260709 12:22:24.914091 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.914780 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.791724  1120 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:24.915508 31569 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:24.751646  1177 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:24.917812 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.798290  1018 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:24.918745   970 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:24.919023 31565 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:24.919144 31566 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.919312   970 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:24.920507   970 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.805821   519 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:22:24.923496 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.923823 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:24.797297  1126 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:24.927075  1126 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:24.927330 31571 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.927971  1126 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.929450  1126 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:24.912424  1198 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:24.930927  1149 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:24.931674 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.931138 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:24.932766  1190 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.261s	user 0.003s	sys 0.000s
I20260709 12:22:24.933208 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:24.934885  1018 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:24.932783 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 365) took 1084 ms. Trace:
I20260709 12:22:24.935765  1018 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.935950 31499 rpcz_store.cc:276] 0709 12:22:23.848437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.848554 (+   117us) service_pool.cc:224] Handling call
0709 12:22:23.863179 (+ 14625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.243559 (+380380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.932474 (+688915us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400363154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:24.932709 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843214080}
I20260709 12:22:24.937839  1057 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.939375  1177 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:24.940616 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.941658 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.942626 31570 raft_consensus.cc:2410] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:24.943502 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.941804 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.944073 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.945017 31565 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:24.944087 31570 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.947057 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:24.948689 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.903909 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.931560  1149 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.954855 32111 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:24.958328 31569 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:24.934450 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:24.955677 31570 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:24.959832 31571 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:24.959252 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:24.961870 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:24.962633 31570 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.962786 31500 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.961637 32113 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:24.964457 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:24.968432 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.971273 31566 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
W20260709 12:22:24.973773 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.873574  1158 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:24.981089 32114 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEARNER]: Advancing to term 4
I20260709 12:22:24.997627 31570 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:24.999258 31569 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:22:25.209508 31569 pending_rounds.cc:85] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 3
I20260709 12:22:25.209793 31569 pending_rounds.cc:107] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:22:25.001132 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 88230.1us
I20260709 12:22:25.003626 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.210018 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:25.210587 31500 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:24.974395  1017 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:25.211766  1017 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:25.213165  1017 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.210070 31569 raft_consensus.cc:2889] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.215894 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:25.216437 31569 raft_consensus.cc:2376] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3. Re-sending same reply.
I20260709 12:22:25.217186 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:25.006709 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71987.4us
I20260709 12:22:25.218155 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.220432 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:25.221213 32106 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:25.221968 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:24.982903 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.222508 32106 raft_consensus.cc:2376] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3. Re-sending same reply.
I20260709 12:22:25.223047 31492 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:25.223803 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:25.223064 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:25.225620 32110 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.225279 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.011365 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:25.227259  1171 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:25.227560 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.219098 31569 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:25.228411 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:25.229030 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.006806  1158 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.109771 31565 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:25.229396 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:25.229951 31565 pending_rounds.cc:85] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 2
I20260709 12:22:25.230037  1116 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.230326 31565 pending_rounds.cc:107] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:25.230628  1116 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:24.974764  1068 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:22:25.231204 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:25.232501 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.232827  1116 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:25.233083 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.233029 31570 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:25.230643 31565 raft_consensus.cc:2889] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.140141 32111 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:22:25.131120 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:25.234823 32111 pending_rounds.cc:85] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 4
I20260709 12:22:25.185546 32114 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:25.064805 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.235090 32111 pending_rounds.cc:107] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:22:25.235338 32111 raft_consensus.cc:2889] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.235553 31565 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:25.163262 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.237349 32113 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEARNER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:25.238155 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.231184  1158 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.234193 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.238734  1202 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:25.239975  1196 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:25.240379  1196 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:25.241113 31565 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.241169  1196 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:25.198269 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.139088 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.242504 31565 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:25.243999 31565 pending_rounds.cc:85] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 1
I20260709 12:22:25.244818 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:25.245064 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:25.245664 31419 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:25.245699  1116 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:25.246030 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:25.148126 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:25.246301  1116 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.229130 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:25.122699 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 109745us
I20260709 12:22:25.257248 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:25.247022 31571 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:25.231449 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.249755 31422 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:25.260028 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.191751   811 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:22:25.035554   773 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.265369   773 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:25.034835 31567 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:25.012655   965 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.016286  1160 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.110219   959 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.250582 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:25.250744 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:25.019969  1200 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:22:25.011502 31493 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.249291  1116 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.019992  1138 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.261s
I20260709 12:22:25.062038  1164 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:25.248273 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:25.247568 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:25.238178  1029 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:22:25.235633 32111 pending_rounds.cc:107] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:25.268302  1186 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.248924 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.234231 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:25.139271  1197 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
I20260709 12:22:25.015276  1149 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:25.247872   839 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.247591 31572 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:25.271792 31574 raft_consensus.cc:2376] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4. Re-sending same reply.
I20260709 12:22:25.278285 32109 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.016613  1162 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.277385 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:25.244485 31565 pending_rounds.cc:107] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:25.284723   959 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:25.290194   778 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:25.062481  1205 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.031100  1120 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.086947  1208 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.137549 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:25.186815  1204 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.133764 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:25.292519 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.242514  1196 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.143121  1159 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.081923 31417 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:25.300731 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:25.302588 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.267207 31567 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.306370 32111 raft_consensus.cc:2889] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:25.059262   927 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.006s
I20260709 12:22:25.280035  1171 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:25.278187  1180 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.094099   519 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.205s
I20260709 12:22:25.313092 31424 raft_consensus.cc:2368] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
W20260709 12:22:25.313591 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55887us
I20260709 12:22:25.127946  1150 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.524398 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:25.283819   965 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:25.683871 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.703548 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:25.663529 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 414639us
I20260709 12:22:25.298291  1213 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.705047 31565 raft_consensus.cc:2889] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.705623 31493 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:25.128857   900 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.312762  1116 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:25.707388 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 183117us
I20260709 12:22:25.533192  1158 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:25.713828 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:25.571564   824 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.717321 31566 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:25.540999  1087 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.007s
W20260709 12:22:25.515172  1126 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.003s
W20260709 12:22:25.503274 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.437747 31420 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.512816  1217 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:25.727365 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 270130us
I20260709 12:22:25.778779 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:25.779210 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.734174 31423 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:25.735555 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:25.780007 31423 pending_rounds.cc:85] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 2
I20260709 12:22:25.780297 31423 pending_rounds.cc:107] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:25.320439 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:25.324637  1201 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.681949  1057 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:25.775224 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45983.7us
I20260709 12:22:25.726841  1116 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:25.783368 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.780598 31423 raft_consensus.cc:2889] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.728891  1180 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.734272  1017 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:25.783882 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.724620 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:25.809111 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.720407  1208 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:25.814489 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.022s	sys 0.110s
W20260709 12:22:25.901536 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.022s	sys 0.110s
W20260709 12:22:25.901970 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 644777us
I20260709 12:22:25.714859   970 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.309280 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:25.885308 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1165) took 1512 ms. Trace:
I20260709 12:22:25.886071 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.816687 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:25.715090   992 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:25.862092 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:25.893908 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158409us
I20260709 12:22:25.734498  1068 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.815697  1126 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.856478 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 637) took 1009 ms. Trace:
I20260709 12:22:25.812095 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.957510 31500 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:25.714275   927 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.715432   778 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.900684 31499 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:25.716037  1120 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.716041  1150 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.715205  1205 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.902796 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:25.909010 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:25.780471  1218 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.920014  1157 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.916630 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:25.916970  1232 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.917580  1212 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:25.917901  1225 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:22:25.728669   900 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.895079  1116 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:25.944900 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82869.7us
W20260709 12:22:25.985651 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.726824  1164 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.957643 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:25.886626 31415 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:25.913074 31497 rpcz_store.cc:276] 0709 12:22:24.372516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.373047 (+   531us) service_pool.cc:224] Handling call
0709 12:22:24.403830 (+ 30783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:24.438115 (+ 34285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.438161 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:24.444451 (+  6290us) log.cc:844] Serialized 26 byte log entry
0709 12:22:24.646922 (+202471us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:24.646959 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.647020 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:25.125212 (+478192us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:25.721900 (+596688us) raft_consensus.cc:1685] finished
0709 12:22:25.721920 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.885129 (+163209us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5400292cd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:25.885252 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2124,"raft.queue_time_us":13425,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":17645,"spinlock_wait_cycles":134781056,"thread_start_us":143277,"threads_started":1,"wal-append.queue_time_us":263733}
I20260709 12:22:25.783248  1087 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:25.963059 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 701384us
I20260709 12:22:25.963155 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.993377 31500 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:25.902961 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.919775   970 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.716060  1204 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.902506  1229 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:25.962570  1126 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.725906  1213 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:25.814546   824 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.892947  1057 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.940454  1149 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.976912 31495 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7.
W20260709 12:22:25.966557  1024 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.051s	user 0.012s	sys 0.000s
I20260709 12:22:25.960119   519 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.956286  1177 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.985742 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:25.899032  1180 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.968580 31418 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.996109 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.024722 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:25.939572   992 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:25.970633  1231 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:25.977561  1089 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.003819 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:25.993614 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:25.914692  1017 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:25.976723  1212 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:25.994176  1226 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:22:25.815009  1217 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:26.004254 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 105966us
I20260709 12:22:25.911623   959 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.011797 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:26.012022 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:26.058380 32112 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:26.012773 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.014226 31568 raft_consensus.cc:2368] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4.
I20260709 12:22:25.996601  1115 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.958178 32107 rpcz_store.cc:276] 0709 12:22:24.790192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.797182 (+  6990us) service_pool.cc:224] Handling call
0709 12:22:25.133527 (+336345us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:25.781990 (+648463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64849792}
W20260709 12:22:26.026976 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 290896us
I20260709 12:22:26.044169   519 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:26.065119   519 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.066172  1120 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.066514   965 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.066859   900 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.067360   519 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:25.998922 32108 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:26.052817  1089 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.017350 31494 raft_consensus.cc:2368] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:22:26.037156 31496 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:26.007107 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:26.039271  1214 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:22:26.026209  1149 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.041922  1180 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.042523  1238 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:26.031107  1239 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:26.043183  1220 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
W20260709 12:22:26.060597 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47909.7us
I20260709 12:22:25.984210  1157 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:26.062107  1224 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:22:26.062781  1227 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:22:26.048225  1212 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.059737  1177 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:26.082834  1120 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.078895  1087 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.048372  1024 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:26.001581  1164 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.045997  1018 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:26.004653  1232 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:22:26.099768  1150 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:25.994722  1218 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.027642  1235 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 12:22:26.095968  1223 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.484s	user 0.008s	sys 0.005s
I20260709 12:22:26.099035  1239 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.099167   778 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.027887  1229 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.060340  1069 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:22:26.045534  1231 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.084174 31418 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:22:26.032327 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 215726us
I20260709 12:22:26.091122 31494 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:26.095257  1238 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:26.088750 31491 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.133350 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.101025  1018 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:26.139680  1018 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.139787   519 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.141353 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.142351   519 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.144946 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.145678   519 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.146864 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.148495   519 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.149276  1018 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.032980 32105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:26.108688  1057 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.153115 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.113202  1208 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.132685   927 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.102101  1120 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.132314 31493 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:26.106580  1177 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:26.170083 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 184399us
I20260709 12:22:26.153973  1087 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.176152 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:26.185874 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 161194us
I20260709 12:22:26.157289  1217 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:26.172003   998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.022s	sys 0.012s
I20260709 12:22:26.190596 32109 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:26.101780  1017 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.162899 32105 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.194175 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:26.196456  1242 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:22:26.197212  1231 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.197676  1243 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:22:26.211054  1232 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:26.186182  1216 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:22:26.211767   824 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.213306   773 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.213472  1120 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.213714   773 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:26.114130  1239 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:26.214607   773 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.216113  1239 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.216713  1235 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.216965 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:26.217267  1235 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:26.217550 31499 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.218195  1235 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.220001 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.220269  1229 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.208876  1205 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.221567 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 644) took 1301 ms. Trace:
I20260709 12:22:26.194591  1126 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.222261  1126 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.222635  1126 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:26.208309   998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.023s	sys 0.013s
I20260709 12:22:26.225272  1244 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:26.225687  1244 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.226003  1244 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.226859  1204 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.227027  1228 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:22:26.228056   970 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.228919 31424 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:26.204319 31495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1215) took 1813 ms (client timeout 1886 ms). Trace:
I20260709 12:22:26.205242  1238 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.150978   778 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:22:26.193181 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.187386  1057 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:26.211313 31494 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:26.223524 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1235) took 1206 ms. Trace:
I20260709 12:22:26.227396  1158 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:26.203048 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.229401  1157 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.229501  1171 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.221932 32111 rpcz_store.cc:276] 0709 12:22:24.920305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.958098 (+ 37793us) service_pool.cc:224] Handling call
0709 12:22:24.958344 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.720721 (+762377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.221353 (+500632us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400085054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:26.221501 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417124224}
I20260709 12:22:26.230973  1177 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.203715  1149 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.198797  1236 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.200608  1018 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:26.232991 31495 rpcz_store.cc:269] 0709 12:22:24.391369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.391612 (+   243us) service_pool.cc:224] Handling call
0709 12:22:26.204143 (+1812531us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002922d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:26.204264 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3637988736}
W20260709 12:22:26.239442 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45339.8us
I20260709 12:22:26.254874 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.240520 31566 rpcz_store.cc:276] 0709 12:22:25.016959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.255831 (+238872us) service_pool.cc:224] Handling call
0709 12:22:25.308495 (+ 52664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.777190 (+468695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.223316 (+446126us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400058054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:26.223461 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939642240}
I20260709 12:22:26.209753 32105 raft_consensus.cc:614] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:26.238721  1239 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.193205  1087 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.252363  1249 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:26.246500  1171 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.260411  1249 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.261739  1087 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.243908   970 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.243000  1158 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.241603  1231 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:26.265563  1231 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.259727  1246 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:26.266981  1246 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.267601  1231 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.250147  1243 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:22:26.268262  1218 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.246726  1157 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:26.259513  1239 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.223522  1126 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.270951 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.259748 31567 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:26.244220  1204 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:26.283269  1204 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:26.283610  1204 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:26.284606  1239 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.284443  1204 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.284965   992 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.269191  1246 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.262574  1249 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:26.286995 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158494us
I20260709 12:22:26.285480 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.291603 31495 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:26.291679 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.269129  1157 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.289482 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.279000  1110 raft_consensus.cc:2764] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:26.296437 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:26.298134 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.280756   970 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:26.329774 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:26.304543 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.300607 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.310240 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.311373 32107 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:26.311793  1249 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:26.340085  1249 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:26.340570  1249 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:26.341645  1249 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.343073 32108 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:26.343144  1249 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.319041 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.320065  1157 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.320797 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.321281  1228 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.321765  1149 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:22:26.325191  1196 consensus_meta.cc:287] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.000s
I20260709 12:22:26.325471  1029 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.327332 32111 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:26.333659 32109 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:26.336089 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:26.381698 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49752.9us
W20260709 12:22:26.381968 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46379us
I20260709 12:22:26.291483  1116 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.307847  1162 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.293203   992 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:26.388118 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:26.360332 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.362399  1157 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:26.346959  1253 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.366334 31491 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:26.353087 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.356510  1251 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.393528 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.396436 31499 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:26.397251 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.397789 31499 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:26.394526 31495 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:26.398571 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.400382 31499 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:26.303200  1212 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:26.340298   970 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.402305 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:26.388542  1238 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:26.392817 32106 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:26.367936 31494 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:26.395066 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.404865 31424 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
I20260709 12:22:26.407274  1160 raft_consensus.cc:1064] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:22:26.409677 31417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 309) took 2320 ms (client timeout 1834 ms). Trace:
I20260709 12:22:26.411585 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:26.412305 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:26.455328 31423 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:26.404121  1157 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.421386  1244 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.395539  1251 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:26.461642  1157 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.423513  1116 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.399333   959 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.392553  1110 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:22:26.425034 31491 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:26.467288 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.388263  1158 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.468917 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.470607  1158 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.400020  1253 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.447264  1246 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.434113 31495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60738423610d43149226454d80d6b245"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:26.481096 31495 raft_consensus.cc:606] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.481624 31495 raft_consensus.cc:614] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:26.436213 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.453138 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.458755 31416 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:26.402740   992 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:26.462049  1251 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:26.429301 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.394428  1029 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:26.475780 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:26.513810 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 118824us
I20260709 12:22:26.479215 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.487623 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.452315  1238 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:26.515187 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.511734 31499 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:26.517802 31499 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:26.520077 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.518214 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:26.513301  1246 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.524603   992 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.525055 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:26.525887 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:26.526584  1228 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.526985  1228 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.527326  1228 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.528988 31572 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:26.535418 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:26.536413   824 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:26.536921   824 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:26.537837   824 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.511917  1017 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:26.536739  1217 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:26.548437 31390 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:26.548689 31495 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:26.520294  1149 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.522369  1218 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.543634   900 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:26.577860 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.538719  1157 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:26.517499  1251 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.547693 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:26.451288 31417 rpcz_store.cc:269] 0709 12:22:24.088962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.092853 (+  3891us) service_pool.cc:224] Handling call
0709 12:22:26.409380 (+2316527us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54004493d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:26.409544 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798298368}
I20260709 12:22:26.527379 31494 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:26.510820  1208 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.542826 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.567576  1219 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:26.569304 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:26.546762  1029 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.571139  1253 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:26.553115  1149 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.571625 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.572476  1212 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.552623  1249 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:22:26.565909  1238 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.546067 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.534297  1116 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:26.546813 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.573405  1162 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.541467   519 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.583772 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.584146 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:26.587760 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:26.733456 31572 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.588703 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.591275 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:26.734453 31573 raft_consensus.cc:2376] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5. Re-sending same reply.
I20260709 12:22:26.604404 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:26.661163 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.577491  1244 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:26.607077 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.597609  1239 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.633239 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:26.580557  1157 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.743331  1157 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.631909 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.631104 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.580003  1110 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.747547  1110 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.747982  1110 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.748272 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:26.748401  1087 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.749032 31495 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:26.749830 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.579277   998 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.751302  1239 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.751757  1239 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.574662  1017 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.578138  1202 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:22:26.606050 32107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:26.609180  1219 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.679152  1255 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:26.675690  1260 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:22:26.683756  1246 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.634338 31493 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:26.600517  1208 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:26.659962  1253 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:26.688015 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:26.713376 32109 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:26.650291  1029 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:26.908406  1202 consensus_queue.cc:1243] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:26.734274 31565 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:26.841581 31567 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:26.908213  1017 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.735780 31571 raft_consensus.cc:2376] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5. Re-sending same reply.
I20260709 12:22:26.608299  1149 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.754951 32107 raft_consensus.cc:606] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.597828  1235 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:22:26.770359 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.861989   998 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.700970  1171 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:26.715492  1116 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.783107 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:26.863338 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.804082 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 219981us
I20260709 12:22:26.834663  1249 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:26.914762 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.840653 31574 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:26.920143 31569 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:26.839345 31496 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:26.716759  1228 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:26.942203 31566 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:26.975507 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.943976 31572 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:26.903256 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.689579 32108 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:26.904844  1258 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.733093 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:26.953416 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.902912  1219 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:26.760344 31570 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:26.956816 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.975574 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.976426 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:26.984604 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.900804  1087 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:26.981164 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 261597us
I20260709 12:22:26.981369 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:26.985466 31565 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
W20260709 12:22:26.987396 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.982523 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:26.984750 31572 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:26.990346 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.025s	sys 0.014s
I20260709 12:22:26.955674 32107 raft_consensus.cc:614] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:26.990648 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.025s	sys 0.014s
I20260709 12:22:26.951978  1253 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:26.991189 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 1.08846e+06us
I20260709 12:22:26.996136 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:26.975601  1116 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.999051  1017 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:26.978600  1222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.024s	sys 0.025s
I20260709 12:22:26.975021  1249 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:27.005012 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.005821 31569 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:27.007216 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.006259 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:27.009363 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.009984 31570 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:27.011785 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.013767 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.015296 31572 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:26.986115  1246 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:27.022131 31387 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:27.016316 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.025784 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:27.014369 31571 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:27.016010 31565 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:27.027935 31572 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:27.028839 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.030242 31569 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:27.013667 31494 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:27.034341 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:27.035610 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:27.004020  1222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.025s	sys 0.026s
W20260709 12:22:27.034464 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54280.1us
I20260709 12:22:27.040935 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.041862 31571 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:27.009109  1249 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.004820  1244 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:27.043089 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.004658 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.045985 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:27.037411 31574 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:27.046998 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:27.049549 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53373.8us
I20260709 12:22:27.049871 32114 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:27.051169 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.052861 31495 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:27.033985  1120 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.055902 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.036554   992 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:27.033905   900 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.989850  1258 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.040434  1282 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:27.040634   998 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:27.044849 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.003634  1017 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:27.073072 31571 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:27.047989  1244 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.103351 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.027935  1029 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.047493  1158 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:27.071264 31567 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
W20260709 12:22:27.071597  1273 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:22:27.282332 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1232) took 1078 ms. Trace:
I20260709 12:22:27.054896  1229 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:27.071182   625 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:27.054991 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.135671 31498 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:27.145045 31570 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.145897 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:27.434403 31572 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:27.149596 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:27.134104 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.127381 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.435091 32113 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:27.118570 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:27.346860 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.229897 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.219228 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1176) took 1471 ms. Trace:
I20260709 12:22:27.137684 31491 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:27.114773  1244 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.432126  1158 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.448553  1158 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:27.436789 31500 rpcz_store.cc:276] 0709 12:22:25.747611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.995150 (+247539us) service_pool.cc:224] Handling call
0709 12:22:25.995529 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:26.154548 (+159019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.154579 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:26.168781 (+ 14202us) log.cc:844] Serialized 52 byte log entry
0709 12:22:26.292707 (+123926us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:26.385435 (+ 92728us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.385822 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.387751 (+  1929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.218786 (+831035us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b54001d1fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:27.218827 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:27.218954 (+   127us) raft_consensus.cc:1685] finished
0709 12:22:27.218975 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.219162 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"prepare.queue_time_us":85815,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":29953,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":299,"spinlock_wait_cycles":87068416,"thread_start_us":202439,"threads_started":3,"wal-append.queue_time_us":126508,"wal-append.run_cpu_time_us":3828,"wal-append.run_wall_time_us":1092712}
I20260709 12:22:27.145371  1277 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.305s
I20260709 12:22:27.454962 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.456058 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.456444 32111 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:27.456809 32111 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:27.456898  1284 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.457417  1284 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:27.457775 32111 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.460047  1284 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:27.218209 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 316) took 2295 ms. Trace:
I20260709 12:22:27.272032 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:27.465816 31497 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:27.203540 31568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1221) took 2260 ms (client timeout 1911 ms). Trace:
I20260709 12:22:27.151662  1186 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:27.070967  1120 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:27.429876  1287 net_util.cc:396] Time spent resolve address for 127.29.143.194: real 0.259s	user 0.000s	sys 0.000s
I20260709 12:22:27.475986 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.292630 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:27.112501 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:27.112043  1171 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:27.121187  1276 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:22:27.111034   992 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.138978  1208 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:27.440762 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 291235us
I20260709 12:22:27.420353 31496 rpcz_store.cc:276] 0709 12:22:26.204220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.219763 (+ 15543us) service_pool.cc:224] Handling call
0709 12:22:27.282099 (+1062336us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400363654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:27.282252 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400751360}
I20260709 12:22:27.361372 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:27.121695  1258 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:27.116945  1282 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.445104  1232 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.116454 32105 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:27.463647 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:27.477418 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.206177  1126 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.292872  1089 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.241262 31492 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:27.277595  1204 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:27.466320 31568 rpcz_store.cc:269] 0709 12:22:24.942608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.943717 (+  1109us) service_pool.cc:224] Handling call
0709 12:22:27.203192 (+2259475us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001a5c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:27.203412 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443899648}
I20260709 12:22:27.464435 31420 rpcz_store.cc:276] 0709 12:22:24.923104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.949887 (+ 26783us) service_pool.cc:224] Handling call
0709 12:22:24.950187 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.777263 (+827076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.217938 (+1440675us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54003ec954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:27.218115 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120830720}
I20260709 12:22:27.497749 32111 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.507754 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.507143  1244 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.508694 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:27.482239  1284 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:22:27.515003 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.516088  1213 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:27.518175  1120 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:27.520018  1017 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:27.432389  1159 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.521556 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 229046us
I20260709 12:22:27.482219   811 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.530383  1068 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:27.270433  1164 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:27.420398  1177 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.312s
I20260709 12:22:27.171444   998 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.361s
I20260709 12:22:27.289124  1238 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.361690  1162 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.160s
I20260709 12:22:27.251567  1115 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.442138  1229 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:27.133841  1239 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.436702   625 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:27.302604  1160 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:27.877775 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.338264 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:27.591109 31569 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:27.583719 31570 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:28.034898 31565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.005s	sys 0.014s
W20260709 12:22:28.325167 31466 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.008s	sys 0.021s
W20260709 12:22:28.340063 31565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.010s	sys 0.019s
W20260709 12:22:28.340415 31466 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.008s	sys 0.021s
W20260709 12:22:28.035277 32109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.019s
I20260709 12:22:27.462692 32108 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
W20260709 12:22:28.340714 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 911874us
I20260709 12:22:28.336701 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:28.061282 32114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.002s
W20260709 12:22:28.343011 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 879408us
W20260709 12:22:28.354197 32114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.006s	sys 0.003s
I20260709 12:22:27.533614 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:28.341320 32109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.000s	sys 0.026s
I20260709 12:22:28.354611 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:28.355702 31572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.003s	sys 0.008s
W20260709 12:22:28.358080 31572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.008s
W20260709 12:22:28.355939 31574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.012s	sys 0.032s
W20260709 12:22:28.358884 31574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.013s	sys 0.032s
I20260709 12:22:28.358975 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 445) took 1207 ms. Trace:
I20260709 12:22:28.360292 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 433) took 1226 ms. Trace:
I20260709 12:22:28.360772 31569 rpcz_store.cc:276] 0709 12:22:27.134336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.590244 (+455908us) service_pool.cc:224] Handling call
0709 12:22:27.590606 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.346700 (+756094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.360225 (+ 13525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.361886 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:27.483842  1228 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:28.295095  1157 consensus_meta.cc:287] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.551s	user 0.005s	sys 0.006s
I20260709 12:22:28.362949 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:28.367802 31420 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:28.368994 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:28.369527 31540 leader_election.cc:400] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:22:27.572103 31417 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:27.858587 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:28.325629  1174 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.381225 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.365304 31422 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6.
W20260709 12:22:27.649230 31494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.025s	sys 0.054s
I20260709 12:22:27.528191  1231 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:28.369911 31540 leader_election.cc:403] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:27.530716  1246 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.370278 31573 raft_consensus.cc:2368] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5.
I20260709 12:22:28.235427 31567 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:28.371973 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 434) took 1226 ms. Trace:
I20260709 12:22:27.569958  1171 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.373312 31571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.007s	sys 0.006s
I20260709 12:22:28.366245 31495 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:28.363174 31423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.033s
W20260709 12:22:28.418999 31423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.019s	sys 0.033s
I20260709 12:22:28.359485 32113 rpcz_store.cc:276] 0709 12:22:27.149760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.444283 (+294523us) service_pool.cc:224] Handling call
0709 12:22:28.356678 (+912395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.420396 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:28.342451  1115 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.896349  1253 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:28.364154  1068 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:28.378064 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:28.372972 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1199) took 1177 ms. Trace:
W20260709 12:22:28.363639 32108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 439) took 1329 ms (client timeout 1533 ms). Trace:
I20260709 12:22:27.970170  1087 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:27.521986  1186 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.438755 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1234) took 2232 ms. Trace:
I20260709 12:22:28.467724 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:28.370960  1110 consensus_meta.cc:287] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.623s	user 0.009s	sys 0.002s
I20260709 12:22:28.359918   992 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:28.420156 31571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.008s	sys 0.006s
W20260709 12:22:28.501199 31570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1257) took 1850 ms (client timeout 2203 ms). Trace:
W20260709 12:22:28.501713 31570 rpcz_store.cc:269] 0709 12:22:26.651038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.010554 (+359516us) service_pool.cc:224] Handling call
0709 12:22:28.500990 (+1490436us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400250dd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:28.501125 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248348544}
I20260709 12:22:28.377230 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:28.503357 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 126231us
I20260709 12:22:28.504073 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:28.504873 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:28.505720 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:28.422027  1177 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:28.510785  1177 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.511456  1177 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.360610   811 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.514074  1177 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.514729   811 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.515956 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:28.358491 32105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 655) took 1367 ms (client timeout 1680 ms). Trace:
I20260709 12:22:28.423563  1244 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.365270  1164 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.516737 32105 rpcz_store.cc:269] 0709 12:22:26.987430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.989572 (+  2142us) service_pool.cc:224] Handling call
0709 12:22:28.355164 (+1365592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.517163  1164 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.519001 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 545) took 1475 ms. Trace:
I20260709 12:22:28.519305  1164 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.519942  1164 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:28.520547  1164 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:28.519409 32110 rpcz_store.cc:276] 0709 12:22:27.043406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.044376 (+   970us) service_pool.cc:224] Handling call
0709 12:22:27.055990 (+ 11614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.056304 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.056336 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.075078 (+ 18742us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.522053 (+446975us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:27.522124 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.522213 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.518794 (+996581us) raft_consensus.cc:1685] finished
0709 12:22:28.518813 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.518947 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15866,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":28938,"thread_start_us":397097,"threads_started":1,"wal-append.queue_time_us":1353393}
I20260709 12:22:28.521844 32110 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:28.521442  1164 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:28.522107  1229 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:28.364459  1120 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:28.522960  1120 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:28.524253  1289 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.556s	user 0.001s	sys 0.000s
I20260709 12:22:28.524688 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 378) took 2211 ms. Trace:
I20260709 12:22:28.415480 31568 rpcz_store.cc:276] 0709 12:22:27.145571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.355782 (+1210211us) service_pool.cc:224] Handling call
0709 12:22:28.371108 (+ 15326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.371291 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.371677 (+   386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.371728 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:28.371767 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.371817 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.371922 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.525084 31498 rpcz_store.cc:276] 0709 12:22:26.312857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.652623 (+339766us) service_pool.cc:224] Handling call
0709 12:22:26.652878 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.433627 (+780749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.524476 (+1090849us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54003bb854. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:28.524631 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109560704}
I20260709 12:22:28.526203 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 654) took 1539 ms. Trace:
I20260709 12:22:28.432421 31496 rpcz_store.cc:276] 0709 12:22:27.195368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.353434 (+1158066us) service_pool.cc:224] Handling call
0709 12:22:28.372536 (+ 19102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.372697 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.372718 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.372755 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.372782 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.372827 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.372911 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.009824 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:28.433936 32111 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:28.540323 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 444) took 1421 ms. Trace:
I20260709 12:22:28.540688 32111 rpcz_store.cc:276] 0709 12:22:27.119063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.455998 (+336935us) service_pool.cc:224] Handling call
0709 12:22:27.456307 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.540036 (+1083729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.540261 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:28.415192 31494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.038s	sys 0.160s
I20260709 12:22:27.625324  1180 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:28.417153 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1223) took 2648 ms. Trace:
I20260709 12:22:28.470436 31495 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:28.363498  1288 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.457634  1246 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.367344  1089 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.417124  1174 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:28.438128 32108 rpcz_store.cc:269] 0709 12:22:27.028762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.033539 (+  4777us) service_pool.cc:224] Handling call
0709 12:22:28.358036 (+1324497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.492705 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:28.495613 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 547) took 1451 ms. Trace:
I20260709 12:22:28.523811  1120 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.364598  1258 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:28.417801 32106 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.379889   998 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:28.531307 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1200) took 1335 ms. Trace:
I20260709 12:22:28.575222   824 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:28.470057 31499 rpcz_store.cc:276] 0709 12:22:26.205879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.518546 (+312667us) service_pool.cc:224] Handling call
0709 12:22:26.518836 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:26.540574 (+ 21738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:26.540611 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:26.550554 (+  9943us) log.cc:844] Serialized 26 byte log entry
0709 12:22:26.717020 (+166466us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:26.717057 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:26.717125 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.438511 (+1721386us) raft_consensus.cc:1685] finished
0709 12:22:28.438533 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.438657 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9640,"raft.queue_time_us":9725,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":17043,"thread_start_us":130308,"threads_started":1,"wal-append.queue_time_us":370866}
I20260709 12:22:28.427220  1231 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.536051 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 436) took 1310 ms. Trace:
I20260709 12:22:28.599396 31570 rpcz_store.cc:276] 0709 12:22:27.225775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.502502 (+1276727us) service_pool.cc:224] Handling call
0709 12:22:28.535403 (+ 32901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.535623 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.535662 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.535717 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:28.535760 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.535829 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.535963 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.541278 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:28.414101  1208 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:28.526657 32112 rpcz_store.cc:276] 0709 12:22:26.987090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.987226 (+   136us) service_pool.cc:224] Handling call
0709 12:22:27.004508 (+ 17282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.015142 (+ 10634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.015185 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.015733 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:22:27.146258 (+130525us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:27.146297 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.146356 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.525926 (+1379570us) raft_consensus.cc:1685] finished
0709 12:22:28.525952 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.526133 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10424,"raft.queue_time_us":9191,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12326,"thread_start_us":91154,"threads_started":1,"wal-append.queue_time_us":513261}
I20260709 12:22:28.374747  1157 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.353545  1159 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:28.575078 31390 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 2.044s (SENT) [suppressed 45 similar messages]
W20260709 12:22:28.539037 31415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.017s	sys 0.043s
I20260709 12:22:28.374470  1238 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.584636 31496 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:28.555300 31493 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.607s	user 0.012s	sys 0.000s
I20260709 12:22:28.584509 32109 rpcz_store.cc:276] 0709 12:22:27.043961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.132140 (+ 88179us) service_pool.cc:224] Handling call
0709 12:22:27.132522 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.147826 (+ 15304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.147873 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.170702 (+ 22829us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.355240 (+1184538us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:28.355280 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.355343 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.495381 (+140038us) raft_consensus.cc:1685] finished
0709 12:22:28.495401 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.495552 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21098,"raft.queue_time_us":12937,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2242,"thread_start_us":914226,"threads_started":1,"wal-append.queue_time_us":1068579}
I20260709 12:22:28.468086  1253 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.575183  1286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.436s	user 0.014s	sys 0.047s
I20260709 12:22:28.592239 31498 rpcz_store.cc:276] 0709 12:22:27.195681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.526218 (+1330537us) service_pool.cc:224] Handling call
0709 12:22:28.526537 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.530889 (+  4352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.530931 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.530987 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:28.531037 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.531115 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.531242 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.582304  1180 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.595449 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1202) took 1399 ms. Trace:
I20260709 12:22:28.581251 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1266) took 1864 ms. Trace:
W20260709 12:22:28.535894 31497 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.000s
I20260709 12:22:28.686966 31497 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:28.687747 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1203) took 1491 ms. Trace:
I20260709 12:22:28.688158 31497 rpcz_store.cc:276] 0709 12:22:27.196524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.271675 (+ 75151us) service_pool.cc:224] Handling call
0709 12:22:28.687670 (+1415995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.529800  1087 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 2. Current term is 3.
I20260709 12:22:28.581270 31491 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:28.690471 31420 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.563627  1110 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.428215  1171 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.378588  1017 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:28.606330 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 1.24498e+06us
I20260709 12:22:28.697842 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:28.607306 31415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.017s	sys 0.044s
I20260709 12:22:28.606333 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1201) took 1410 ms. Trace:
I20260709 12:22:28.699369 31496 rpcz_store.cc:276] 0709 12:22:27.195973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.527135 (+1331162us) service_pool.cc:224] Handling call
0709 12:22:28.580582 (+ 53447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.606036 (+ 25454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.606262 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.595153   824 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.683076 31495 rpcz_store.cc:276] 0709 12:22:27.196254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.583260 (+1387006us) service_pool.cc:224] Handling call
0709 12:22:28.594335 (+ 11075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.594557 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.594595 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.594648 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:28.595161 (+   513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.595239 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.595372 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.591885  1213 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.701169  1213 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:28.701617  1213 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.701728  1186 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.604087  1208 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:28.595907  1258 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:28.669086  1286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.018s	sys 0.048s
I20260709 12:22:28.654670  1229 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:28.617997 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2388) took 1149 ms. Trace:
I20260709 12:22:28.657521  1282 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.720008 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:28.603960  1120 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.757288 31422 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:28.682124 31493 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:28.580247 31492 rpcz_store.cc:276] 0709 12:22:25.726274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.775979 (+ 49705us) service_pool.cc:224] Handling call
0709 12:22:27.240779 (+1464800us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:27.241008 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.354719 (+1113711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.374947 (+ 20228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14244736}
W20260709 12:22:28.698127  1116 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.699s	user 0.008s	sys 0.004s
I20260709 12:22:28.762585 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:28.762802  1258 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.596114   998 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.760106  1244 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.719084  1208 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.702924 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 385) took 1224 ms. Trace:
I20260709 12:22:28.758108  1239 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.714890   824 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.691406  1253 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:28.796850 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 291193us
I20260709 12:22:28.809356 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:28.764725 31416 rpcz_store.cc:276] 0709 12:22:27.458152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.492304 (+1034152us) service_pool.cc:224] Handling call
0709 12:22:28.607150 (+114846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.686601 31567 rpcz_store.cc:276] 0709 12:22:26.715313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.482660 (+767347us) service_pool.cc:224] Handling call
0709 12:22:27.895860 (+413200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.434542 (+538682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.579332 (+144790us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:28.812876 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 476297us
I20260709 12:22:28.810803 31420 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:28.682390  1068 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.808502  1219 raft_consensus.cc:2764] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:28.767360  1229 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.820202 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2244) took 2226 ms. Trace:
I20260709 12:22:28.826058 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:28.819473  1228 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:28.860695 32113 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:28.792486  1116 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.823267  1029 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.806759 31491 rpcz_store.cc:276] 0709 12:22:27.478834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.855733 (+376899us) service_pool.cc:224] Handling call
0709 12:22:28.697093 (+841360us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:28.855882  1249 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.802s	user 0.008s	sys 0.004s
I20260709 12:22:28.880111 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:28.880507  1205 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.880762 31416 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.881048  1205 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:28.882378  1149 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.925s	user 0.009s	sys 0.000s
I20260709 12:22:28.883174  1205 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.883739  1205 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:28.806435  1024 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.804633 31493 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1197) took 2251 ms (client timeout 2044 ms). Trace:
W20260709 12:22:28.810848 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 235819us
I20260709 12:22:28.830375 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:28.829617 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 460214us
I20260709 12:22:28.887881 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:28.810127  1196 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.808845  1244 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:28.894531  1244 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.895030  1304 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:28.895568  1304 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.897689 32106 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:28.897773  1304 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:28.898312 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 447) took 1416 ms. Trace:
W20260709 12:22:28.888695 31493 rpcz_store.cc:269] 0709 12:22:26.537898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.568956 (+ 31058us) service_pool.cc:224] Handling call
0709 12:22:28.772333 (+2203377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.898941  1231 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:28.891320  1024 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.900516  1231 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.900894  1231 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.901238  1231 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.901371  1024 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:28.902860  1017 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:28.903282  1017 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:28.903666  1017 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.904177  1229 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.905565  1087 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:28.889284 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:28.906919  1159 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.907305  1089 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.884883  1029 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.908113  1171 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:28.908911 31420 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2380) took 1453 ms (client timeout 1784 ms). Trace:
I20260709 12:22:28.846834 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:28.817584 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:28.853938  1164 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:28.866335  1308 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.893666  1196 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.889097  1149 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:28.864660  1228 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:28.910244 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 92895.5us
I20260709 12:22:28.873334  1219 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.821779  1305 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:28.909299 31420 rpcz_store.cc:269] 0709 12:22:27.455873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.368428 (+912555us) service_pool.cc:224] Handling call
0709 12:22:28.908729 (+540301us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54003eb554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:28.908852 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723573504}
I20260709 12:22:28.920667  1089 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:28.909409   998 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:28.916935 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:28.920483 32108 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.886914  1174 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:28.939545 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50349.4us
I20260709 12:22:28.941406 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:28.879904  1249 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.951316 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 548) took 1907 ms. Trace:
W20260709 12:22:28.952044 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.823479 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.969147  1305 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:29.012993   998 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.013305  1305 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.013726   998 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.892300  1205 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.945894  1029 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:28.917047 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:28.946509  1228 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.962646  1304 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:28.856770 31565 rpcz_store.cc:276] 0709 12:22:26.593459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.220633 (+627174us) service_pool.cc:224] Handling call
0709 12:22:27.221110 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:27.221595 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.221635 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:27.222355 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 12:22:28.340755 (+1118400us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.812700 (+471945us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.818869 (+  6169us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.819858 (+   989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.819934 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:28.819976 (+    42us) raft_consensus.cc:1685] finished
0709 12:22:28.819988 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.820146 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9147,"prepare.queue_time_us":473965,"raft.queue_time_us":39337,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":12478,"spinlock_wait_cycles":9278208,"thread_start_us":1556966,"threads_started":2,"wal-append.queue_time_us":1260328}
I20260709 12:22:28.978856 31498 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:28.916152 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:28.978747 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:28.979765 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 217257us
I20260709 12:22:29.076028 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:29.015648 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74315.6us
I20260709 12:22:29.078045 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.081857 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2375) took 1651 ms. Trace:
W20260709 12:22:29.014554  1303 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:22:29.004068 32114 rpcz_store.cc:276] 0709 12:22:27.044208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.445920 (+401712us) service_pool.cc:224] Handling call
0709 12:22:27.446243 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.446460 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:28.355458 (+908998us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.950862 (+595404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.950930 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:28.950993 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.951080 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:28.951239 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1048349,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":51947,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":1502802,"threads_started":3,"wal-append.queue_time_us":527269}
I20260709 12:22:29.084393 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.232156 31420 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.232669 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2391) took 1712 ms. Trace:
I20260709 12:22:29.232999 31420 rpcz_store.cc:276] 0709 12:22:27.520682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.084158 (+1563476us) service_pool.cc:224] Handling call
0709 12:22:29.232610 (+148452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.979418 31419 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:28.909688 32106 rpcz_store.cc:276] 0709 12:22:27.482267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.573100 (+ 90833us) service_pool.cc:224] Handling call
0709 12:22:28.898251 (+1325151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:28.974435  1159 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:29.074328  1302 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:22:29.088205  1057 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:28.969638  1219 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:28.969934  1246 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:28.979146  1087 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:29.257213 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1265) took 2544 ms. Trace:
W20260709 12:22:29.092643  1310 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:22:29.003640  1110 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.003250 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2370) took 1580 ms. Trace:
W20260709 12:22:29.093297  1293 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 12:22:28.941497  1308 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.085717 31415 rpcz_store.cc:276] 0709 12:22:27.430740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.432423 (+  1683us) service_pool.cc:224] Handling call
0709 12:22:27.455012 (+ 22589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.455270 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:28.699293 (+1244023us) log.cc:844] Serialized 14 byte log entry
0709 12:22:29.081477 (+382184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.081532 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:29.081591 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.081666 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.081796 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1317102,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":42981,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1625301,"threads_started":3}
I20260709 12:22:28.969403  1089 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.096473 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2369) took 1673 ms. Trace:
W20260709 12:22:28.990240  1296 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:22:29.276230 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2242) took 2683 ms. Trace:
I20260709 12:22:29.277195 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1198) took 2630 ms. Trace:
I20260709 12:22:29.277715 31494 rpcz_store.cc:276] 0709 12:22:26.646772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.099996 (+453224us) service_pool.cc:224] Handling call
0709 12:22:27.127744 (+ 27748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.128129 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.128160 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.128696 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.587581 (+1458885us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:28.592529 (+  4948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.596577 (+  4048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.276930 (+680353us) raft_consensus.cc:1685] finished
0709 12:22:29.276956 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.277122 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1031,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":1452479,"threads_started":1,"wal-append.queue_time_us":1453335}
I20260709 12:22:29.279986 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.279361 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.280717 31494 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:29.280915 31415 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:29.281726 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2387) took 1823 ms. Trace:
I20260709 12:22:29.284165  1308 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.285065  1089 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:29.285557   998 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.286620 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.287331 31498 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
W20260709 12:22:29.289685 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 128370us
I20260709 12:22:29.083647 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.139256  1149 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.003505  1180 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:29.165714 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 89792.1us
I20260709 12:22:29.073640  1312 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:29.087805  1304 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.222371  1249 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:29.223300 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 393010us
W20260709 12:22:29.225565 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.230012 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 150829us
I20260709 12:22:28.990721 31416 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:29.108575 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:29.237226 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 219526us
I20260709 12:22:29.244300 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:28.991235  1164 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.248769  1057 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.256265  1205 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.315064  1057 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.315208  1312 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:29.316248  1312 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.239921  1159 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.317417  1159 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.318869  1196 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.319959  1244 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:29.271497 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.247048  1253 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.273484 31423 rpcz_store.cc:276] 0709 12:22:27.422896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.423070 (+   174us) service_pool.cc:224] Handling call
0709 12:22:27.440525 (+ 17455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.443880 (+  3355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.443924 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.507361 (+ 63437us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.419702 (+912341us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:28.419759 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.419852 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.096188 (+676336us) raft_consensus.cc:1685] finished
0709 12:22:29.096217 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.096398 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2947,"raft.queue_time_us":3214,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":595127,"threads_started":1,"wal-append.queue_time_us":1124209}
W20260709 12:22:29.112793  1316 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:22:29.282155 31415 rpcz_store.cc:276] 0709 12:22:27.457878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.278987 (+1821109us) service_pool.cc:224] Handling call
0709 12:22:29.281643 (+  2656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.291021 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.298316 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.276652 31571 rpcz_store.cc:276] 0709 12:22:26.592931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.115383 (+522452us) service_pool.cc:224] Handling call
0709 12:22:27.119643 (+  4260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.161786 (+ 42143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.161815 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.318992 (+157177us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b2c0010e118. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:27.319547 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.499226 (+1179679us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.760697 (+261471us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.760947 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.761018 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.275925 (+514907us) raft_consensus.cc:1685] finished
0709 12:22:29.276019 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.276172 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16910,"prepare.queue_time_us":387334,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":110269,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":7390,"spinlock_wait_cycles":20886784,"thread_start_us":1440256,"threads_started":2,"wal-append.queue_time_us":1287756}
I20260709 12:22:29.303241 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:29.357693 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54544.1us
W20260709 12:22:29.357949 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59697.1us
I20260709 12:22:29.359062 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.303597 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.271796  1324 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.257647 31572 rpcz_store.cc:276] 0709 12:22:26.713144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.463798 (+750654us) service_pool.cc:224] Handling call
0709 12:22:27.464165 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.482735 (+ 18570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.482772 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.508111 (+ 25339us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.358637 (+850526us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:28.791787 (+433150us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.807098 (+ 15311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.808209 (+  1111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.256998 (+448789us) raft_consensus.cc:1685] finished
0709 12:22:29.257022 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.257156 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29279,"prepare.queue_time_us":509984,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":41451,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":7288,"thread_start_us":1008843,"threads_started":2,"wal-append.queue_time_us":1015664}
I20260709 12:22:29.248250  1116 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.262518  1087 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.315272  1180 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.329845  1313 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:29.311004   998 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:29.331777 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:29.304700  1319 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 12:22:29.328279  1304 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.328446 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.385072  1330 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.330669  1164 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.265076 31417 rpcz_store.cc:276] 0709 12:22:27.423207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.430358 (+  7151us) service_pool.cc:224] Handling call
0709 12:22:27.441587 (+ 11229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.412998 (+971411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.995210 (+582212us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b5400353ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:29.003152 (+  7942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137707904}
I20260709 12:22:29.329135  1249 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:29.340545 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 435) took 2127 ms. Trace:
I20260709 12:22:29.322281 31491 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.343118 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2374) took 1918 ms. Trace:
I20260709 12:22:29.345029  1219 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.334271 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.355659  1017 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.321692 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:29.365880 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.367914 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:29.408350 32080 connection.cc:256] RPC call timeout handler was delayed by -1.2153018540002449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 12:22:29.350775  1239 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:29.408913 32080 connection.cc:256] RPC call timeout handler was delayed by -1.1649018540001634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:22:29.409363 32080 connection.cc:256] RPC call timeout handler was delayed by -1.1618610040000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:22:29.368239  1331 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.368811  1162 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.368930  1253 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.370124 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2386) took 1912 ms. Trace:
I20260709 12:22:29.416410 31415 rpcz_store.cc:276] 0709 12:22:27.457597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.355303 (+1897706us) service_pool.cc:224] Handling call
0709 12:22:29.369650 (+ 14347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.369818 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.369841 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:29.369878 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:29.369907 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.369956 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.370072 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.371830  1244 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.373138 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1260) took 2721 ms. Trace:
W20260709 12:22:29.353688   824 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
W20260709 12:22:29.345906  1115 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.817s	user 0.016s	sys 0.008s
I20260709 12:22:29.374902 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:29.405164  1204 consensus_meta.cc:287] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.042s	user 0.005s	sys 0.014s
I20260709 12:22:29.439594  1149 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.439754 31494 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.376755 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.440533 31498 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:29.440817 31566 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:29.441159 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.441218 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.441484 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:29.441869 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2246) took 2794 ms (client timeout 1702 ms). Trace:
I20260709 12:22:29.442051 31498 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:29.396874  1180 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:29.442265 31566 rpcz_store.cc:269] 0709 12:22:26.647828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.975313 (+327485us) service_pool.cc:224] Handling call
0709 12:22:29.441712 (+2466399us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b5400261bd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:29.441802 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5649034752}
I20260709 12:22:29.443015 32107 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:29.443490 32107 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:29.444255  1017 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.444446  1180 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:29.353962  1120 consensus_meta.cc:287] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.003s
W20260709 12:22:29.386746  1208 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.566s	user 0.019s	sys 0.029s
I20260709 12:22:29.445061  1283 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.445283 32106 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:29.430164   824 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.445511  1208 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.445788  1283 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.446592 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:29.428121  1239 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.403020  1159 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:29.389801 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 86246.1us
I20260709 12:22:29.447620   824 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:29.390499 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 99531.3us
I20260709 12:22:29.448612 31416 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.448799  1239 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:29.397907 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 86636.3us
I20260709 12:22:29.431643  1228 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:29.450064 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1558374450000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 12:22:29.450435 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1558374450000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 12:22:29.428802  1330 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:29.451922  1228 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.452131 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:29.452263  1330 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:29.321632 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.453433 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:29.453564 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.453838 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.454110 31571 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.454229 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.401054  1205 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:29.394558  1126 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.038s	user 0.015s	sys 0.022s
I20260709 12:22:29.404332 31569 rpcz_store.cc:276] 0709 12:22:27.213621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.412962 (+1199341us) service_pool.cc:224] Handling call
0709 12:22:28.413310 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.715425 (+302115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.715476 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.715551 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:28.715610 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.340215 (+624605us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540023fd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:29.340272 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.340468 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694144256}
W20260709 12:22:29.412681 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100954us
I20260709 12:22:29.374643  1057 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.414872 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.423414  1321 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:29.424463 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:29.425136  1315 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:29.424400  1029 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.430052 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55246.4us
I20260709 12:22:29.511687 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:29.376031 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.405172 31421 rpcz_store.cc:276] 0709 12:22:27.424615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.424746 (+   131us) service_pool.cc:224] Handling call
0709 12:22:27.441014 (+ 16268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:27.453452 (+ 12438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:27.453484 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:27.453979 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.909359 (+1455380us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b1800245fe0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:22:29.233256 (+323897us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:29.233312 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.233386 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.342790 (+109404us) raft_consensus.cc:1685] finished
0709 12:22:29.342810 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.343059 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2540,"raft.queue_time_us":2962,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":58499,"spinlock_wait_cycles":19875200,"thread_start_us":323693,"threads_started":1,"wal-append.queue_time_us":1816423}
I20260709 12:22:29.442416 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:29.432176  1231 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.015s
I20260709 12:22:29.523599  1029 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.523725  1231 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.525183 32114 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:29.525918  1029 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.526132  1231 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:29.412204   992 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.010s
W20260709 12:22:29.433060  1285 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.924s	user 0.008s	sys 0.010s
I20260709 12:22:29.526881 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.437382  1238 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.438971 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.527911 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1317) took 1055 ms. Trace:
I20260709 12:22:29.438798  1115 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.528110 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.528355 31416 rpcz_store.cc:276] 0709 12:22:28.472308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.331430 (+859122us) service_pool.cc:224] Handling call
0709 12:22:29.527701 (+196271us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b5400353ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:29.527843 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124687104}
I20260709 12:22:29.529086 32114 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:29.530049 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.530197  1115 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:29.347092  1232 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.992s	user 0.019s	sys 0.017s
I20260709 12:22:29.530948  1232 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.394719  1313 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.448895  1159 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.374624   900 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.532061   900 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.532860  1313 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.453205  1330 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.455359 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:29.551280 31570 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:29.455612 31565 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:29.456228  1204 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.552870  1204 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.554852  1204 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.456964  1017 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:29.555568  1017 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.379240  1324 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.556444  1324 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:29.556566 31419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2379) took 2101 ms (client timeout 1668 ms). Trace:
W20260709 12:22:29.556967 31419 rpcz_store.cc:269] 0709 12:22:27.455508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.455791 (+   283us) service_pool.cc:224] Handling call
0709 12:22:29.556371 (+2100580us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540022f454. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:29.556487 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3501625088}
I20260709 12:22:29.557592  1017 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.418072 31574 rpcz_store.cc:276] 0709 12:22:26.711888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.243074 (+531186us) service_pool.cc:224] Handling call
0709 12:22:27.243430 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:28.359443 (+1116013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.359474 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:28.360036 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:22:28.823347 (+463311us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:28.853160 (+ 29813us) log.cc:844] Serialized 14 byte log entry
0709 12:22:28.853359 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:28.853439 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:29.250386 (+396947us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b180028e280. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:29.372769 (+122383us) raft_consensus.cc:1685] finished
0709 12:22:29.372906 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.373072 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69931,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":21404,"raft.run_cpu_time_us":1126,"raft.run_wall_time_us":14408,"spinlock_wait_cycles":56073088,"thread_start_us":1501616,"threads_started":2,"wal-append.queue_time_us":502896}
I20260709 12:22:29.438980 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.559113 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:29.559672 32105 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.429525  1331 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.439659 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:29.562453 31573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1251) took 2913 ms (client timeout 1565 ms). Trace:
I20260709 12:22:29.403615  1171 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.563524 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.563629  1171 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.564392  1331 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.412312  1249 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.564821  1324 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.565910  1171 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.566298  1249 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.461272  1089 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.461570 32108 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:29.567255  1324 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.568140  1089 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.418473  1162 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:29.412640  1304 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.463233 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2383) took 2006 ms. Trace:
I20260709 12:22:29.416201  1253 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.440557 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 549) took 2303 ms. Trace:
I20260709 12:22:29.468032  1087 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.469205 31568 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:29.442535 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.575472 31500 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:29.399511  1335 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.476114 31415 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:29.479769 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.579901 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1316) took 1199 ms. Trace:
I20260709 12:22:29.580215 32109 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:22:29.482575 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.483539 31571 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:29.496743 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:29.580389 31415 rpcz_store.cc:276] 0709 12:22:28.380329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.417684 (+1037355us) service_pool.cc:224] Handling call
0709 12:22:29.475954 (+ 58270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.579552 (+103598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.579831 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:29.497488 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:29.581683 31465 connection.cc:256] RPC call timeout handler was delayed by -1.6728199069998482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:22:29.581683 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85072.8us
I20260709 12:22:29.584089 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:29.534053  1126 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.431627 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:29.455353  1328 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:29.475476  1186 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:29.475356  1205 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:29.518888  1282 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:29.447633  1208 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.520147  1057 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:29.587033  1213 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.028s
I20260709 12:22:29.512099  1239 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:22:29.509449  1201 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.512400  1120 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:29.544899 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.548182  1283 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.548756  1244 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.549216  1238 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:29.615554  1238 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:29.615887  1157 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.616443  1238 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.555888 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2373) took 2131 ms. Trace:
I20260709 12:22:29.618818 31418 rpcz_store.cc:276] 0709 12:22:27.424291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.424408 (+   117us) service_pool.cc:224] Handling call
0709 12:22:27.424692 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.368330 (+943638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:28.368358 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:28.368394 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:28.368423 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.555686 (+1187263us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b5400212ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:29.555728 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:29.555838 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169756928}
I20260709 12:22:29.386997   625 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:29.562871 31573 rpcz_store.cc:269] 0709 12:22:26.649456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.769963 (+120507us) service_pool.cc:224] Handling call
0709 12:22:29.562255 (+2792292us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400058554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:29.562384 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3251756288}
I20260709 12:22:29.569449 31422 rpcz_store.cc:276] 0709 12:22:27.456809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.515618 (+1058809us) service_pool.cc:224] Handling call
0709 12:22:29.463049 (+947431us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54002134d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:29.463175 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551661312}
I20260709 12:22:29.570600 32113 rpcz_store.cc:276] 0709 12:22:27.137102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.431409 (+1294307us) service_pool.cc:224] Handling call
0709 12:22:28.520141 (+ 88732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:28.861199 (+341058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:29.440253 (+579054us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400631fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:29.440494 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759249280}
I20260709 12:22:29.571626 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.621125 31496 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:29.572912 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 61310.3us
W20260709 12:22:29.573475 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 149958us
I20260709 12:22:29.622777  1201 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.594717  1205 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:29.624156 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:29.573940 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 197979us
I20260709 12:22:29.625206 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:29.500263  1180 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:29.626770 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.606590  1186 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.627573 31419 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:29.629267 32114 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:29.629470 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:29.589243  1126 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:29.587381 32109 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:29.646864  1126 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:29.510444 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 86107.4us
I20260709 12:22:29.589835 31498 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:29.649852 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.630021 31422 raft_consensus.cc:2376] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5. Re-sending same reply.
I20260709 12:22:29.649852 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.657173 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.587663 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:29.658667 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71067us
I20260709 12:22:29.659202 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.589514 32110 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:29.660006 31571 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:29.652568  1230 raft_consensus.cc:2764] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:29.570374  1162 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.574753  1253 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.416460  1258 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.579308  1335 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.586794  1087 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.607939   900 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.588948 31491 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:29.710377 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:29.710992 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.585405  1089 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.588476  1171 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.609994  1213 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.576575 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.634783  1186 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.578609  1304 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.592466  1249 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:22:29.636750 31493 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:29.640756   625 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.526901   992 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.640978 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.641606 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.705365  1149 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:29.536259  1321 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.644986  1180 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:29.646420  1288 consensus_meta.cc:287] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.059s	user 0.017s	sys 0.010s
I20260709 12:22:29.760362  1288 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.652722 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.760594  1180 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.761297   992 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:29.570853  1315 consensus_queue.cc:1243] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:22:29.717935  1239 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:29.666425 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.668617 31496 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:29.679912 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:29.680737 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.768774 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.769150 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.667969 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:29.668639 32080 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.834s (SENT)
I20260709 12:22:29.770028 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:29.770326 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 102428us
W20260709 12:22:29.770948 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102336us
I20260709 12:22:29.683179 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:29.709179 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.711189 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:29.773733 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 90724.1us
I20260709 12:22:29.746176 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.711067 32110 raft_consensus.cc:606] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:29.787330 32110 raft_consensus.cc:614] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:29.715526 31572 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:22:29.787973 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 108135us
I20260709 12:22:29.715981 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.789885 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:29.727680 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.791208 31424 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.705758  1282 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.733192 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:29.734758 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.795343 31568 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:29.707043  1334 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.735267 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.704635  1157 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:29.737541 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.802237 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.740099 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.709214  1335 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:29.741205 31389 connection.cc:256] RPC call timeout handler was delayed by -2.3121965549999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:22:29.678601  1120 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:22:29.744166 31499 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:29.743254 31573 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:29.730628  1089 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.746232 31418 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:29.642856  1244 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.763904 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.708979  1286 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:22:29.660876 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.715637  1258 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.812427 31422 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:29.652892  1219 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.802522  1305 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.004s
I20260709 12:22:29.796334  1315 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.798774  1282 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.798985 31500 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.797663  1057 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:29.801126 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:29.798328  1290 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.774442 31420 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:29.815070 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.833741 31495 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:29.791895  1087 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:29.794863   992 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:29.799814  1171 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.811672 31498 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6. Re-sending same reply.
I20260709 12:22:29.793145 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.817152 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.800534 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.801637 31417 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:29.808357  1068 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:22:29.777766 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 111715us
I20260709 12:22:29.850440 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:29.850900 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57866.7us
I20260709 12:22:29.851522 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:29.833534 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.803681 31497 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.800820  1283 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.832594 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:29.836555  1087 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:29.843659  1029 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.799007  1159 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:29.870312  1029 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.881770  1029 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.881927 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.882579 31498 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:29.885898 31498 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.838310 32109 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:29.805398  1334 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.827190  1219 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.832621  1282 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.889943  1334 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.890966  1321 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.899638  1089 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.901275  1087 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.869344 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.907156  1213 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.801017  1157 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:29.833189  1290 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.834709 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.921532 32110 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:29.856832 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.923364 31495 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.823976 31419 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.847520 32105 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:29.926239 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.926959 32105 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:29.927596  1205 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.858002  1286 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:29.858297  1283 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.858407 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.823508  1340 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:22:29.923326  1290 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.856586  1239 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.856478  1244 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:29.867588 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.867827  1258 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.825958  1305 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.843187  1330 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.844358  1171 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.872740 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.874922 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:29.947343 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.948014 31424 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:29.947968 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 73162us
I20260709 12:22:29.834626 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:29.950104 31496 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:29.877466 31389 leader_election.cc:336] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.565s (SENT)
I20260709 12:22:29.878175  1068 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.880177  1335 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.881242  1159 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:29.888046 31498 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:29.852939 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:29.952543 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75105.3us
W20260709 12:22:29.953042 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100221us
I20260709 12:22:29.953701 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:29.913318 31500 raft_consensus.cc:2410] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:29.956386  1335 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.913918 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:29.919191 31497 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:29.848798   992 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:29.959342  1244 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:29.960139   992 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.960870  1159 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:29.961179  1201 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.962131 31492 raft_consensus.cc:2368] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:29.961812  1159 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.920818  1157 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.963178  1159 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.934011 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.967173 31415 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.943305  1239 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.967298 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94613.8us
I20260709 12:22:29.967717  1239 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.968052 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.968824 31415 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:29.969259  1238 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:29.969666 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.929059  1253 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.970940 32113 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:29.972002  1253 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.938325 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:29.973453 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.923087  1087 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.976439  1249 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:29.931066  1304 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:29.931041  1286 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:29.925025  1291 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.939850 31421 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:29.934237  1283 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.940819 31422 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:29.858032  1126 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.943883 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:29.992570 32110 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.943125 31495 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:29.931348  1205 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.996865 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.996946 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.997342  1162 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.998179 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.942221 31491 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.999943 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.007344 31423 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.008275 32111 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.015168 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1245) took 1099 ms. Trace:
I20260709 12:22:30.016049 31492 rpcz_store.cc:276] 0709 12:22:28.915561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.918156 (+  2595us) service_pool.cc:224] Handling call
0709 12:22:29.328269 (+410113us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:30.014938 (+686669us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003bb354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:30.015104 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302234624}
I20260709 12:22:30.020972  1029 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:29.988612  1017 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.988920  1330 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.025079 31419 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:29.989099  1258 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.027046  1258 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.027407  1258 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:30.028445 31318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 297) took 13699 ms (client timeout 15000 ms). Trace:
I20260709 12:22:30.031553  1305 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.960666  1244 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:29.992651  1286 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.032739 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.033447 31494 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.969812  1238 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:29.977375 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.049641 31572 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:30.050778 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:29.977465 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.968698 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:29.978084 32106 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:29.937449 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.967060 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:29.938365 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:29.979247  1171 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.976941  1249 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:30.060544 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1315) took 1707 ms. Trace:
I20260709 12:22:29.967037  1068 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.040892 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.041929 31570 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:30.034408 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.063354 31422 raft_consensus.cc:2376] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:22:30.064396 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.055110 31424 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:30.054608 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.056667 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:30.058056 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89423.5us
I20260709 12:22:30.059535 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.070562  1068 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.070418  1238 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.071189  1249 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.072472  1249 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.990726  1204 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:30.062209 31568 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:30.002398  1126 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:29.995142  1282 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.061013 31417 rpcz_store.cc:276] 0709 12:22:28.353324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.415737 (+1062413us) service_pool.cc:224] Handling call
0709 12:22:29.439242 (+ 23505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.854833 (+415591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.000792 (+145959us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54003e9254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:30.060464 (+ 59672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744887680}
I20260709 12:22:29.998242 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.090490 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.091508 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.092690 31420 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.082577 32110 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:22:30.084056 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.033922  1291 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.086122 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:30.086494  1347 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 12:22:30.061851  1228 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.088501 31415 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.126999 31565 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 2.
W20260709 12:22:30.127445 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44756.4us
I20260709 12:22:30.130807 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.130349 31421 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:22:30.131817 31421 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 4
I20260709 12:22:30.130934 31422 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:30.056037 31491 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:30.136516 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.074910 32108 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:30.139353 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 367787us
I20260709 12:22:30.142153 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:29.976946  1157 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.126926  1228 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.141194 32079 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:30.028856 31318 rpcz_store.cc:269] 0709 12:22:16.329129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.348838 (+ 19709us) service_pool.cc:224] Handling call
0709 12:22:30.028361 (+13679523us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:24.281620 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:24.284788 (+  3168us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:24.284849 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:22:24.284862 (+    13us) tablet.cc:662] Decoding operations
0709 12:22:24.285941 (+  1079us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:24.286012 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:24.286042 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:22:24.335014 (+ 48972us) tablet.cc:701] Row locks acquired
0709 12:22:24.349686 (+ 14672us) write_op.cc:260] PREPARE: finished
0709 12:22:24.401327 (+ 51641us) write_op.cc:270] Start()
0709 12:22:24.423617 (+ 22290us) write_op.cc:276] Timestamp: P: 1783599744379362 usec, L: 0
0709 12:22:24.423647 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:22:24.467103 (+ 43456us) log.cc:844] Serialized 3658 byte log entry
0709 12:22:24.753684 (+286581us) op_driver.cc:464] REPLICATION: finished
0709 12:22:25.139774 (+386090us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc11d199ef0
0709 12:22:25.446728 (+306954us) write_op.cc:301] APPLY: starting
0709 12:22:25.446864 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:25.447088 (+   224us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:25.447125 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:25.809859 (+362734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:26.015089 (+205230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:22:26.024947 (+  9858us) write_op.cc:312] APPLY: finished
0709 12:22:26.101073 (+ 76126us) log.cc:844] Serialized 71 byte log entry
0709 12:22:26.745079 (+644006us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b
0709 12:22:27.056720 (+311641us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:27.102074 (+ 45354us) write_op.cc:454] Released schema lock
0709 12:22:27.116008 (+ 13934us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:27.121676 (+  5668us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:27.121714 (+    38us) write_op.cc:454] Released schema lock
0709 12:22:27.233244 (+111530us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18000ff580. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
Metrics: {"mutex_wait_us":228460,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":525905,"apply.run_cpu_time_us":56859,"apply.run_wall_time_us":1812430,"num_ops":9,"prepare.queue_time_us":177691,"prepare.run_cpu_time_us":10219,"prepare.run_wall_time_us":252304,"raft.queue_time_us":174710,"raft.run_cpu_time_us":29895,"raft.run_wall_time_us":574393,"replication_time_us":274007,"spinlock_wait_cycles":49086848,"thread_start_us":1505238,"threads_started":5,"wal-append.queue_time_us":962517,"wal-append.run_cpu_time_us":62735,"wal-append.run_wall_time_us":2142203}]]}
I20260709 12:22:30.144075 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.143134 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.145117 31491 raft_consensus.cc:2410] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:30.154726  1304 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.143365 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:30.147418 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.143397 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.155836 31417 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.156277 31495 raft_consensus.cc:2368] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:30.155830 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.156726 31498 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:30.155150 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.157050 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.157526 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.158004  1230 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:30.158208 31498 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:30.158372  1230 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:30.158461 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.158905  1230 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:30.159264 31495 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:30.159132 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.160230   900 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.161463 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:30.162739 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.163381 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.163662 31495 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:30.165261 32110 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.163712  1228 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.167042 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.167699 32105 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:30.162580  1325 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.168831  1325 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:30.169752  1325 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.172279 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.172848 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.132043 31421 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:22:30.174695 31421 raft_consensus.cc:2917] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:22:30.173578 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.171916   773 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.126235  1116 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:30.176889 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.178874 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.179054 32109 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:30.138474 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.181165 31421 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:30.184031 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.184568 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.185331 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.185436 31491 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.185570 32109 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:22:30.190337 32113 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:30.130338  1126 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:22:30.155138  1304 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:30.196550 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.142940  1305 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:22:30.175993  1321 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:30.144512  1288 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:22:30.146739  1201 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:22:30.201898 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 66954.2us
I20260709 12:22:30.179993 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.202878 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.204164 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.177997  1029 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.182668  1239 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.214434 31574 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.193991  1162 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.227394   992 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:30.229187 31498 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:30.197750  1116 consensus_queue.cc:1243] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:22:30.199952  1356 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:22:30.200863  1304 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.289976 31417 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:30.274187 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:30.243788 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 290427us
W20260709 12:22:30.279546 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75469.7us
W20260709 12:22:30.236050 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.321491 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.322515 31568 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:30.323304 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.324132 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:30.325310 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.209267  1321 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.302286 31422 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.218925 31492 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:30.200575  1330 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.336733 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.337445 31568 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.338099 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.230592  1245 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:30.339545 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.338557 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.344485 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.344823 31570 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:30.336023 31422 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.342375 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.346055 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.344058 31572 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:30.231935  1239 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.347081 31566 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.297921  1204 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.342612 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.350867 31571 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.348248 31572 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.345609 32109 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:30.297741   992 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:30.359114 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.362488 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.363432 31573 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.333810  1321 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.367854 31571 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:30.337018  1018 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:22:30.357278  1164 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:30.331935 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.381573 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.383283 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.386991 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.389679 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.399106 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.374603 31573 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:30.409337 31571 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:30.456514 31566 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:30.457037 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.457647 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.456610 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.458868 31421 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:30.459162 31571 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:30.465204 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.466944 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.357527  1243 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:30.470106 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.343226  1283 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.382579 31493 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:30.464784  1361 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:22:30.474165 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.510442 31566 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.479485 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.512549 31573 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:30.480225 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.470332 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1205) took 2097 ms. Trace:
I20260709 12:22:30.513738 31499 rpcz_store.cc:276] 0709 12:22:28.372629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.599026 (+226397us) service_pool.cc:224] Handling call
0709 12:22:28.599376 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.808727 (+1209351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.470123 (+661396us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000253d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:30.470281 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2632383360}
I20260709 12:22:30.515416 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.516098 31499 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.491633 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.492539 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.463798  1245 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.381124  1282 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:30.361410  1204 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.533583 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.469709  1186 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.550664 31570 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:30.476938  1340 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:30.381480  1164 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:30.563227 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 214543us
I20260709 12:22:30.557610 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.529198 32108 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:22:30.493695 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.574383 31572 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.567303 31570 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.574890 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.575601 31420 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.575799 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.571398 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.576479 31573 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:30.577307 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.577553 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.506836  1291 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:30.581807 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.568305 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 559) took 1146 ms. Trace:
I20260709 12:22:30.470572  1313 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:22:30.584597 32106 rpcz_store.cc:276] 0709 12:22:29.421589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.446341 (+ 24752us) service_pool.cc:224] Handling call
0709 12:22:30.568161 (+1121820us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54007300d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:30.568252 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861897600}
I20260709 12:22:30.580688 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.568285 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.586007 31420 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.469748  1017 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:22:30.572250 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:30.546074  1157 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.573349 32108 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 4
I20260709 12:22:30.590763 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.486822  1243 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.606674 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.610224 31420 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:30.598598 31573 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:30.589143 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.565227  1245 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:30.602746 31424 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.631624 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1229) took 1017 ms. Trace:
I20260709 12:22:30.632014 31496 rpcz_store.cc:276] 0709 12:22:29.614719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.950967 (+336248us) service_pool.cc:224] Handling call
0709 12:22:29.951288 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.951685 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.951724 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.988888 (+ 37164us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.088103 (+ 99215us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:30.088158 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.088250 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.631428 (+543178us) raft_consensus.cc:1685] finished
0709 12:22:30.631449 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:30.631569 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":86748,"threads_started":1,"wal-append.queue_time_us":183679}
I20260709 12:22:30.633652 31570 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:30.566661  1340 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:30.556535 31494 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:30.597416 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:30.640237 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:30.605652 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.505406  1162 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:22:30.646965 31491 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:30.566469  1186 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.634119 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.604542 32108 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:22:30.648416 31496 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
W20260709 12:22:30.651363 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44774.4us
I20260709 12:22:30.652537 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:30.504102 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.642802 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.645233 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.527920   992 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.605479  1126 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.637662 31566 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:30.628835  1087 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.008s
I20260709 12:22:30.622522  1232 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.656222 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.660261 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.662925 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.668938 31495 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.648070  1340 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.638144   900 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:30.662699  1362 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:22:30.671823 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.680044 31573 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:30.671485 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.675297 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.676317 31499 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:30.626308  1228 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.653450  1253 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.653621 32108 raft_consensus.cc:2917] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:22:30.654439  1213 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.687090 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.681089  1288 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:30.656236 31494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1216) took 1158 ms (client timeout 1509 ms). Trace:
I20260709 12:22:30.703706 31424 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.704149 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.705526 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.662268 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.678092 31495 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:30.688593  1068 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.001s
I20260709 12:22:30.701175 31566 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:30.695384   992 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.682111  1365 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.720055 31415 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.692832  1164 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.692023  1371 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.693461  1253 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:30.729581 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.732187 31566 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.700573  1288 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.710490 32108 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:30.732360 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.709566  1201 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.713122  1281 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:30.739190 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.693753  1364 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:22:30.697710  1089 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:30.779735 31422 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.737000   900 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:30.740459 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 110844us
W20260709 12:22:30.781057 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75642.3us
I20260709 12:22:30.775915 31566 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:30.774391 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.782225 31424 raft_consensus.cc:2410] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:30.783413 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.784996 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.786523 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.736213  1253 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.737983  1288 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.787724 31566 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.783753  1204 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:30.799256  1159 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.000s
I20260709 12:22:30.817708 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.691233  1245 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.761502  1243 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.739250  1283 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.725826  1365 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:30.719399 31493 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:30.793234 31568 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:30.794422 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:30.735909  1126 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:30.784246  1290 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.835s	user 0.005s	sys 0.006s
I20260709 12:22:30.719687  1068 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:30.703718 31494 rpcz_store.cc:269] 0709 12:22:29.497818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.522210 (+ 24392us) service_pool.cc:224] Handling call
0709 12:22:30.032584 (+510374us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:30.654478 (+621894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27528064}
I20260709 12:22:30.788872 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.856427 31422 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.789759  1057 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:22:30.802783 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.802731  1364 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:30.869068  1364 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:30.869956  1364 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.871166  1364 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:30.872315 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:30.873011 32105 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:30.804109  1171 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.000s
I20260709 12:22:30.873963 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:30.856927  1371 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:30.875469 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.876473 31566 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:30.806829  1230 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.004s
I20260709 12:22:30.807288  1186 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.807847  1228 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.881668 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.832737  1325 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.813055 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.884150 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.797545  1089 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:22:30.815321  1249 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 12:22:30.877375 32105 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:30.826155 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.889050 31415 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:30.889892 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:30.794737  1360 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 12:22:30.851871 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57770.7us
I20260709 12:22:30.853142 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:30.890622 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.853835 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.892367 31568 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:30.855129 32113 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:22:30.854930  1290 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.900626 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.901818 31493 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.902505  1290 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.801955 31322 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 2 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:30.903563 31322 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:22:30.904955 31322 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 4, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 4 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.906960 31571 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:30.860800  1288 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.907050 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.908166 31493 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:30.909073  1288 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.852294  1243 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:22:30.866959  1286 consensus_meta.cc:287] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.019s
I20260709 12:22:30.866847  1057 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:30.855897  1330 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.868132 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.909893  1286 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.910097  1330 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.912074  1330 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.912135  1286 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.868635  1068 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.912688  1330 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:30.913909 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:30.914299 31570 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:30.878938 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82460.1us
I20260709 12:22:30.880743 31418 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:30.882795 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.883298 31422 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:30.891525 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.884720 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.886696 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.815671  1229 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:30.869855 32107 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:30.809432   773 consensus_meta.cc:287] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.621s	user 0.002s	sys 0.006s
W20260709 12:22:30.878966 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.914466 31415 raft_consensus.cc:2376] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4. Re-sending same reply.
I20260709 12:22:30.929147 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.909971 31420 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.915305 31322 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.936038 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:30.937714 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:30.920799  1304 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:22:30.939244  1304 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.941951  1304 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:30.887864  1325 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.945217  1325 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:30.945618 32111 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:30.945799 32106 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.946626 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:30.920540 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:30.947261 32111 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.947582 31494 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.947963  1340 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.951864 32113 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:22:30.938370 32105 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.916432 31568 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:30.919638 31566 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:30.854070  1365 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.951877  1288 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:30.965438  1288 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:30.965804  1288 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.881780  1232 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:30.959811  1240 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.882638  1283 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.924350 31540 leader_election.cc:400] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:30.951648  1201 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.971585 31540 leader_election.cc:403] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:30.972406 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48186.5us
I20260709 12:22:30.973750 31540 leader_election.cc:400] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:30.974038 31540 leader_election.cc:403] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:22:30.974282 32107 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.888382  1228 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.873976  1171 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:30.883420  1230 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:30.951104  1371 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:30.922475  1229 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:31.024188 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.999691 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.928395  1377 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:30.971269  1321 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:22:30.973474  1205 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:30.918397 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:31.057986 31422 raft_consensus.cc:2368] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:31.059038 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:31.059284 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:31.059976 31422 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:31.060873 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:31.061998 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.925782 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.975245 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:31.063261 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 137612us
W20260709 12:22:31.063966 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89344us
I20260709 12:22:31.065249 31422 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:30.957248 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:30.975680 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.068703 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.066160 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:30.996879  1366 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.342s	user 0.000s	sys 0.003s
I20260709 12:22:30.981596 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:30.962265  1340 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:30.997087 31424 raft_consensus.cc:2410] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:30.919014 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:31.014412 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:31.028820 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:30.993314 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1319) took 2401 ms. Trace:
I20260709 12:22:31.010188 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:30.993460 31421 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:31.027467 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:31.025528 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:30.962430 31322 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 3, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.055265 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:30.986320 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.054162  1377 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:30.991906  1258 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.964s	user 0.002s	sys 0.009s
I20260709 12:22:31.073444 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.075166 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 396) took 1406 ms. Trace:
I20260709 12:22:31.130071 31500 rpcz_store.cc:276] 0709 12:22:29.668984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.956139 (+287155us) service_pool.cc:224] Handling call
0709 12:22:29.956397 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:29.956711 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:29.956735 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:29.957193 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.219553 (+262360us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:30.298877 (+ 79324us) log.cc:844] Serialized 14 byte log entry
0709 12:22:30.299405 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.299502 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.016955 (+717453us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800304840. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:31.074905 (+ 57950us) raft_consensus.cc:1685] finished
0709 12:22:31.074990 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.075112 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78044,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":15052,"raft.queue_time_us":631,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":17289,"spinlock_wait_cycles":26108288,"thread_start_us":253136,"threads_started":1,"wal-append.queue_time_us":340268}
W20260709 12:22:31.132910 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59531.1us
I20260709 12:22:31.133368 31500 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:31.133957 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:30.982456 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.076619 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:31.077658 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54967.6us
W20260709 12:22:31.135380 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58891us
I20260709 12:22:31.135492 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:31.077910  1243 consensus_queue.cc:1243] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:30.984858  1245 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:30.980878  1290 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.126376  1369 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:30.976667 32111 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:31.121594 31570 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.121958 31418 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:31.121744 31423 rpcz_store.cc:276] 0709 12:22:28.592383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.355341 (+762958us) service_pool.cc:224] Handling call
0709 12:22:30.993093 (+1637752us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400148a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:30.993250 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375452928}
I20260709 12:22:31.074801  1286 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.123549 31571 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:31.072288 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.049845  1228 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.124739 31496 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:31.126951 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 208017us
I20260709 12:22:31.066663  1250 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:22:31.075984 31566 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:31.135802 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.136026 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:30.971511  1283 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.024142  1116 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:22:31.072868   992 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.180049 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 567) took 1007 ms. Trace:
I20260709 12:22:31.139397 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:31.180402 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.983760  1201 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:31.141882  1138 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:31.074928  1249 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:31.080273  1330 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:31.122924 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67725.7us
I20260709 12:22:31.151193 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:31.198475 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.199599 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.152254  1291 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:30.986497  1365 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.121804  1371 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:31.164990 31570 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:31.125943 31322 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.204613 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:31.205247 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:31.173554  1149 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.159212 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.206565 31571 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:31.207703 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.208603 31571 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:31.209744 31571 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:31.168757 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:31.169268 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 233901us
I20260709 12:22:31.171363 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:31.211185 31568 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:31.211481 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:31.212323 31568 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:31.171631 32107 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:30.988183  1253 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.214972 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:31.129633  1377 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.215798  1253 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:31.216393  1253 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:31.201145  1291 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:31.217494  1388 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.217940  1388 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.218423  1388 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.216727  1253 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.080042  1087 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:22:31.219132  1253 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:31.214619 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 543) took 4171 ms. Trace:
I20260709 12:22:31.219429  1087 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:31.219940  1087 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:31.071416  1321 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.219759 32107 rpcz_store.cc:276] 0709 12:22:27.042829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.047617 (+  4788us) service_pool.cc:224] Handling call
0709 12:22:27.227793 (+180176us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:27.228073 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:29.442920 (+2214847us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400117ea0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196dadc0 00007fc1197651c0 00007fc119766231 00007fc119762d8f 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c
0709 12:22:30.213852 (+770932us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400117ea0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196e106f 00007fc119759f60 00007fc11975b7de 00007fc119765b49 00007fc119766416 00007fc119762d8f 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62
0709 12:22:30.869520 (+655668us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b5400117ea0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196e0520 00007fc119759f70 00007fc11975b7de 00007fc119765b49 00007fc119766416 00007fc119762d8f 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62
0709 12:22:31.214324 (+344804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.214541 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3585870336}
I20260709 12:22:31.220836  1087 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.138566 31567 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:31.221449 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.079885  1186 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:22:31.200068 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:31.224009  1243 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.195444 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:31.140132  1229 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:31.226644  1386 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 12:22:31.228396  1387 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:22:31.187778   773 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.228642 32108 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.228993   773 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.229449   773 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.172248  1340 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.233393  1371 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:31.234337  1371 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.240139  1171 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:31.240963  1171 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.244527  1335 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:31.247675  1374 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:31.248325  1374 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:31.249356  1374 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.199673  1205 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.251655 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.251919  1205 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:31.252365  1205 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:31.253382 31569 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:31.253270  1205 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:31.255053 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119635us
I20260709 12:22:31.252424 32109 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:31.140050  1258 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.173190  1245 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.205758 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:31.205412 31322 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:22:31.322113 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 154469us
I20260709 12:22:31.321379 31322 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.971289  1240 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.214195 31568 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:31.326848 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 254637us
I20260709 12:22:31.170079  1228 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.197659  1330 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:31.326355 31322 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.260164 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:31.180445 32110 rpcz_store.cc:276] 0709 12:22:30.172892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.173011 (+   119us) service_pool.cc:224] Handling call
0709 12:22:30.173301 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.173719 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.173762 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.178784 (+  5022us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.342026 (+163242us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.342096 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.342161 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:30.996207 (+654046us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:31.179747 (+183540us) raft_consensus.cc:1685] finished
0709 12:22:31.179768 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.179978 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":545,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7541,"spinlock_wait_cycles":3780992,"thread_start_us":140188,"threads_started":1,"wal-append.queue_time_us":401330}
I20260709 12:22:31.278221 31566 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:22:31.278661 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 110013us
I20260709 12:22:31.323354 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:31.196333  1249 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.326952 32109 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:31.218823  1254 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:22:31.328457 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.216732 32105 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:31.405622 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 77270.3us
W20260709 12:22:31.407155 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 56107.1us
I20260709 12:22:31.226670  1229 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.407843 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.343474 31322 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 4, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 4 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.407900 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.413398 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.415624 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.255345  1138 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:31.410804 32114 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:22:31.420066 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.429332 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 250285us
I20260709 12:22:31.422508 32112 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:31.326465  1087 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.439854 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.442723 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.443439  1204 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:31.408814  1330 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:31.460407 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 137141us
W20260709 12:22:31.460718 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 200662us
I20260709 12:22:31.410212  1281 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.280449  1243 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.421841  1116 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:31.487821  1116 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:31.488091  1126 consensus_meta.cc:287] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.003s
I20260709 12:22:31.488600  1126 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.488829  1116 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:31.491315  1288 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.000s
I20260709 12:22:31.407207  1249 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.417039  1162 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.470141 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:31.494166 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51777.1us
I20260709 12:22:31.495236 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.495712 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:31.468967  1201 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.475960  1204 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:31.476163  1385 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.476706  1379 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.477113  1219 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:31.477268  1305 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:31.477735 31466 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.750s (SENT)
I20260709 12:22:31.504999 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:31.438467   992 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:31.410250  1286 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:22:31.479055  1382 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:31.479830  1238 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:31.480300 32112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 451) took 2671 ms (client timeout 1995 ms). Trace:
W20260709 12:22:31.529028 32112 rpcz_store.cc:269] 0709 12:22:28.808914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:28.809061 (+   147us) service_pool.cc:224] Handling call
0709 12:22:31.480104 (+2671043us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400730354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:31.480205 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5995459456}
I20260709 12:22:31.481084  1258 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:31.408324  1367 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:22:31.483721  1290 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:31.485709  1377 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.486745  1321 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:31.505191  1379 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.459969  1283 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:31.487200 31494 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.000s
I20260709 12:22:31.471494 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.600451 31494 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
W20260709 12:22:31.600926 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 129517us
I20260709 12:22:31.602492 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.455945  1245 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.507063 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.458611  1120 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:31.506609 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 64105.1us
I20260709 12:22:31.416510  1171 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:22:31.534277  1385 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:31.604369  1120 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.604882  1385 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.605288  1120 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.500844  1230 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:31.605908 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.508368 32107 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.606510  1120 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:31.603763 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:31.595638 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 100022us
I20260709 12:22:31.528510  1219 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:22:31.531183   992 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.508682  1392 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:31.508580  1389 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.529767  1384 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:31.503682  1288 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.534200  1205 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.491694  1304 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:22:31.470839  1369 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.716826  1369 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.475987  1138 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.535183  1382 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.721309  1377 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:31.722054 31493 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:31.724023  1205 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.724614  1400 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.724766  1205 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.725406  1205 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:31.725777  1205 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:31.726190  1205 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:31.593958 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 66367.1us
W20260709 12:22:31.618039 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.626264 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:31.688048 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 181069us
I20260709 12:22:31.690876 32111 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
W20260709 12:22:31.746528 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 120370us
I20260709 12:22:31.747844 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.749691 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.599474  1379 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.493430  1281 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.611372  1238 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:31.699251 31419 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1332) took 1755 ms (client timeout 1950 ms). Trace:
I20260709 12:22:31.610662 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:31.823685 31419 rpcz_store.cc:269] 0709 12:22:29.943779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.999486 (+ 55707us) service_pool.cc:224] Handling call
0709 12:22:31.698984 (+1699498us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54003ed354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:31.699147 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56256896}
W20260709 12:22:31.824304 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 213676us
I20260709 12:22:31.781466 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.821111  1382 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.688325  1245 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.687922  1389 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:31.796231 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48503.6us
W20260709 12:22:31.828517 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47171us
I20260709 12:22:31.760100  1171 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.841106  1171 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.843246  1171 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.830529  1367 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.847885  1382 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.849555  1249 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.832222 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.831346 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.816844  1283 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.817436  1392 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:31.853287 31574 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:31.853775 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.822288  1157 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:31.775192  1384 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:31.859362 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 423615us
I20260709 12:22:31.609127  1326 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 12:22:31.821956  1321 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.822647  1238 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.860139 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.869725 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:31.761814  1398 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.870389 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.872125 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:31.875204 31570 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:31.877458 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:31.871042 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:31.880601 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:31.881934 32112 raft_consensus.cc:2368] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:31.836563  1389 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.859395  1245 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:31.887375 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 283685us
I20260709 12:22:31.887436 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:31.896788 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:31.864722  1171 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.866641  1157 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.864645  1367 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:31.882236  1253 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.011s
I20260709 12:22:31.881809 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:31.874070  1400 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:31.883805  1238 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.900588 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:31.882535  1290 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:31.889248  1388 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.004s
I20260709 12:22:31.882045  1392 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.942298 31495 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:31.889123  1399 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:31.902796  1283 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:31.903827  1219 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.895974  1286 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:31.886137  1321 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.913501  1398 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:31.955054 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 84081.7us
I20260709 12:22:31.919494  1385 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.886284   992 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.961388 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.964825 32109 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:31.962144 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:31.972025 31495 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:31.951602  1286 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.972973 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:31.945657  1400 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:31.918896  1253 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.919149  1245 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:31.976438 31537 leader_election.cc:400] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:31.976773 31537 leader_election.cc:403] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:22:31.957553 32105 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:31.970281 32108 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:31.979413  1288 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:31.979207  1392 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:31.959326  1283 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:31.964947  1385 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.975368  1286 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.973659  1157 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.956276  1388 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.918471  1367 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.965072  1219 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:22:32.012272  1228 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.003s
I20260709 12:22:32.012776  1228 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.014462  1228 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.974795  1171 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:22:32.032498  1389 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.012092  1157 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.978063  1398 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:22:31.948429  1384 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.041193  1389 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.957765  1399 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:31.992105  1385 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.024504  1249 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:31.982764  1404 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
W20260709 12:22:32.044792  1402 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:22:32.042110  1405 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:22:32.027671  1205 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.071661  1398 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.076165 31492 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:32.077843  1249 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:32.091041  1249 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:32.091921  1249 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.082252 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:32.095713 32105 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:32.096678 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:32.082119  1411 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:22:32.117471 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 220525us
W20260709 12:22:32.122115 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45372.6us
I20260709 12:22:32.043919  1283 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.128340  1253 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.128659 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.130812  1367 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:32.122997 31465 leader_election.cc:336] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.702s (SENT)
I20260709 12:22:32.131728 31494 raft_consensus.cc:2376] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5. Re-sending same reply.
I20260709 12:22:32.133718 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.135142 31540 leader_election.cc:400] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
W20260709 12:22:32.121373  1087 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.662s	user 0.017s	sys 0.000s
W20260709 12:22:32.135337  1229 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.003s
I20260709 12:22:32.117817  1321 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.137157 31540 leader_election.cc:403] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:22:32.140328 31465 leader_election.cc:336] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.772s (SENT)
I20260709 12:22:32.140393 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:32.142356 31465 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.885s (SENT)
I20260709 12:22:32.142695 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.142845 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:32.145159 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.145370  1171 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.146045  1087 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.160629 31569 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:32.163476 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:32.164064 31569 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:32.147382 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.035763  1400 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.166661 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.167243 31567 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6. Re-sending same reply.
I20260709 12:22:32.148407 31568 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:22:32.146268 31465 leader_election.cc:336] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.934s (SENT)
I20260709 12:22:32.168135 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.171980 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.172711 31571 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:32.173313 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:32.180491 31567 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:32.170982  1330 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.001s
I20260709 12:22:32.174831  1384 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.189033 31573 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:32.190933 31566 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:22:32.183084  1388 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.182430  1409 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.143824  1414 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.183732  1205 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:32.193929  1408 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:22:32.185057  1330 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.198239  1424 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5.
I20260709 12:22:32.201116  1417 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.201592  1417 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.201930  1417 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.195672  1238 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:32.193089  1385 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.186196  1403 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:32.193836  1410 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:22:32.217021 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59970.1us
I20260709 12:22:32.216886 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:32.218046 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1255) took 2097 ms. Trace:
I20260709 12:22:32.218495 31497 rpcz_store.cc:276] 0709 12:22:30.121169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.135808 (+ 14639us) service_pool.cc:224] Handling call
0709 12:22:32.216676 (+2080868us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:32.217969 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5726592}
I20260709 12:22:32.220498 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.221259 31573 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:32.222110 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.228597 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.229228 31497 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:32.230036 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.230552 31497 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:32.231149 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.231933 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:32.232494 31497 raft_consensus.cc:2410] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.236187 31567 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:32.199404  1384 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:22:32.233870 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:32.224113  1424 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:32.216370  1403 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:32.227396  1399 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.244506 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:32.246732 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.246843 31497 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:32.247303 31567 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.242846  1419 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:22:32.256879 31567 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:32.257900 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:32.258502 31571 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:32.262868 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:32.263132   773 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.033s	user 0.009s	sys 0.005s
I20260709 12:22:32.263447 31571 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:32.263556   773 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.265676   773 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.269968 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.246852  1403 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.280084 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:32.280917 31567 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 3: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:32.281029 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.281952 31571 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:32.266647  1398 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:32.284706 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:32.286298 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:32.286646 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:32.288440 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.289546 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:32.292337  1171 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:32.294516 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.297871 31573 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:32.245826  1424 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.300288  1330 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.301175  1068 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:32.301604  1068 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.288614  1385 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:32.295683  1283 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:32.288333  1238 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.291235  1410 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.291028  1428 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:32.302366  1424 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.295179  1205 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:32.311076  1205 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.312336  1205 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.313879 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 572) took 1392 ms. Trace:
I20260709 12:22:32.314323 32107 rpcz_store.cc:276] 0709 12:22:30.921910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.222670 (+300760us) service_pool.cc:224] Handling call
0709 12:22:31.226776 (+  4106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.606611 (+379835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.313603 (+706992us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540058eb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:32.313805 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610068352}
I20260709 12:22:32.309178  1428 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.315591  1428 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.302404  1068 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.309356  1385 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.326862  1068 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:32.329260 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 405) took 1272 ms. Trace:
I20260709 12:22:32.331262  1239 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:32.321878  1283 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:32.333158  1379 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.001s
I20260709 12:22:32.318243  1286 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:32.332670  1239 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:32.331509 31493 rpcz_store.cc:276] 0709 12:22:31.056552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.066424 (+  9872us) service_pool.cc:224] Handling call
0709 12:22:31.611444 (+545020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.722520 (+111076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.328976 (+606456us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400013e50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.329170 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091391872}
I20260709 12:22:32.334018  1385 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.336741  1291 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.347071  1239 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.348181  1239 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.348461 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:32.349661 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.350349 31493 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:32.359926 31569 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:32.360864  1286 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.338289  1417 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.344033  1379 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.364817 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:32.368469  1374 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.378933  1397 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:32.383332 31495 raft_consensus.cc:2368] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4.
I20260709 12:22:32.387712 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 671) took 2007 ms. Trace:
I20260709 12:22:32.388121 32114 rpcz_store.cc:276] 0709 12:22:30.380726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.380851 (+   125us) service_pool.cc:224] Handling call
0709 12:22:30.457236 (+ 76385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.423138 (+965902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.387447 (+964309us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b540049d9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:32.387645 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192402816}
I20260709 12:22:32.381664  1238 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:32.391346 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:32.400352 31422 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:32.380033  1397 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.397815 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:32.398417 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:32.397207 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:32.403754 31419 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:32.401253 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:32.407567 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:32.412143 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:32.412748 31418 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.415657 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.382277  1403 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.418111 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.418283  1417 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.418838 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.419319 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.404477  1238 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:32.411203   773 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.429500 31418 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:32.430177 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:32.430989 32114 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.383466  1283 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.438988 31493 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:32.439780 31418 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:32.441841 31423 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:32.418503  1252 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:32.445715 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.446962 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:32.454459 32114 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:32.435122  1240 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.459839  1244 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.467958 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:32.462836  1410 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.470273 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:32.470592 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:32.469097  1412 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.395s	user 0.003s	sys 0.001s
I20260709 12:22:32.456498  1400 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:22:32.471354 31567 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:32.474121 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.475307 31567 raft_consensus.cc:2376] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4. Re-sending same reply.
I20260709 12:22:32.476972  1403 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.479640 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 576) took 1498 ms. Trace:
I20260709 12:22:32.480060 32108 rpcz_store.cc:276] 0709 12:22:30.981132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.229742 (+248610us) service_pool.cc:224] Handling call
0709 12:22:31.230115 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.979027 (+748912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.479391 (+500364us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54005dc5d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:32.479563 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674978048}
I20260709 12:22:32.474635   773 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:32.471336  1240 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:32.483479  1126 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:32.467353  1238 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.484707  1428 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.463577   992 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:22:32.469846  1244 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.486836 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:32.465443  1229 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:22:32.486426  1254 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:22:32.471585  1379 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.463410  1252 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.486836 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:32.494262   773 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:32.495687  1089 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:32.502811  1365 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:32.503423 31574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2277) took 1640 ms (client timeout 1870 ms). Trace:
I20260709 12:22:32.503785 31566 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:32.503997 31574 rpcz_store.cc:269] 0709 12:22:30.862517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.014120 (+151603us) service_pool.cc:224] Handling call
0709 12:22:32.503180 (+1489060us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400250dd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.503340 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100010880}
W20260709 12:22:32.504776 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.505187 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.503630 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1267) took 2286 ms. Trace:
I20260709 12:22:32.506516 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.506903 31491 rpcz_store.cc:276] 0709 12:22:30.216928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.217273 (+   345us) service_pool.cc:224] Handling call
0709 12:22:30.646742 (+429469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.647337 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.503441 (+1856104us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400012a50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.503569 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986731776}
I20260709 12:22:32.508090 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.494357  1244 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.512001 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.512660 31567 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:32.496481  1068 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:32.510182 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.514572 31574 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:32.509217 31491 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:32.499203  1282 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:32.515573  1282 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:32.516714  1252 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.516503  1282 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.513242  1379 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:22:32.517550 31491 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:22:32.513667  1365 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:22:32.519762 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:32.520277 31491 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:32.520462 31566 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:32.499732   992 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:32.499459  1089 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.501760  1397 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:32.523525  1365 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:32.521471 31491 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:32.523881  1365 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:32.524863 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.524668  1365 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:32.525293 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.525630 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.525972 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 457) took 1640 ms. Trace:
I20260709 12:22:32.520632 31567 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
W20260709 12:22:32.526104 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.513613  1254 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:22:32.526410 31570 rpcz_store.cc:276] 0709 12:22:30.885166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.205031 (+319865us) service_pool.cc:224] Handling call
0709 12:22:32.525760 (+1320729us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400261bd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.525904 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538914560}
I20260709 12:22:32.527015 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:32.517534  1282 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.527891 31567 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:22:32.528265 31491 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:32.528240 31500 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:32.525580  1365 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.529511  1068 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.531569 31500 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:32.534967 31574 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:32.536602 31500 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.536684 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:32.537756 31567 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:32.532655  1379 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:32.539249  1379 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:32.539422  1428 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.540283  1379 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:32.541589  1437 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:22:32.542887  1379 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.550102 31499 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.551486 31566 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:32.531144   992 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:32.533449  1229 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:22:32.554738 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:32.561054 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2273) took 1699 ms (client timeout 1804 ms). Trace:
W20260709 12:22:32.561654 31572 rpcz_store.cc:269] 0709 12:22:30.861405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.999411 (+138006us) service_pool.cc:224] Handling call
0709 12:22:32.560793 (+1561382us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002a1cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.560963 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341949184}
I20260709 12:22:32.564158  1253 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:32.567680  1440 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:22:32.567199   992 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.567950  1253 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:32.568851  1253 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:32.571342 31416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2397) took 2625 ms (client timeout 1750 ms). Trace:
W20260709 12:22:32.571800 31416 rpcz_store.cc:269] 0709 12:22:29.946198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.973148 (+ 26950us) service_pool.cc:224] Handling call
0709 12:22:32.571109 (+2597961us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003534d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.571256 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3148969728}
I20260709 12:22:32.572899  1258 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:32.573477  1258 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.533031   773 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.575660  1258 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:32.564527  1441 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:22:32.587822 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 466) took 1756 ms. Trace:
W20260709 12:22:32.590968 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.591459  1376 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:32.591681 31420 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1337) took 1909 ms (client timeout 1942 ms). Trace:
I20260709 12:22:32.593992  1376 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:32.594064 31420 rpcz_store.cc:269] 0709 12:22:30.682719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.686757 (+  4038us) service_pool.cc:224] Handling call
0709 12:22:32.591458 (+1904701us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54004493d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.591614 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486736640}
I20260709 12:22:32.593609 32106 rpcz_store.cc:276] 0709 12:22:30.831288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.831802 (+   514us) service_pool.cc:224] Handling call
0709 12:22:30.832226 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.946174 (+113948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.587497 (+1641323us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540031ddd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:32.587735 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260750080}
I20260709 12:22:32.595170  1376 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.596225 31571 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:32.596365  1376 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.564271  1232 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:32.540568  1089 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:32.599318  1243 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:32.603960  1068 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.617483  1162 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:32.617978  1162 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:32.601233  1438 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:22:32.600831  1232 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:32.630075 31569 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:22:32.602828  1238 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:22:32.647372  1450 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:22:32.631106  1089 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.647795  1229 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.669302 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1348) took 1787 ms. Trace:
I20260709 12:22:32.655040  1250 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.672405 31424 rpcz_store.cc:276] 0709 12:22:30.881698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.884509 (+  2811us) service_pool.cc:224] Handling call
0709 12:22:32.668048 (+1783539us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b54003516d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.669232 (+  1184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177407872}
I20260709 12:22:32.673060  1250 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.674844  1250 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.669215  1277 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:32.648614  1162 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.700505  1162 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:32.700812  1244 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.690692  1277 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:32.711272  1277 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:32.680344  1229 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.683133  1232 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:32.698562  1448 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:22:32.769511 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.779979 32111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 577) took 1731 ms (client timeout 2228 ms). Trace:
W20260709 12:22:32.780578 32111 rpcz_store.cc:269] 0709 12:22:31.048198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.205511 (+157313us) service_pool.cc:224] Handling call
0709 12:22:32.779716 (+1574205us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54003f98d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:32.779892 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850760448}
I20260709 12:22:32.782882 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 470) took 1915 ms. Trace:
I20260709 12:22:32.783278 32113 rpcz_store.cc:276] 0709 12:22:30.867231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.900396 (+ 33165us) service_pool.cc:224] Handling call
0709 12:22:30.900627 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:30.952330 (+ 51703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.779252 (+1826922us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54002c8dd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:32.782818 (+  3566us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116864256}
W20260709 12:22:32.776202  1449 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.007s
I20260709 12:22:32.768702  1149 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.803915  1149 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:32.818481  1244 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:32.776705  1277 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.933476  1229 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.033869  1304 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.034562  1304 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:33.035688  1304 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.037138  1304 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.045401  1382 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:33.045994  1382 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:33.047091  1382 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.048642  1382 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.054216  1340 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:33.054829  1340 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:33.055845  1340 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.059499  1249 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.076942  1364 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:33.079864  1364 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:33.082091  1364 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:33.209884 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.211042 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.214118 31417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2416) took 2869 ms (client timeout 3237 ms). Trace:
W20260709 12:22:33.214789 31417 rpcz_store.cc:269] 0709 12:22:30.344129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.344256 (+   127us) service_pool.cc:224] Handling call
0709 12:22:33.213617 (+2869361us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54003e8854. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:33.213892 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637088128}
W20260709 12:22:33.215997 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.217026 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.209939 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2422) took 2731 ms. Trace:
I20260709 12:22:33.220006 31421 rpcz_store.cc:276] 0709 12:22:30.478741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.478911 (+   170us) service_pool.cc:224] Handling call
0709 12:22:30.993236 (+514325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.125034 (+131798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.209151 (+2084117us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400148a50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:33.209616 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182151040}
W20260709 12:22:33.217051 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.223661 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.229528 31570 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:33.232808 31496 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:33.233724 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 415) took 1354 ms. Trace:
W20260709 12:22:33.235893 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.237387 32108 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:33.238016 32111 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:33.235740 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1275) took 1069 ms. Trace:
I20260709 12:22:33.239342 31497 rpcz_store.cc:276] 0709 12:22:32.166532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.287029 (+120497us) service_pool.cc:224] Handling call
0709 12:22:33.235300 (+948271us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002e6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:33.235566 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377779584}
I20260709 12:22:33.240020 32106 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:22:33.229744 31492 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 412) took 1356 ms (client timeout 1788 ms). Trace:
W20260709 12:22:33.240971 31492 rpcz_store.cc:269] 0709 12:22:31.873246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.873374 (+   128us) service_pool.cc:224] Handling call
0709 12:22:33.229131 (+1355757us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540007f3d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:33.229411 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272798976}
I20260709 12:22:33.242233 32107 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:33.246657 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.234090 31496 rpcz_store.cc:276] 0709 12:22:31.878973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.879103 (+   130us) service_pool.cc:224] Handling call
0709 12:22:33.231459 (+1352356us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:33.231947 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:33.233346 (+  1399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.233601 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6193024}
I20260709 12:22:33.233734 32113 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:33.265390  1340 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.270434 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:33.270892  1291 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.275524 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:33.276674 31574 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:33.281065 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:33.282101 32114 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.284346  1364 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:33.292497 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.292651  1244 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.273110  1232 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.295379  1149 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.294529  1244 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:33.293325 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.317140  1281 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.335760 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:33.337015 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:33.337534 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:33.338021 31498 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:33.339128 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:33.339773 31495 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:33.340512 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:33.344897 31500 raft_consensus.cc:2368] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4.
I20260709 12:22:33.344931 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:33.248523 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:33.348830 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.354537 32114 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:33.362071 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.362993 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.364228  1164 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.365016  1164 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.368546 31494 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:22:33.370571 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.376281 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.378811 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:33.379199 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 131297us
I20260709 12:22:33.379736 32113 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:33.381296 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.382552  1089 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.003s
I20260709 12:22:33.382864 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:33.383652  1239 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.377616 31496 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:33.391903  1057 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.378506  1281 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.400162 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:33.400123  1404 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.414762 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:33.417392  1413 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:33.395726  1057 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.426703 31569 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:33.423305   625 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:33.431666 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.430918 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:33.433894 31569 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.439654 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:33.410008  1239 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.428696   625 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.448293 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:33.452934 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.454178 31571 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.453754 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:33.456508 31570 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:22:33.456885 31570 pending_rounds.cc:85] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:22:33.457183 31570 pending_rounds.cc:107] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:22:33.457446 31570 raft_consensus.cc:2889] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:33.447955  1164 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.442072  1404 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:33.514170 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 73127.4us
W20260709 12:22:33.551352 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.563205  1460 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
W20260709 12:22:33.638391 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.638458 32107 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:33.638492 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:33.641443 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.636482 31497 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:22:33.646946 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.651600 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.642184 31537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.228s (SENT) [suppressed 41 similar messages]
W20260709 12:22:33.656960 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.657099 31569 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:33.663715 31494 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:33.665277 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.671236  1159 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.672158  1159 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.668735  1244 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:33.671273  1162 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.970s	user 0.013s	sys 0.026s
W20260709 12:22:33.793442 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.668192  1232 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.824414 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:33.824837 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 430044us
I20260709 12:22:33.825474 31419 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 12:22:33.825587 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.826421  1457 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.494s	user 0.009s	sys 0.005s
I20260709 12:22:33.826668 31421 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:33.831928  1162 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.832517  1057 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.832645  1162 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.833319  1244 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.835660 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:33.837220 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:33.838654 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:33.839521 31572 raft_consensus.cc:2376] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4. Re-sending same reply.
I20260709 12:22:33.840057  1157 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.840575 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:33.840850  1157 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.841296 31572 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:33.837348  1162 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.834028  1244 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.856561 31571 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
W20260709 12:22:33.825568 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.857957 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.859076 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:33.871665 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.884341 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:33.883909 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:33.899827 31569 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:22:33.671618 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.910921 31419 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:33.867693  1162 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.913476 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:33.906563 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:33.908741  1281 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.926033 31567 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:33.926259  1281 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.927255 31495 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:33.925899 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:33.928309  1229 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.928731 31422 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:33.928701  1281 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.929028  1229 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:33.929453  1281 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:33.930192 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:33.931767 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:33.932760 31423 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:33.933744 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:33.933890 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:33.934379 31423 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:22:33.934778  1461 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.199s	user 0.009s	sys 0.000s
I20260709 12:22:33.935030 31421 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:33.935148 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:33.935992 31424 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:33.936275 31421 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:22:33.936622 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:33.937155 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 100071us
I20260709 12:22:33.937388 31418 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:33.937806  1239 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:33.930956 31422 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.938364  1239 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.938530  1159 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:33.938931  1239 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:33.941208  1239 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:33.941357  1249 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:33.942063   773 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.942732 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:33.942953 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:33.943532 31574 raft_consensus.cc:2376] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6. Re-sending same reply.
I20260709 12:22:33.944957   625 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:33.875844  1089 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:33.945871  1089 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.946728  1057 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.947539  1057 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:33.948457  1089 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:33.926086  1157 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:33.953477 31423 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:33.946375 31422 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:33.942662   773 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:33.955248 31500 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:33.937183 31424 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:34.009819 31496 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:34.005556 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:34.014868 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 86869.4us
I20260709 12:22:33.961241  1239 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.013741 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 371433us
I20260709 12:22:34.011606 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.021823 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.000156  1413 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.023579 31495 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:33.915755  1232 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:34.027776 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82626.1us
I20260709 12:22:34.031168 31497 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:34.022770  1340 consensus_meta.cc:287] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.757s	user 0.016s	sys 0.008s
W20260709 12:22:34.015131  1291 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.688s	user 0.001s	sys 0.016s
I20260709 12:22:34.029425 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.036936 31419 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:34.014410  1249 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:34.042286 31498 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:34.045233 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.046780 31573 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:34.048462 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.048882 31567 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:34.049258 31424 raft_consensus.cc:2368] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:34.051144 31416 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:22:34.051638 31416 pending_rounds.cc:85] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 6
I20260709 12:22:34.053128 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.053292 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.054809 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:34.055450 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:34.026796 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.059441 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1319) took 1196 ms. Trace:
I20260709 12:22:34.060571  1281 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:34.060747 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:34.024911  1239 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.062994 31493 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:34.062397 31567 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.061501 31574 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.028918  1413 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.056248 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.076200  1382 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:34.066967  1249 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.076895  1382 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.078387  1249 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.079118 31569 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:34.079504  1340 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.080796 31498 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:34.082947  1291 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.082782 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.118194  1340 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.118809  1291 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.083978 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1307) took 1605 ms. Trace:
I20260709 12:22:34.084216  1404 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.120824  1291 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.085835  1229 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.059912 31568 rpcz_store.cc:276] 0709 12:22:32.704410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.704576 (+   166us) service_pool.cc:224] Handling call
0709 12:22:32.705919 (+  1343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.720821 (+ 14902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.767625 (+ 46804us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:32.768126 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.262321 (+494195us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:33.262431 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.262542 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.900636 (+638094us) raft_consensus.cc:1685] finished
0709 12:22:33.900656 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.900794 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":5193,"thread_start_us":476775,"threads_started":1,"wal-append.queue_time_us":488806}
I20260709 12:22:34.056293 31416 pending_rounds.cc:107] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:22:34.088091 31537 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.089319 31419 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:22:34.064834  1364 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.774s	user 0.013s	sys 0.009s
I20260709 12:22:34.091349 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:34.092425  1382 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.092723  1239 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.061215  1281 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.093628  1171 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.095237 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:34.069446  1164 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.105866 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:34.107093 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 271634us
W20260709 12:22:34.103681 31322 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 273) took 11617 ms (client timeout 15000 ms). Trace:
I20260709 12:22:34.112953 31570 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:34.096715 31420 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:22:34.119207 31415 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:34.083442 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.147662 31499 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:34.120438  1340 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.085381   773 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.112699 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.121289 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.061299  1232 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.125490 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:34.154613 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.155045 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.129667 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.150231  1404 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.151398 31415 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:34.101483  1413 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.125756 31416 raft_consensus.cc:2889] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:34.099658  1244 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.158617 31498 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:34.162429 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.163256 31422 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:34.119688 31565 rpcz_store.cc:276] 0709 12:22:32.406039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.407958 (+  1919us) service_pool.cc:224] Handling call
0709 12:22:32.560939 (+152981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:32.561301 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:32.561344 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:33.242484 (+681140us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b2c0010e118. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:33.299486 (+ 57002us) log.cc:844] Serialized 26 byte log entry
0709 12:22:33.385291 (+ 85805us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:33.655840 (+270549us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.668588 (+ 12748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.816656 (+148068us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:33.935874 (+119218us) raft_consensus.cc:1685] finished
0709 12:22:33.935990 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:33.980536 (+ 44546us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002a1cd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:34.011783 (+ 31247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":552670,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":12322,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":6476,"spinlock_wait_cycles":342432512,"thread_start_us":314599,"threads_started":2,"wal-append.queue_time_us":143234}
I20260709 12:22:34.165019 31418 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:34.166649 31420 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 12:22:34.166996 31420 pending_rounds.cc:85] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 8
I20260709 12:22:34.167201 31420 pending_rounds.cc:107] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:22:34.167413 31420 raft_consensus.cc:2889] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:34.168397 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.169436 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.170899 31421 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:34.171593 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.173074 32113 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:22:34.173475 32113 pending_rounds.cc:85] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 5
I20260709 12:22:34.173686 32113 pending_rounds.cc:107] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:22:34.173911 32113 raft_consensus.cc:2889] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:34.152068  1281 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.171896 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:34.181200 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.175732 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119847us
I20260709 12:22:34.170382 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.111856  1472 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:22:34.189868 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.191709 31497 raft_consensus.cc:2410] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:22:34.190814 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 129251us
I20260709 12:22:34.156629  1171 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.194398 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.195250 31417 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:34.197897 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.198105 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.156592  1164 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.201916 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.200978  1475 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.189847  1340 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.203482 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.207532 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.212317 31420 raft_consensus.cc:2410] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:34.206640 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:34.218663  1475 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:34.221505 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 130237us
I20260709 12:22:34.221776  1476 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.222851 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:34.222426  1475 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.224412 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:34.227855 31422 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:34.229481 31419 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:34.184171  1404 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.232313 31421 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:34.234189 31415 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:34.234709 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 206061us
I20260709 12:22:34.235412 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:34.170946  1467 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:22:34.240144 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.245605 31422 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:34.246891  1413 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.247092 31418 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 12:22:34.248139 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.252810  1281 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:34.256526  1471 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:34.257498  1471 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.241592  1089 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.260295  1089 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.260691  1089 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.256589 31415 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:34.254501 31420 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:34.264966 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.222443  1476 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:34.268944 31419 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:34.258060  1164 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.233867  1239 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.234030  1364 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.254891 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.277159 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.267483 31421 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:34.273219 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:34.280164  1057 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:34.280735 31493 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:34.280855  1057 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:34.282142 31418 raft_consensus.cc:2368] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4.
I20260709 12:22:34.282212 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.268550  1413 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.287899 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:34.289086 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.289683 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.291533 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.283110  1164 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.293241  1164 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.293475  1229 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:34.295475  1466 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.295971  1164 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.296229  1466 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.297155 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.297883 31418 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:34.298527 31420 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:34.298749 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.298875  1157 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.299639  1171 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.300540 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.300870  1476 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.301494 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.303056 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.250128  1291 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:22:34.146451 31322 rpcz_store.cc:269] 0709 12:22:22.486506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.487482 (+   976us) service_pool.cc:224] Handling call
0709 12:22:34.103403 (+11615921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:31.963223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:31.990488 (+ 27265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:31.990530 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:22:31.990547 (+    17us) tablet.cc:662] Decoding operations
0709 12:22:32.097038 (+106491us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:32.097094 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:32.097119 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:22:32.174466 (+ 77347us) tablet.cc:701] Row locks acquired
0709 12:22:32.174486 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:22:32.179022 (+  4536us) write_op.cc:270] Start()
0709 12:22:32.184002 (+  4980us) write_op.cc:276] Timestamp: P: 1783599752178947 usec, L: 0
0709 12:22:32.185373 (+  1371us) op_driver.cc:348] REPLICATION: starting
0709 12:22:32.201447 (+ 16074us) log.cc:844] Serialized 4039 byte log entry
0709 12:22:32.294965 (+ 93518us) op_driver.cc:464] REPLICATION: finished
0709 12:22:32.409492 (+114527us) write_op.cc:301] APPLY: starting
0709 12:22:32.411233 (+  1741us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:32.441342 (+ 30109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:32.466413 (+ 25071us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:32.479126 (+ 12713us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:32.479410 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:22:32.479449 (+    39us) write_op.cc:312] APPLY: finished
0709 12:22:32.479730 (+   281us) log.cc:844] Serialized 77 byte log entry
0709 12:22:32.479891 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.480015 (+   124us) write_op.cc:454] Released schema lock
0709 12:22:32.480062 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:32.480511 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.480550 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37259,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":84770,"apply.run_cpu_time_us":3980,"apply.run_wall_time_us":79114,"num_ops":10,"prepare.queue_time_us":411695,"prepare.run_cpu_time_us":13914,"prepare.run_wall_time_us":259882,"raft.queue_time_us":64210,"raft.run_cpu_time_us":25102,"raft.run_wall_time_us":54129,"replication_time_us":99048,"thread_start_us":346832,"threads_started":4,"wal-append.queue_time_us":9825,"wal-append.run_cpu_time_us":32022,"wal-append.run_wall_time_us":1439462}]]}
W20260709 12:22:34.309731 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.312530 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:34.299088  1239 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.302765  1364 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.314394  1468 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:34.327311  1057 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.443307 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:34.446235 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.453284 31574 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:34.453773 31493 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:34.342751 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48568us
I20260709 12:22:34.267014  1281 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:34.315052  1478 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:34.298787  1472 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:34.300568 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 139488us
I20260709 12:22:34.447801 31498 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:34.244099  1244 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:22:34.295073  1473 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:22:34.320932  1340 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.322057  1474 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:34.441963 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:34.448998  1477 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.479110  1477 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.449148 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.480496 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:34.481926  1477 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.452167 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.486994 31570 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:34.456357  1413 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.488283  1162 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:34.488848  1162 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:34.491735  1404 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.441908  1466 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.454895 31497 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.441082  1171 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.490322  1413 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:34.449813  1469 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.163s	user 0.005s	sys 0.000s
I20260709 12:22:34.461261  1164 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.508698  1164 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.466470  1382 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.461273  1239 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.511873 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.468011  1481 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.468668 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:34.471293 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.471186 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.517313 31419 raft_consensus.cc:2410] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:34.460322  1472 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.473472 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.460425 31492 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:34.464242  1467 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.463274 31499 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:34.503656  1477 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.504262  1232 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.512135  1404 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.504771  1364 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:34.467684 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.472471 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.472817  1340 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.478370 31574 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:34.524178 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.504348 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.522065  1472 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.548286 31569 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:34.489964  1162 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.520506  1157 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.552862 31565 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:34.547318  1340 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.547508   773 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.514710  1171 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:34.573427 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61613.2us
I20260709 12:22:34.554410  1364 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.578509 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:34.580379 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50087.8us
I20260709 12:22:34.569130  1164 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.587095 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:34.585577 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72334.5us
I20260709 12:22:34.544135  1232 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.586267  1281 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.592978  1232 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.587291 31572 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:34.535185  1467 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.597458 32079 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.548741  1382 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.574631   773 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.549723  1404 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.600133 31495 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:34.553377  1477 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:34.606055 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 137517us
I20260709 12:22:34.526547  1481 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:34.606932 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87683.9us
I20260709 12:22:34.583498  1244 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.570034  1157 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.580675  1471 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.617439 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:34.619808 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.619771 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:34.606066  1164 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:34.621748  1492 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:22:34.626191 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.613049   773 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:34.633903 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.620693  1162 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:34.638729 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 356012us
I20260709 12:22:34.651117 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.626994  1089 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.655879 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.656661 31498 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:34.657464  1089 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.654132  1164 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:34.659538  1164 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.660954  1488 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:34.661577  1488 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.663849  1488 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.664642 31499 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:34.646715  1479 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:22:34.656198  1483 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:22:34.663913  1157 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.666441  1157 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.653283 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.667572 31492 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:34.653679  1489 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:34.668777  1489 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.669292  1489 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.670949  1492 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.671279  1486 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.671998  1486 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:34.671360  1492 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:34.681289 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49161.5us
I20260709 12:22:34.674960 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.677217 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:34.679798  1229 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.682734 31497 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:34.631415  1244 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.625707  1364 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:34.706251 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:34.649792  1467 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:34.711329 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 104716us
W20260709 12:22:34.707006 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.713748 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:34.711876 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 85768.9us
I20260709 12:22:34.685575  1229 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:34.718915 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:34.699383  1281 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:34.723523 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 132995us
W20260709 12:22:34.727447 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.728184  1476 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.728606  1488 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.728755  1476 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.729295  1488 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.732175  1488 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.652374  1493 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:22:34.714315  1486 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.733705  1478 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.747299 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 121311us
I20260709 12:22:34.724005  1281 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.748294 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:34.750790  1495 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:34.750604  1229 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.751322  1495 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.751797  1495 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:34.752179  1229 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:34.755270  1485 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:22:34.756467  1487 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:34.725649  1239 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.757575 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:34.759919  1413 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.760425  1413 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.760778  1244 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.750350 31319 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:34.763429 31319 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.765542  1492 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.732738  1476 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.765795 31319 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:34.738812 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.749933  1281 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:34.788532 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 139051us
I20260709 12:22:34.789960  1490 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:34.790313  1467 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:34.791009  1476 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.792200 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.792968  1500 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.793457  1500 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.793828  1500 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.794873 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.796721 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.797492 31568 raft_consensus.cc:2410] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:34.797659  1476 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:34.799430 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80991.2us
I20260709 12:22:34.800140  1476 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.800647 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:34.775781  1171 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.790585  1490 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:34.801633 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.802943 31568 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:34.802580 31390 leader_election.cc:400] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4.
I20260709 12:22:34.815115 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.815361 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.815860 31565 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:34.810659  1171 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.816938  1472 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.817236  1171 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.818288  1491 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.819109  1382 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:34.819941 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99250.8us
I20260709 12:22:34.821372 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:34.822223  1232 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:34.822772 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.785549  1477 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.823061  1501 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:34.775231  1478 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:34.826768  1478 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.827662  1506 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:34.828410  1506 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.832978  1171 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.833243  1382 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.834069  1481 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.834898 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.843456 31568 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:34.803076  1239 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:34.844413  1239 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:34.847052 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44656us
I20260709 12:22:34.842168  1382 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.835567  1492 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.833012 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.837950 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:34.853307 31570 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:34.841459  1404 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.853569 31572 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:22:34.848168 31390 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:34.786089  1413 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:34.849432 31319 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 3 to 4, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:22:34.857105 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.857782 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.859092 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.859702 31497 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:34.846666  1239 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:34.823521  1489 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.802335  1490 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:34.963491 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.872226 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:34.931574 31540 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.942s (SENT)
W20260709 12:22:34.877759 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45619.2us
W20260709 12:22:35.000056 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:34.928611 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80483.5us
I20260709 12:22:34.853173  1478 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:34.919587 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.870067 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:34.890188 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.005892 31498 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:35.006213 31493 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:34.929234 31319 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 3, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 3 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.854872  1472 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.856465  1471 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.856616  1481 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.921160  1474 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:34.959419  1503 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.931655  1506 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.957913  1157 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:35.020382 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 293748us
I20260709 12:22:35.021663 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.023422  1364 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:35.020872  1503 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:35.028148  1516 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:35.028322  1503 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.029603  1503 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:35.029693 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 109369us
W20260709 12:22:35.030447 31540 leader_election.cc:336] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.950s (SENT)
I20260709 12:22:35.034220 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:34.965222  1171 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:35.012784  1404 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.038241  1506 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:34.920022  1500 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.955044   773 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:34.931293  1493 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:22:35.021024  1157 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:35.060467 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:35.064131  1382 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:35.033576  1471 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.068157   773 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:34.890491  1510 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
I20260709 12:22:35.013324  1478 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.020001  1474 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.077019 31319 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 4, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:35.100546 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 245143us
I20260709 12:22:35.062342 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.119995 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:35.120530 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58280.3us
I20260709 12:22:35.120618 31565 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:35.122051 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60977.9us
I20260709 12:22:35.121568 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.060305  1239 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.062465  1472 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:35.126087 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.119460  1467 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.130481 31570 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.074208  1404 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:35.039762  1481 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:35.121256  1495 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.129522  1157 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.099010  1340 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.061133  1508 raft_consensus.cc:2764] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:35.119722  1474 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:35.138912 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58016.5us
W20260709 12:22:35.139983 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119684us
I20260709 12:22:35.077776  1171 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.131747  1413 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:35.125490  1516 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.137336  1514 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:35.148650 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.153023  1526 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:35.130136  1472 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:35.158088 31319 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 3 to 4, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.157373 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:35.155576  1477 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:22:35.160377 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:35.162580  1524 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:22:35.178946  1526 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:35.167423  1364 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:22:35.137900  1239 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.185858  1495 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.160825   773 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:35.186786  1516 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.187043  1404 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:35.187862  1509 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:22:35.191847  1478 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:35.180998  1281 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.193097  1474 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.193976  1382 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:35.230513  1493 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.074241  1513 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:22:35.141467  1500 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:35.198930 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 53115.2us
W20260709 12:22:35.199435 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.201509  1162 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.008s
I20260709 12:22:35.132215  1492 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:22:35.185216  1171 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.201538 31570 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:35.205427 31565 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:35.201611  1501 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.200209 31319 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:35.155824  1413 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.182317  1472 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.214567 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.267148 31566 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.212188  1526 consensus_queue.cc:1243] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:35.215746  1340 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.090113  1506 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.216315 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:35.229862 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73768.8us
W20260709 12:22:35.238621 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.240139 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87236.8us
W20260709 12:22:35.277631 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.242249 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.243386  1523 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:35.194376 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45879us
I20260709 12:22:35.247181 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.278964 31568 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.235507  1489 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.257413 31415 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:35.247139  1382 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.264420 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:35.267683 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:35.252604  1471 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.287964  1511 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.288502  1511 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:35.289371  1511 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.255201  1493 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:35.291393  1493 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.286496  1382 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.297006  1476 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:35.287257 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:35.300007  1481 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.301394  1239 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.303077  1281 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.301345 31566 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:35.305759 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.268693  1413 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:35.313194 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 191735us
I20260709 12:22:35.314194 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.301121  1157 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.262828  1478 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:35.320408 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 259396us
I20260709 12:22:35.320606  1524 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:35.320925  1474 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.320771 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:35.321316 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 62972.8us
I20260709 12:22:35.321375 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.322670 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.355943 31570 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.322698  1513 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.321520  1232 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.324858  1382 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:35.325534 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.326488  1471 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:35.327172 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.373947  1471 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.333846 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.385010 31496 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:35.336009 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.327261  1340 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:35.352336 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.355942 31498 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:35.359269 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.360345 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:35.363862  1511 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.408740 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.281204  1523 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.409735  1523 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.409883 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.305819  1171 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:35.410976  1171 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.373396  1244 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:35.386585 31500 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:35.394817  1471 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.406385  1340 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.407078 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.396518 31497 raft_consensus.cc:2376] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4. Re-sending same reply.
I20260709 12:22:35.408002 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:35.408106  1382 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.414914 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.429999 31498 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:35.354619  1524 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.417483 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.418958 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:35.410899  1232 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:35.423254 31570 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:35.432687 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74325.3us
I20260709 12:22:35.436213 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.436362 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.417405  1481 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.355387  1478 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.478340 31495 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:35.478899 31500 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
W20260709 12:22:35.485463 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158371us
I20260709 12:22:35.480345  1528 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:35.486366  1528 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:35.486881  1528 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.417210  1244 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:35.427465  1511 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:35.486274 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.440623  1171 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.503785  1516 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:35.503306  1511 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.512699 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:35.479682 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60798.6us
I20260709 12:22:35.471662  1510 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:35.525478  1517 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:22:35.471984 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
W20260709 12:22:35.540055 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.583657 32079 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:35.586118 31497 raft_consensus.cc:606] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:35.445673  1524 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.441329  1340 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:35.561813 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82279.6us
I20260709 12:22:35.564838  1513 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.565546  1493 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.566442 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:35.611006 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81762.2us
I20260709 12:22:35.567724 31568 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:35.530911  1510 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:35.597290 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.581248  1171 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:35.555536 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.640169 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.614531 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.641453 31572 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:35.605906 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.489857  1481 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.635202  1510 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:35.644496  1481 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:35.647755 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.648835 31565 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:35.603628  1501 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:35.654525 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.655157 31573 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
W20260709 12:22:35.639057  1535 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:22:35.659291 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.666015 31573 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:35.659654 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.647879 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:35.662285 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.667832 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.662971 31466 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.791s (SENT)
I20260709 12:22:35.611871  1500 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.664260 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.646405  1171 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.638888  1239 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:35.672592 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.693672 31566 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:22:35.694624 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.671284 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:35.711084 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.711476 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.727445 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.670830  1541 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.728260 31415 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:35.732751 32113 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.732915 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:35.733487 31419 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.730607 31422 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:35.617044  1493 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.738763 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:35.738763 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.692830  1171 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.740183 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.696738  1239 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.645303  1506 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:22:35.744807 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:35.746418 31420 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.738245 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:35.748073 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:35.743273 31417 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:35.727602  1516 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.754933 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:35.755882 32113 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:22:35.749857 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 136235us
I20260709 12:22:35.751147 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.739050 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:35.757036 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:35.757145 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:35.671411  1481 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:22:35.761266 32114 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:35.761338 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:35.765393 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102459us
I20260709 12:22:35.758061  1491 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:35.747781  1382 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.749168  1239 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.761905 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:35.790251 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.792061 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:35.910058 32113 raft_consensus.cc:2410] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:22:35.728730  1523 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.728116  1500 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:35.766825  1503 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.737s	user 0.005s	sys 0.006s
I20260709 12:22:35.804033  1525 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:35.804490 32114 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:22:35.807581  1544 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:35.808147 32109 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.812983 31420 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:35.819955  1542 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:22:35.822708 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.830729  1467 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:35.843339  1478 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:35.846765 31494 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:35.850229 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.857067  1340 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:35.862637 31492 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:35.874392 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.736353  1232 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:35.873729  1517 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:22:35.758802  1541 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.878811  1471 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:35.883234  1472 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.002s
I20260709 12:22:35.990942 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:35.995167 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:35.889076 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.889820 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.890585 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.891076 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.892460 31572 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:35.997020 31565 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:35.997455  1340 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:35.997857 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.892053  1244 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.894600  1476 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.999536  1540 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:35.999852  1476 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:36.000238  1540 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:36.001057  1476 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.999547  1244 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.005098  1540 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:36.006081  1540 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:35.899492 31419 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:35.872807  1413 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 12:22:35.762750  1516 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.936048 31567 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:35.940145 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:35.912333  1491 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:35.943572 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:35.944923 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:35.937287  1467 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:36.033996 31569 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:35.883832  1171 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:35.998003  1340 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:35.940143  1506 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:36.048629 31574 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:36.054425 31570 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:36.055249 31499 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:22:36.056602 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.018180  1492 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:36.067324 31573 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:36.071031 31570 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:36.062084  1528 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:22:36.011340  1382 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:22:36.011512  1481 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:22:36.011126  1413 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:35.930090  1525 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.018229  1472 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.088342 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:36.089258 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:36.090461 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95373.1us
I20260709 12:22:36.070905  1492 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.102362 31493 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:36.077215  1501 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:36.104648 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 106019us
I20260709 12:22:36.061355  1506 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:36.112098 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:36.112777 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 381055us
I20260709 12:22:36.116305 31566 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:36.089532  1530 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.089361  1503 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:36.104115  1492 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:36.126333 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 148437us
W20260709 12:22:36.133049 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 140350us
I20260709 12:22:36.084908  1528 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:36.138209 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67179.9us
I20260709 12:22:36.181533 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.182262 31493 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:36.181859 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:36.194434 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.195919 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.197082 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.197690 31500 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:36.198586 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.199671 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:36.200788 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:36.246544 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.255807 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.258246 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:36.260584 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 176633us
I20260709 12:22:36.263433 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.263922 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.264094 31419 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:36.264477 31420 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:36.265690 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.266250 31420 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:36.266974 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.266196 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.271154 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.271938 31420 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:36.273936 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:36.274395 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 92722.8us
I20260709 12:22:36.274753 31493 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:36.276162 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.276295 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.281188 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:36.292318 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.293412 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.297669 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.297603 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.297748 31421 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:36.302980 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.303977 31424 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:36.109783  1491 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.273687  1523 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:36.137864  1503 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.335646 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:36.277640  1500 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:36.127096  1510 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:36.140381  1530 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.280879  1552 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:36.416730 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102200us
W20260709 12:22:36.519761 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 340544us
W20260709 12:22:36.502790 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 329618us
W20260709 12:22:36.586727 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 311494us
W20260709 12:22:36.340972  1553 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 12:22:36.502790 31537 leader_election.cc:336] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.228s (SENT)
I20260709 12:22:36.616421 31419 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 2.
I20260709 12:22:36.617524 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:36.315443  1567 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.653831 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:36.335561  1477 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:36.577387  1171 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:36.659277  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.002s	sys 0.014s
W20260709 12:22:36.659525 31491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.002s	sys 0.018s
W20260709 12:22:36.589305  1157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.020s
I20260709 12:22:36.658742 31418 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
W20260709 12:22:36.658378 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 70427.2us
W20260709 12:22:36.708211  1560 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
I20260709 12:22:36.660784  1523 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:36.389534  1572 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:36.567651  1490 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:22:36.568140  1516 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:36.711748 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.430275  1471 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:36.713475 31491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.002s	sys 0.018s
I20260709 12:22:36.733726  1471 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:36.340206  1382 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.321s
I20260709 12:22:36.721951 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:36.723809 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 248711us
I20260709 12:22:36.624557  1340 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:36.709632 31568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.015s	sys 0.052s
W20260709 12:22:36.717427  1157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.020s
W20260709 12:22:36.713325  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.003s	sys 0.014s
W20260709 12:22:36.737180 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:36.739769 31568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.015s	sys 0.053s
I20260709 12:22:36.727464  1572 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:36.743178  1569 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:22:36.743983  1528 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:36.745836  1510 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:36.747334  1561 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 12:22:36.748041  1574 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:36.743978 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1276) took 1449 ms. Trace:
W20260709 12:22:36.749251  1524 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.130s	user 0.013s	sys 0.000s
W20260709 12:22:36.778119 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 56221us
I20260709 12:22:36.786535 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:36.734808  1472 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:36.789779 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1285) took 1492 ms. Trace:
I20260709 12:22:36.727645  1500 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:22:36.654296  1571 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:22:36.779865 31496 rpcz_store.cc:276] 0709 12:22:35.295053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.443648 (+148595us) service_pool.cc:224] Handling call
0709 12:22:35.443966 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.496660 (+ 52694us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:36.068928 (+572268us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.558269 (+489341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.591817 (+ 33548us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.627394 (+ 35577us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:36.627449 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.627545 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.743760 (+116215us) raft_consensus.cc:1685] finished
0709 12:22:36.743779 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.743916 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95901,"prepare.queue_time_us":271469,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":21763,"raft.queue_time_us":260584,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":82817,"thread_start_us":866416,"threads_started":3,"wal-append.queue_time_us":651692}
I20260709 12:22:36.763636  1525 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:36.769650  1281 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:36.728058  1552 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:22:36.425635  1501 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:36.817636  1244 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.005s
I20260709 12:22:36.817956 31496 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:36.818320 31496 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:36.763267  1572 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.819114 31496 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.820243 31496 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.803856  1477 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:36.815740  1552 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:36.827008 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2312) took 1213 ms. Trace:
I20260709 12:22:36.793439 31495 rpcz_store.cc:276] 0709 12:22:35.297254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.493696 (+196442us) service_pool.cc:224] Handling call
0709 12:22:35.530033 (+ 36337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.603369 (+ 73336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.603408 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.646237 (+ 42829us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.790422 (+144185us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:35.790479 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.790570 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.789571 (+999001us) raft_consensus.cc:1685] finished
0709 12:22:36.789591 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.789723 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7043,"thread_start_us":60991,"threads_started":1,"wal-append.queue_time_us":351983}
I20260709 12:22:36.826283 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1286) took 1451 ms. Trace:
I20260709 12:22:36.827521 31568 rpcz_store.cc:276] 0709 12:22:35.613125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.613347 (+   222us) service_pool.cc:224] Handling call
0709 12:22:35.652142 (+ 38795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.964861 (+312719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.964907 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.011620 (+ 46713us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.751417 (+739797us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:36.751468 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.751553 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.826758 (+ 75205us) raft_consensus.cc:1685] finished
0709 12:22:36.826784 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.826936 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1631,"raft.queue_time_us":20596,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":36076,"thread_start_us":957024,"threads_started":2,"wal-append.queue_time_us":763611}
W20260709 12:22:36.834862 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 223293us
I20260709 12:22:36.829324 31497 rpcz_store.cc:276] 0709 12:22:35.374713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.742139 (+367426us) service_pool.cc:224] Handling call
0709 12:22:35.758661 (+ 16522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.761620 (+  2959us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:35.761876 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.270052 (+508176us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.315605 (+ 45553us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.315804 (+   199us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:36.315854 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.315945 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.826055 (+510110us) raft_consensus.cc:1685] finished
0709 12:22:36.826090 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.826220 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116214,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":280580,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":19487,"thread_start_us":507697,"threads_started":2,"wal-append.queue_time_us":358658}
I20260709 12:22:36.838660 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:36.812016  1510 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.793895  1524 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:36.827593  1528 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:36.838979  1244 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.835204  1472 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:36.841032  1500 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:22:36.904943 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.012s	sys 0.008s
W20260709 12:22:36.907485 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.008s
W20260709 12:22:36.841461 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 130346us
I20260709 12:22:36.908341 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:36.923113 31463 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.727s (SENT)
I20260709 12:22:36.850814  1510 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:36.888377  1530 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:36.907832  1552 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:36.907166  1503 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:36.856338  1528 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.940797 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:36.960480 31570 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:36.976176 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:36.959743 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:36.957302  1239 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.002s
I20260709 12:22:36.858920  1244 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:36.989498 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2324) took 1104 ms. Trace:
I20260709 12:22:36.989866 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 437) took 1569 ms. Trace:
I20260709 12:22:36.990989  1524 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:36.991173  1581 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
W20260709 12:22:36.991408  1556 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:36.995167 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:36.986024 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:36.985922 31572 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:36.940171  1552 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.998756 31573 rpcz_store.cc:276] 0709 12:22:35.885631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.890783 (+  5152us) service_pool.cc:224] Handling call
0709 12:22:36.989273 (+1098490us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b54001964d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:36.989415 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161629440}
I20260709 12:22:36.957669  1530 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.886849  1584 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.985694  1503 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:37.022789  1552 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.026336 31492 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:37.050757 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.026898  1530 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:37.028338 31573 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:37.029096  1510 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.030846  1588 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:37.033787  1492 consensus_meta.cc:287] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.772s	user 0.006s	sys 0.003s
I20260709 12:22:37.033890 31568 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:37.039230  1589 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.041307  1567 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.043870  1493 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:36.975979  1587 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:22:37.045660  1540 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.038513  1541 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:36.975571  1171 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:22:37.048995 31496 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:22:37.001461  1239 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.066617 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1291) took 1140 ms. Trace:
I20260709 12:22:37.067291 31496 rpcz_store.cc:276] 0709 12:22:35.926416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.817525 (+891109us) service_pool.cc:224] Handling call
0709 12:22:36.817844 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.066371 (+248527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.066564 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:36.976298  1157 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.999377 31491 rpcz_store.cc:276] 0709 12:22:35.420044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.833114 (+413070us) service_pool.cc:224] Handling call
0709 12:22:35.833644 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.834097 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:35.834138 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:35.851184 (+ 17046us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.733705 (+882521us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:36.734071 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.839189 (+105118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.839262 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:36.989679 (+150417us) raft_consensus.cc:1685] finished
0709 12:22:36.989699 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.989813 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6531,"prepare.queue_time_us":4972,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7996,"raft.queue_time_us":103477,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":18932,"thread_start_us":936150,"threads_started":2,"wal-append.queue_time_us":1005233}
I20260709 12:22:36.974000  1586 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.115s
W20260709 12:22:37.061692 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 129820us
I20260709 12:22:37.075896 31568 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:37.076201 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:37.050447  1477 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.044708  1572 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:37.053577 31573 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:37.057521  1510 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.083104 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:37.093184 31571 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:37.054773  1492 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.102540 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1284) took 1805 ms. Trace:
W20260709 12:22:37.098651 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 190427us
I20260709 12:22:37.098884 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:37.100982 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:37.078729  1586 consensus_queue.cc:1243] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:37.105446 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.051697  1584 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.081947  1404 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.081110  1490 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.081846  1493 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.129148 31500 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:37.103952 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:37.116581 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.054203  1588 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:37.133152 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 294556us
I20260709 12:22:37.072930  1540 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.138827 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.139940 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.081612  1481 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:37.077848  1157 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.089943  1382 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:37.109943  1503 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.143473 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.120637  1527 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:37.134100 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0098634899995886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 12:22:37.082140  1589 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:22:37.103070 31498 rpcz_store.cc:276] 0709 12:22:35.296993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.490094 (+193101us) service_pool.cc:224] Handling call
0709 12:22:35.526478 (+ 36384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.567241 (+ 40763us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:36.073610 (+506369us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.589140 (+515530us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.612635 (+ 23495us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.612845 (+   210us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:36.613313 (+   468us) log.cc:844] Serialized 14 byte log entry
0709 12:22:37.101987 (+488674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.102239 (+   252us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.102299 (+    60us) raft_consensus.cc:1685] finished
0709 12:22:37.102319 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.102471 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144782,"prepare.queue_time_us":310448,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":13415,"raft.queue_time_us":398143,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":43983,"thread_start_us":1290899,"threads_started":3,"wal-append.queue_time_us":643698}
I20260709 12:22:37.157393 32114 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:37.158130 32113 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.130987  1340 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:37.094900  1510 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:37.165410 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61543.7us
I20260709 12:22:37.166497 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:37.145648  1590 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:37.167630 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.168169  1590 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.168562 32108 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.168588  1590 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.170796 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.170902 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.171604 32110 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:37.180291 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74202.5us
I20260709 12:22:37.182842 31573 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:37.184274 31463 leader_election.cc:336] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.882s (SENT)
I20260709 12:22:37.177835  1530 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.194067 32106 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:37.157666  1404 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.135370  1493 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.157617  1527 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.202632  1530 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:37.192973 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.130756  1490 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.199740  1585 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:37.200392 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.208488 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 68618.6us
I20260709 12:22:37.200982  1590 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.201481 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:37.201918  1510 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.201256  1596 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.178907  1413 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:37.209687 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.214037 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.203955  1578 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:37.158447  1503 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.202899  1527 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.220538 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.198302  1528 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.229382 32110 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.214651  1587 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.239041  1587 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.239760  1157 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.240509 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.240947 32107 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:37.241412  1587 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:37.242026 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.184310  1340 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.243589 32108 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:37.244204   773 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:37.244415  1340 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.244599   773 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:37.244818 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.241420 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.245848 32114 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:37.245471   773 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.246152 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.241919 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.196103  1591 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:22:37.247417 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.249624  1492 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.211210  1244 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.255430 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.255600  1596 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:37.256412  1591 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:37.263569 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.190651  1232 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:22:37.269896 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.217620  1578 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:37.271099 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.275805 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.272210 32110 raft_consensus.cc:2376] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5. Re-sending same reply.
I20260709 12:22:37.275724 31573 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:37.280115 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.254010  1589 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:37.266573  1596 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.291648 32112 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:37.292905 32106 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:37.295321  1476 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.295908  1572 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.268945  1157 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:22:37.275030  1244 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:22:37.296663  1594 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:37.269227  1585 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.297255 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:37.303846 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102429us
W20260709 12:22:37.316674  1592 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:22:37.318485  1602 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:22:37.297365   773 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.331110 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.319031 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.338165 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:37.338438 32112 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.302369  1596 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:37.340847 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82112.6us
I20260709 12:22:37.346771  1572 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.351126 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.351871 32112 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.298403  1589 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.359819 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:37.360247 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47788.6us
I20260709 12:22:37.338061  1503 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.359756  1239 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:37.363106  1607 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:22:37.363605 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:37.364244  1530 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:37.364805  1530 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:37.366669  1530 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.369113  1530 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.371874  1493 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.344848  1591 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:37.372745  1591 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:37.373605  1591 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.374884  1591 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.361887 31573 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:37.340389  1528 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:37.384933  1528 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.387171  1528 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.389228  1589 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:37.392303  1606 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 12:22:37.394001  1573 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:37.394428  1573 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:37.395342  1573 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.396659  1573 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.398981 31572 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:37.401489 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.402097 31572 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:37.403815  1579 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.486s	user 0.000s	sys 0.002s
I20260709 12:22:37.378759 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.404906 32112 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.406023 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1377) took 1141 ms. Trace:
I20260709 12:22:37.406406 31419 rpcz_store.cc:276] 0709 12:22:36.264921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.265060 (+   139us) service_pool.cc:224] Handling call
0709 12:22:37.405840 (+1140780us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540022ef54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.405939 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707130624}
W20260709 12:22:37.364662  1604 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:22:37.411324 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1307) took 1332 ms. Trace:
I20260709 12:22:37.411692 31493 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:37.383030  1590 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:37.412976 31571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2315) took 1758 ms (client timeout 2163 ms). Trace:
I20260709 12:22:37.411737 31500 rpcz_store.cc:276] 0709 12:22:36.079287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.200539 (+121252us) service_pool.cc:224] Handling call
0709 12:22:37.411119 (+1210580us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54002e5254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.411266 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133106560}
W20260709 12:22:37.383457 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2334) took 1494 ms (client timeout 1966 ms). Trace:
I20260709 12:22:37.383839  1490 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:37.414623 31566 rpcz_store.cc:269] 0709 12:22:35.888875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.943269 (+ 54394us) service_pool.cc:224] Handling call
0709 12:22:37.383260 (+1439991us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b5400319054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.383397 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165436288}
I20260709 12:22:37.415988 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:37.416139 31567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2314) took 1802 ms (client timeout 1965 ms). Trace:
W20260709 12:22:37.416491 31567 rpcz_store.cc:269] 0709 12:22:35.613703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.613808 (+   105us) service_pool.cc:224] Handling call
0709 12:22:37.415953 (+1802145us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400317254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.416088 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604745984}
I20260709 12:22:37.417045 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:37.417454 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.418100 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.421617 31565 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:37.423015 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.423527 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.424090 31565 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 2.
I20260709 12:22:37.424973 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.425637 31565 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:37.425917 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:37.427572 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.428946 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:37.429251 31424 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:37.429628 32110 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:37.429800 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1385) took 1145 ms. Trace:
W20260709 12:22:37.413540 31571 rpcz_store.cc:269] 0709 12:22:35.635849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.635971 (+   122us) service_pool.cc:224] Handling call
0709 12:22:37.394444 (+1758473us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400316d54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.394621 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272780544}
I20260709 12:22:37.423714 31419 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:37.430384 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.485126 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.486012 31573 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:37.486068 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.470908 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.485023 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.489178 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.489178 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.441741 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:37.432153 31567 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:37.492059 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.492076 31565 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:37.493942 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 130403us
I20260709 12:22:37.430106 31424 rpcz_store.cc:276] 0709 12:22:36.284760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.428669 (+1143909us) service_pool.cc:224] Handling call
0709 12:22:37.428954 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.429588 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.429749 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:37.430857 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.438737 31566 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:22:37.496752 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:37.497406 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.499320 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.500715 31466 connection.cc:256] RPC call timeout handler was delayed by -1.4466958349999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:22:37.499976 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:37.432777 31540 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.542s (SENT)
I20260709 12:22:37.513700 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.445246  1481 raft_consensus.cc:2764] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:37.516553 31573 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:37.518038 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.515811 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.510740 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.516983 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:37.520627 31567 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:37.521185 31571 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:37.497764 31572 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:37.522773   773 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:37.516947 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.528115 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.529486 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.530726 31415 raft_consensus.cc:2368] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7.
I20260709 12:22:37.530213 31424 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:37.533442 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:37.538091 31573 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:37.539116 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 106376us
W20260709 12:22:37.527611  1516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.010s
I20260709 12:22:37.547112 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.551167 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:37.551740  1540 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:37.552428 31565 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:37.552474 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:37.553378 31418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1382) took 1286 ms (client timeout 1677 ms). Trace:
I20260709 12:22:37.554625 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:37.553776 31418 rpcz_store.cc:269] 0709 12:22:36.266532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.266774 (+   242us) service_pool.cc:224] Handling call
0709 12:22:37.553232 (+1286458us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54002120d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:37.553325 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898331904}
I20260709 12:22:37.559944 31566 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:22:37.540231  1516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.007s	sys 0.011s
W20260709 12:22:37.560482 31540 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.648s (SENT)
I20260709 12:22:37.561566 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.544502  1528 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.544549 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.566358 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.567039 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.566416 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.569128 31419 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.567783 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.569996 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:37.572815 31415 raft_consensus.cc:2410] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:37.573947 31420 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:37.574981 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.576431 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.577201 32111 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.577975 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.578295 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.578917 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.579130 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.579418 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.580753 32108 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:37.581574  1239 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.581782 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.582343 32112 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:37.588924 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.589768 31421 raft_consensus.cc:2368] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7.
I20260709 12:22:37.589910 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.589752  1584 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.590664 31423 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.590518 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:37.591742 31540 leader_election.cc:336] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.651s (SENT)
I20260709 12:22:37.592103 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:37.592183 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.592851 31418 raft_consensus.cc:2376] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4. Re-sending same reply.
I20260709 12:22:37.596163  1596 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:37.596954  1340 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.597772 31424 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:37.546039  1552 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:37.598788  1596 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.599511 32113 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:37.599572 31420 raft_consensus.cc:2410] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:37.601001  1552 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:37.603967 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:37.613149 31572 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:37.620054 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:37.621768 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:37.598366  1527 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:37.628835 31573 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:37.632417 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:37.699249 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60041.3us
W20260709 12:22:37.722579 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.762480 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.698724 31573 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.583140 31416 raft_consensus.cc:2376] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4. Re-sending same reply.
I20260709 12:22:37.777738 31418 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:37.796083 31573 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:37.617290  1506 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:37.842460 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 70002.2us
W20260709 12:22:37.853535 31466 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.739s (SENT)
I20260709 12:22:37.773211  1550 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:22:37.983774  1527 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:37.984442 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 130941us
W20260709 12:22:37.985184 31466 leader_election.cc:336] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.819s (SENT)
I20260709 12:22:37.983708 31419 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
W20260709 12:22:37.983580 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.984616  1621 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.364s	user 0.000s	sys 0.000s
W20260709 12:22:38.078615  1620 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 12:22:38.081947  1623 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 12:22:38.084741 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 492991us
W20260709 12:22:38.094588 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 109341us
I20260709 12:22:38.095316 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:38.095770 31466 leader_election.cc:336] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.882s (SENT)
I20260709 12:22:38.096187 31419 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:38.096273 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:38.100442 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:38.101687 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:38.102214 31567 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:38.103327 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:38.104168 31567 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.122532 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.132664 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.051679  1527 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.147655 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.151046 31417 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:38.151651 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:38.158319 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.160060 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.161084 31569 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:38.148070  1621 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:22:38.168814 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.177388 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.178349 31423 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:38.189276 31567 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:38.158805 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:38.209693 32080 connection.cc:256] RPC call timeout handler was delayed by -1.3683537209999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:22:38.210587 32080 connection.cc:256] RPC call timeout handler was delayed by -1.1856537210001079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 12:22:38.213941 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.214802 31423 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:38.220294 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:38.220522 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:38.160466  1527 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:38.221053 32110 raft_consensus.cc:606] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:38.233502 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:38.218729  1516 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.239123 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.234488  1550 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.244009  1588 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:38.248633  1624 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.475s	user 0.008s	sys 0.002s
I20260709 12:22:38.249344 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.250209 31415 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:38.251034 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.252053 31415 raft_consensus.cc:2410] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:38.214512  1467 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:38.253708  1467 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:38.253852 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.253580  1578 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:38.252985 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.254601  1578 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:38.255883 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.257777 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.258884 31415 raft_consensus.cc:2410] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:38.259881 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.265128  1527 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:38.266184 31415 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:38.268191 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.215157 31416 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:38.271409 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:38.272255 31416 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:22:38.272987 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.273525 31416 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.275616 31423 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
W20260709 12:22:38.288897 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.290423 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:38.290436 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.291049 31423 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.289316  1588 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:38.292227 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2329) took 2401 ms. Trace:
I20260709 12:22:38.292934 31574 rpcz_store.cc:276] 0709 12:22:35.887339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.993570 (+106231us) service_pool.cc:224] Handling call
0709 12:22:35.993852 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.049156 (+ 55304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.287511 (+2238355us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54002607d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:38.288913 (+  1402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116853504}
I20260709 12:22:38.300320 32110 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:38.292996  1550 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:38.318195 32109 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:38.275362  1516 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:38.319041  1550 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.297839  1510 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 12:22:38.318298 31565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.032s	sys 0.028s
I20260709 12:22:38.332510 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2339) took 1181 ms. Trace:
W20260709 12:22:38.334270 31565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.032s	sys 0.028s
I20260709 12:22:38.334347 31566 rpcz_store.cc:276] 0709 12:22:37.150891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.519482 (+368591us) service_pool.cc:224] Handling call
0709 12:22:37.554524 (+ 35042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.562280 (+  7756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.332253 (+769973us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400251cd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:38.332433 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64956160}
I20260709 12:22:38.298259  1588 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:38.336997 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.343670 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.349807 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:38.337280 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 241531us
I20260709 12:22:38.351790 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.352751 32106 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:38.353556 31466 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 2.045s (SENT)
I20260709 12:22:38.333281  1550 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:38.356405 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.354226 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:38.362761 31423 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:22:38.351778 31415 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:38.329457  1557 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:22:38.371095 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.395879 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.397974 32106 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:38.407027 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:38.418133 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.394496 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:38.431084  1629 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:22:38.444572 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:38.445587 31496 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:38.446210 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1301) took 1356 ms. Trace:
W20260709 12:22:38.447418 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.447464 31423 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:38.446628 31496 rpcz_store.cc:276] 0709 12:22:37.089650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.113272 (+ 23622us) service_pool.cc:224] Handling call
0709 12:22:38.444335 (+1331063us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:38.446131 (+  1796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17052544}
I20260709 12:22:38.447338  1566 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.451053  1566 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:38.451772  1516 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:38.453572  1588 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:38.455494 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 690) took 1215 ms. Trace:
I20260709 12:22:38.456146 31416 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:38.455915 32113 rpcz_store.cc:276] 0709 12:22:37.240028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.240269 (+   241us) service_pool.cc:224] Handling call
0709 12:22:38.455256 (+1214987us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54005799d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:38.455393 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823890176}
I20260709 12:22:38.460057 31420 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:38.461630  1244 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:38.462085  1244 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:38.471333 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 296838us
I20260709 12:22:38.474790 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:38.462214  1588 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.475498 32109 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:38.484977 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:38.487684 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:38.490746 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:38.493590 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:38.496666 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:38.496850 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 323330us
I20260709 12:22:38.497313 32109 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:38.506786 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:38.508507 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:38.546411 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2347) took 1195 ms. Trace:
I20260709 12:22:38.546870 31565 rpcz_store.cc:276] 0709 12:22:37.351209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.553477 (+202268us) service_pool.cc:224] Handling call
0709 12:22:37.561377 (+  7900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.568324 (+  6947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.568758 (+   434us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.589545 (+ 20787us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.334708 (+745163us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:38.334747 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.334815 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.546197 (+211382us) raft_consensus.cc:1685] finished
0709 12:22:38.546218 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.546348 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10814,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":561950,"threads_started":1,"wal-append.queue_time_us":872740}
I20260709 12:22:38.470772  1244 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:38.483417  1588 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:38.549913 31573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.011s
W20260709 12:22:38.556774 31573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.011s
W20260709 12:22:38.567898 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.549454  1632 raft_consensus.cc:2764] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:38.558451 31416 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 12:22:38.574163 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 328235us
W20260709 12:22:38.579558 31540 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 2.192s (SENT)
I20260709 12:22:38.580163 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:38.567576  1513 raft_consensus.cc:2764] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:22:38.582403 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.570731  1578 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.577236 31416 pending_rounds.cc:85] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 2
I20260709 12:22:38.575122  1244 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.589843  1603 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.594322 31416 pending_rounds.cc:107] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:38.593585  1467 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:38.609905  1513 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:22:38.660696  1578 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:22:38.690397  1578 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:38.661095 31416 raft_consensus.cc:2889] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:38.695459  1605 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.377s	user 0.004s	sys 0.012s
I20260709 12:22:38.663084  1603 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:38.799002 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 302658us
W20260709 12:22:38.821452 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 310622us
W20260709 12:22:38.823621 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 351475us
W20260709 12:22:38.990476 31390 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 1.520s (SENT) [suppressed 80 similar messages]
W20260709 12:22:38.933604 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 435629us
W20260709 12:22:38.994480 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 487792us
W20260709 12:22:38.989449 31387 connection.cc:256] RPC call timeout handler was delayed by -1.3232228270003361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:22:38.996037 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 420160us
W20260709 12:22:38.838420  1593 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.610s	user 0.019s	sys 0.034s
I20260709 12:22:38.990258 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:39.194687 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 204495us
I20260709 12:22:39.195402 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:39.003648  1550 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.006s
I20260709 12:22:39.177350  1471 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:39.104995 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 751403us
W20260709 12:22:39.148875 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.006s	sys 0.015s
W20260709 12:22:39.232427 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.007s	sys 0.015s
W20260709 12:22:39.179047 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1390) took 1757 ms (client timeout 2192 ms). Trace:
W20260709 12:22:39.233002 31421 rpcz_store.cc:269] 0709 12:22:37.421325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.466649 (+ 45324us) service_pool.cc:224] Handling call
0709 12:22:39.141324 (+1674675us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54004493d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:39.178972 (+ 37648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222549760}
I20260709 12:22:39.179896 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2471) took 1025 ms. Trace:
W20260709 12:22:39.097353 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 539094us
W20260709 12:22:39.005704 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.005097  1634 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:39.172394  1633 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.192224 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:39.200340 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1290) took 3384 ms. Trace:
I20260709 12:22:39.203789 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1308) took 3093 ms. Trace:
I20260709 12:22:39.241670 31495 rpcz_store.cc:276] 0709 12:22:36.085787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.846261 (+760474us) service_pool.cc:224] Handling call
0709 12:22:36.855933 (+  9672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:36.856126 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:36.907011 (+ 50885us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.252575 (+1345564us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18002ff9e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a 00007fc11976da2a
0709 12:22:39.005620 (+753045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:39.178907 (+173287us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:39.178951 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.179019 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.179150 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50525,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"spinlock_wait_cycles":24184576,"thread_start_us":752559,"threads_started":2}
I20260709 12:22:39.244786 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:39.234452 31420 rpcz_store.cc:276] 0709 12:22:38.154277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.437853 (+283576us) service_pool.cc:224] Handling call
0709 12:22:38.459803 (+ 21950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:38.462412 (+  2609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.141754 (+679342us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400148f50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:39.179807 (+ 38053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49660672}
I20260709 12:22:39.247867 31420 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:39.241444 31493 rpcz_store.cc:276] 0709 12:22:35.809536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.284745 (+475209us) service_pool.cc:224] Handling call
0709 12:22:37.411418 (+1126673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.412214 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.193384 (+1781170us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002e5250. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:39.193522 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413281536}
W20260709 12:22:39.201293  1593 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.979s	user 0.035s	sys 0.042s
I20260709 12:22:39.212936 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:39.214923 31570 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:39.216943 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:39.271709 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2474) took 1116 ms. Trace:
W20260709 12:22:39.279608 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62728.9us
I20260709 12:22:39.212240 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:39.249818 31574 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:39.192839  1467 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:39.276649 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 84530.9us
I20260709 12:22:39.282717 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.283427 31493 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:39.284063 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 293606us
I20260709 12:22:39.278746 31420 rpcz_store.cc:276] 0709 12:22:38.155550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.247316 (+1091766us) service_pool.cc:224] Handling call
0709 12:22:39.247680 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.271379 (+ 23699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.271631 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.285730 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.286413 31495 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:39.288473 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:39.229300  1596 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:39.011137  1637 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:39.215572  1513 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:39.280898 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 68767.8us
W20260709 12:22:39.295835 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 91144.4us
I20260709 12:22:39.240826 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2472) took 1086 ms. Trace:
I20260709 12:22:39.260136  1527 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:39.339442 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 139464us
W20260709 12:22:39.342898 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54032.6us
W20260709 12:22:39.355592 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 164946us
I20260709 12:22:39.343149 31387 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:39.287498  1588 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:39.260275  1666 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.282908  1467 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:39.296401  1596 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.284354  1638 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:39.256165  1634 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:39.416615 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2338) took 2266 ms. Trace:
I20260709 12:22:39.325031  1637 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.340704  1633 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:39.340999  1513 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:39.349474  1566 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:39.528241 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 327396us
I20260709 12:22:39.531178 31568 rpcz_store.cc:276] 0709 12:22:37.150526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.160393 (+  9867us) service_pool.cc:224] Handling call
0709 12:22:37.160799 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.161269 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.161311 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.169722 (+  8411us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.253036 (+ 83314us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:37.253072 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.253157 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.544295 (+1291138us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:39.371474 (+827179us) raft_consensus.cc:1685] finished
0709 12:22:39.371507 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.416523 (+ 45016us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":20269,"spinlock_wait_cycles":10775296,"thread_start_us":82767,"threads_started":1,"wal-append.queue_time_us":127283}
W20260709 12:22:39.544044 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.277138  1550 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:39.550786 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.550999 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.551455 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.551646 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.415606  1648 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:39.532953  1588 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:39.612780 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 380230us
I20260709 12:22:39.663733 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:39.664243 31466 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 2.710s (SENT)
I20260709 12:22:39.664767 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:39.613492 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.420785  1596 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:39.666821 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 311820us
I20260709 12:22:39.670662 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:39.670874 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.547346  1510 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:39.674773 32114 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:39.675424 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.536356  1637 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:39.549789  1513 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:39.350127 31416 rpcz_store.cc:276] 0709 12:22:38.154703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.486600 (+331897us) service_pool.cc:224] Handling call
0709 12:22:38.509795 (+ 23195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.127933 (+618138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.228696 (+100763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.368710  1527 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:39.556473  1541 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:39.685527 32109 raft_consensus.cc:2368] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6.
I20260709 12:22:39.614226  1648 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.354225  1640 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.380s
I20260709 12:22:39.730079 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:39.731387 31422 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 379) took 1580 ms (client timeout 1731 ms). Trace:
W20260709 12:22:39.734375 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 391286us
I20260709 12:22:39.735162 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:39.676621  1643 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:39.731805 31422 rpcz_store.cc:269] 0709 12:22:38.151360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.158273 (+  6913us) service_pool.cc:224] Handling call
0709 12:22:39.729913 (+1571640us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:39.731328 (+  1415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6439680}
I20260709 12:22:39.741777 31422 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:39.742436 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2481) took 1527 ms. Trace:
I20260709 12:22:39.742866 31422 rpcz_store.cc:276] 0709 12:22:38.214596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.741176 (+1526580us) service_pool.cc:224] Handling call
0709 12:22:39.741520 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.742177 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.742386 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.743297 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:39.745625 31422 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:39.747174 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2482) took 1523 ms. Trace:
I20260709 12:22:39.747560 31422 rpcz_store.cc:276] 0709 12:22:38.223863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.743646 (+1519783us) service_pool.cc:224] Handling call
0709 12:22:39.743911 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.746805 (+  2894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.747110 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.748983 31422 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:22:39.749594 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2483) took 1518 ms. Trace:
I20260709 12:22:39.750563 31422 rpcz_store.cc:276] 0709 12:22:38.231002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.748426 (+1517424us) service_pool.cc:224] Handling call
0709 12:22:39.748744 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:39.749355 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.749534 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.550174  1633 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.547538  1638 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.766117 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.766862 31500 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.755367 31493 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:39.771207 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.777068 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.589828  1566 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.778535 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:39.782709 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:39.742502  1541 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:39.796063 31417 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:39.796813 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 388) took 1620 ms. Trace:
I20260709 12:22:39.797150 31417 rpcz_store.cc:276] 0709 12:22:38.176558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.741176 (+1564618us) service_pool.cc:224] Handling call
0709 12:22:39.776334 (+ 35158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.796514 (+ 20180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.796754 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.797833 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.732215 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.813055 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.730088  1648 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:39.819141 32106 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:39.778934  1244 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.151s	user 0.011s	sys 0.006s
W20260709 12:22:39.820654 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 140284us
I20260709 12:22:39.824781 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.831305 32114 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:39.824990 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.824812 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:39.833140 31493 raft_consensus.cc:2410] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:39.828598 31417 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:39.835632 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2487) took 1547 ms. Trace:
I20260709 12:22:39.836073 31417 rpcz_store.cc:276] 0709 12:22:38.288565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.798066 (+1509501us) service_pool.cc:224] Handling call
0709 12:22:39.828397 (+ 30331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.835304 (+  6907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.835551 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:39.778112  1588 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.737828  1528 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:22:39.763904 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:39.676311  1467 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.778640  1651 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:39.795758  1541 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:39.828917 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 85708.9us
I20260709 12:22:39.873188 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:39.873879 31497 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:39.877492 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:39.879793  1639 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.525s	user 0.001s	sys 0.000s
I20260709 12:22:39.880116  1681 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:39.880363  1527 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:39.868167  1593 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.880705  1681 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.881585  1566 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:39.883478  1657 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:39.883654  1650 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.884006  1657 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:39.884207  1650 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:39.884963  1657 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:39.886266  1650 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:39.888248  1635 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.889051  1635 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:39.868425  1651 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:39.892035  1665 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.892541  1665 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:39.896229 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 383) took 1742 ms. Trace:
I20260709 12:22:39.881142 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 528) took 2312 ms. Trace:
I20260709 12:22:39.897188 31573 rpcz_store.cc:276] 0709 12:22:37.568608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.797010 (+228402us) service_pool.cc:224] Handling call
0709 12:22:37.797425 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:37.983712 (+186287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.983743 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:37.984418 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 12:22:38.557246 (+572828us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:38.557283 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.557349 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:39.880928 (+1323579us) raft_consensus.cc:1685] finished
0709 12:22:39.880945 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.881085 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51999,"raft.queue_time_us":185583,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":572432,"threads_started":1,"wal-append.queue_time_us":1230722}
W20260709 12:22:39.902639 31495 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.000s
I20260709 12:22:39.905988 31495 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:39.907320 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:39.908130 31495 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:39.916875 31500 raft_consensus.cc:2410] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:39.917961 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:39.924425 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 78853.6us
W20260709 12:22:39.926653 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.931742 31418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.004s
W20260709 12:22:39.931783  1516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.002s	sys 0.010s
W20260709 12:22:39.932340 31418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.004s
W20260709 12:22:39.932093 31423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.008s
I20260709 12:22:39.869172  1467 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:39.934082 31423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.002s	sys 0.008s
W20260709 12:22:39.895205  1655 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:22:39.939920 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:39.938189 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.830600  1510 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:39.924499 32105 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:39.942148 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.009s
W20260709 12:22:39.945533 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.005s	sys 0.009s
I20260709 12:22:39.943439 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.935976 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.875919  1672 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:39.876371  1501 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:39.951946 31565 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.013s	sys 0.005s
I20260709 12:22:39.940796 31497 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:39.948647 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 71251.3us
I20260709 12:22:39.959894 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:39.961081 31565 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.014s	sys 0.005s
I20260709 12:22:39.952764 31500 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:39.939534 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 156924us
I20260709 12:22:39.924443  1566 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:39.961496  1674 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:39.940652  1577 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:39.972585 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:39.976415 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:39.982896 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.025s
W20260709 12:22:39.985862 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.005s	sys 0.025s
W20260709 12:22:39.986150 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 629844us
I20260709 12:22:39.983852 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 532) took 1514 ms. Trace:
W20260709 12:22:39.932509  1516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.002s	sys 0.010s
I20260709 12:22:39.959190  1645 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.989266 31566 rpcz_store.cc:276] 0709 12:22:38.469138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.469287 (+   149us) service_pool.cc:224] Handling call
0709 12:22:38.469702 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.470142 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.470181 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.473049 (+  2868us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.850483 (+377434us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:38.850540 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.859650 (+  9110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:39.983582 (+1123932us) raft_consensus.cc:1685] finished
0709 12:22:39.983610 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.983780 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34963,"raft.queue_time_us":243040,"raft.run_cpu_time_us":13854,"raft.run_wall_time_us":490509,"thread_start_us":347069,"threads_started":1,"wal-append.queue_time_us":1041269}
I20260709 12:22:40.000232 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:39.993623 31500 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.959254  1635 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:39.958704  1681 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:40.007957 32077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.001s	sys 0.014s
W20260709 12:22:40.018867 32077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.001s	sys 0.014s
I20260709 12:22:40.019328  1665 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:40.019948  1659 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:22:40.020048  1645 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:40.021565 32139 heartbeater.cc:646] Failed to heartbeat to 127.29.143.254:45911 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.143.254:45911 timed out after 15.000s (SENT)
I20260709 12:22:39.939965  1675 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:22:39.962098  1672 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.022935 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 385) took 1868 ms. Trace:
I20260709 12:22:40.023283 31424 rpcz_store.cc:276] 0709 12:22:38.154608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.463676 (+309068us) service_pool.cc:224] Handling call
0709 12:22:38.472825 (+  9149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.473130 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.473161 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.475535 (+  2374us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.960829 (+485294us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:38.960887 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.960993 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.022739 (+1061746us) raft_consensus.cc:1685] finished
0709 12:22:40.022758 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.022881 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25010,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6718,"thread_start_us":457030,"threads_started":1,"wal-append.queue_time_us":1061434}
I20260709 12:22:40.024333  1672 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:39.987826  1577 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:40.025717  1633 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.025395  1577 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.026407  1577 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.026516 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 390) took 1816 ms. Trace:
I20260709 12:22:39.999308  1244 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.005923  1688 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.027231  1635 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:40.027347  1232 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:40.028349  1645 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:39.940102  1680 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 12:22:40.043814 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 43661.8us
I20260709 12:22:40.063346 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:40.063462 31540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.012s	sys 0.012s
I20260709 12:22:39.976300  1501 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:40.064105 31540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.012s	sys 0.012s
I20260709 12:22:40.017699  1638 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:40.052371  1593 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:40.066116 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 820331us
I20260709 12:22:40.083026 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:40.064442 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.008s	sys 0.020s
W20260709 12:22:40.239765 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.009s	sys 0.021s
W20260709 12:22:40.240483 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 952029us
I20260709 12:22:40.241791 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:40.070955  1633 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.163916 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2489) took 1874 ms. Trace:
I20260709 12:22:40.229197 31500 raft_consensus.cc:2410] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:40.052489  1672 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:22:40.053217  1646 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:40.234297 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.007s	sys 0.036s
I20260709 12:22:40.085464  1526 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.066147  1679 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.053009  1689 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:40.052193  1665 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:22:40.086133  1593 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:40.241803 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 187925us
I20260709 12:22:40.243611 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:40.164645 31463 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.547s (SENT)
W20260709 12:22:40.320076 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 155496us
W20260709 12:22:40.320114 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 76586.9us
W20260709 12:22:40.320745 31463 leader_election.cc:336] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.660s (SENT)
I20260709 12:22:40.321177 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:40.252504 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 169527us
I20260709 12:22:40.322127 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:40.052062  1688 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.260845 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1311) took 1088 ms. Trace:
I20260709 12:22:40.334090 31500 rpcz_store.cc:276] 0709 12:22:39.172645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.972142 (+799497us) service_pool.cc:224] Handling call
0709 12:22:40.260754 (+288612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.335376 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:40.266386 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.036s
W20260709 12:22:40.336560 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.253351  1687 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.281165  1701 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:22:40.247051 31417 rpcz_store.cc:276] 0709 12:22:38.289761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.837099 (+1547338us) service_pool.cc:224] Handling call
0709 12:22:39.857868 (+ 20769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.858107 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:39.858392 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.163459 (+305067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.163534 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:40.163595 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.163687 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.163838 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90552,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":41726,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":29228,"thread_start_us":262988,"threads_started":1}
I20260709 12:22:40.255522  1527 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:40.468160  1672 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:40.339030 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.337352 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:40.505915 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 169110us
I20260709 12:22:40.264964  1680 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.078960  1510 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.270736  1526 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.269570  1651 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:40.315191  1639 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:40.332996  1593 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.513551 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 443) took 1520 ms. Trace:
I20260709 12:22:40.513962 31499 rpcz_store.cc:276] 0709 12:22:38.992972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.993062 (+    90us) service_pool.cc:224] Handling call
0709 12:22:40.512902 (+1519840us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:40.513080 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.513250 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.513274 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.513313 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:40.513349 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.513403 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.513500 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3710720}
I20260709 12:22:40.515349 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:40.516525 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.517588 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:40.517812  1643 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.755s	user 0.005s	sys 0.007s
I20260709 12:22:40.518324 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1312) took 1345 ms. Trace:
I20260709 12:22:40.518446  1643 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.518980 31566 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:40.368387 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:40.372733 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52018.2us
I20260709 12:22:40.337291  1675 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:40.373391 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 362455us
I20260709 12:22:40.260387  1633 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:40.370076  1655 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:22:40.384933  1691 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:22:40.527781 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 440) took 1535 ms. Trace:
I20260709 12:22:40.528455  1633 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.510579  1526 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.528293 31494 rpcz_store.cc:276] 0709 12:22:38.992086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.992192 (+   106us) service_pool.cc:224] Handling call
0709 12:22:39.184009 (+191817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.662145 (+478136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.662197 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.675269 (+ 13072us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.865216 (+189947us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:39.865254 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.865317 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.527548 (+662231us) raft_consensus.cc:1685] finished
0709 12:22:40.527568 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.527722 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20590,"raft.queue_time_us":349336,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":51765,"thread_start_us":501870,"threads_started":2,"wal-append.queue_time_us":337129}
I20260709 12:22:40.493973  1525 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:40.530833  1683 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
I20260709 12:22:40.530932  1525 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:40.531859  1525 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.496685  1527 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:40.385149 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:40.532938  1525 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.535130 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 386) took 2380 ms. Trace:
I20260709 12:22:40.530741 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.535490 31421 rpcz_store.cc:276] 0709 12:22:38.154991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.234244 (+1079253us) service_pool.cc:224] Handling call
0709 12:22:39.269146 (+ 34902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.269601 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.269640 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.270197 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.794800 (+524603us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:39.794918 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.795011 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.530230 (+735219us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:40.534830 (+  4600us) raft_consensus.cc:1685] finished
0709 12:22:40.534860 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.535062 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9108,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":45628,"spinlock_wait_cycles":15850880,"thread_start_us":422691,"threads_started":1,"wal-append.queue_time_us":727825}
I20260709 12:22:40.357651  1700 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:40.368019  1678 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:40.537329  1700 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.537437  1678 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.539538  1700 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:40.539819  1678 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.323009 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:40.314997  1679 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.532476 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.541337  1677 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:40.541666 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:40.390331  1596 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.004s
I20260709 12:22:40.380788  1692 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:40.408036  1632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.696s	user 0.003s	sys 0.022s
I20260709 12:22:40.438257 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1407) took 2319 ms. Trace:
I20260709 12:22:40.551239 31495 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:40.332738  1635 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.038050 31416 rpcz_store.cc:276] 0709 12:22:38.210099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.747704 (+1537605us) service_pool.cc:224] Handling call
0709 12:22:39.820942 (+ 73238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:39.851453 (+ 30511us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:39.880032 (+ 28579us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.016663 (+136631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:40.018312 (+  1649us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:40.026280 (+  7968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.026347 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.026463 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56905,"prepare.queue_time_us":116778,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":91943,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13282,"thread_start_us":57675,"threads_started":1}
I20260709 12:22:40.395780  1710 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.451408  1501 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.363714  1687 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.459620  1665 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:40.483387  1688 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.488976  1634 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:40.490342  1541 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
W20260709 12:22:40.348466 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.032s	sys 0.061s
W20260709 12:22:40.577999 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.035s	sys 0.062s
I20260709 12:22:40.249743  1657 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:40.499955 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 162893us
W20260709 12:22:40.506870 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.581812 31465 leader_election.cc:336] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.966s (SENT)
I20260709 12:22:40.587780 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1321) took 1336 ms. Trace:
I20260709 12:22:40.588364 31495 rpcz_store.cc:276] 0709 12:22:39.250980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.919153 (+668173us) service_pool.cc:224] Handling call
0709 12:22:40.587524 (+668371us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400012a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:40.587706 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387160320}
W20260709 12:22:40.507392 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.506947 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:40.590200 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 83339.5us
I20260709 12:22:40.592010 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:40.510628  1681 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:40.520068 31463 leader_election.cc:336] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.674s (SENT)
I20260709 12:22:40.520715 31499 rpcz_store.cc:276] 0709 12:22:39.172870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.517382 (+1344512us) service_pool.cc:224] Handling call
0709 12:22:40.518266 (+   884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.593291 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:40.522483 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:40.593952 31500 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:40.594172 31496 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:40.540092  1637 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.000s
I20260709 12:22:40.541730  1677 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:40.332178  1690 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.138s
I20260709 12:22:40.542300 31493 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:40.543596 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 220526us
I20260709 12:22:40.551406 31418 rpcz_store.cc:276] 0709 12:22:38.119292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.119586 (+   294us) service_pool.cc:224] Handling call
0709 12:22:38.119973 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.120322 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.120349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.143819 (+ 23470us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.137111 (+993292us) spinlock_profiling.cc:243] Waited 929 us on lock 0x7b1800316de0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:22:39.349545 (+212434us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:39.947183 (+597638us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.993202 (+ 46019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.993285 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.437955 (+444670us) raft_consensus.cc:1685] finished
0709 12:22:40.438051 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.438194 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72815,"prepare.queue_time_us":583978,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":39,"raft.queue_time_us":112017,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":16071,"spinlock_wait_cycles":3624576,"thread_start_us":682323,"threads_started":2,"wal-append.queue_time_us":2229377}
I20260709 12:22:40.550880  1506 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:40.532964  1527 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:40.560119 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:40.560566  1593 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.563118 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:40.620465 31390 connection.cc:256] RPC call timeout handler was delayed by -1.0269533189994036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2654s for a response
I20260709 12:22:40.588999  1577 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.566174  1603 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.551014  1672 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.632826  1672 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.623195  1656 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.633800  1656 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.635063  1672 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.556769  1710 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.635859  1710 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.636345  1656 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.636864  1680 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.637529  1680 consensus_queue.cc:1243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:40.638067  1693 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:40.574208 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.639770 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:40.607985  1657 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.640376 31494 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:40.641953  1657 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.542251  1679 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:40.551268  1632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.852s	user 0.004s	sys 0.023s
I20260709 12:22:40.555025  1675 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:40.644495  1550 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:40.644297  1675 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:40.594377 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74351.7us
W20260709 12:22:40.592849 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.647006 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 712) took 1094 ms. Trace:
I20260709 12:22:40.647595 32107 rpcz_store.cc:276] 0709 12:22:39.555767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.588511 (+ 32744us) service_pool.cc:224] Handling call
0709 12:22:40.559999 (+971488us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:40.646938 (+ 86939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15179520}
I20260709 12:22:40.647799  1645 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:40.648802  1645 consensus_queue.cc:1243] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:40.649326  1645 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:40.649649  1645 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:40.599472 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:40.650956 32110 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:40.651031 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.650462  1645 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.542562  1596 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.653420 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.654860  1596 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.563964 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.586985  1688 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.606786  1578 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.595985  1232 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.655949 31492 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:40.655725  1688 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.656426 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 444) took 1663 ms. Trace:
I20260709 12:22:40.656163  1232 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.656772 31492 rpcz_store.cc:276] 0709 12:22:38.993225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.993616 (+   391us) service_pool.cc:224] Handling call
0709 12:22:40.563794 (+1570178us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:40.656369 (+ 92575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26294656}
I20260709 12:22:40.657781  1688 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.621125 31498 raft_consensus.cc:2410] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:40.576433  1665 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:40.658161  1232 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:40.658557 31498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 445) took 1665 ms (client timeout 1511 ms). Trace:
I20260709 12:22:40.658496 31424 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:40.659312 32109 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:22:40.659008  1665 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.555877  1692 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.660012  1593 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.608412  1566 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:22:40.659037 31498 rpcz_store.cc:269] 0709 12:22:38.993662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.993798 (+   136us) service_pool.cc:224] Handling call
0709 12:22:40.562933 (+1569135us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:40.658465 (+ 95532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5326208}
I20260709 12:22:40.661185  1566 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:40.661633 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2490) took 2363 ms. Trace:
I20260709 12:22:40.625037 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:40.631727  1663 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:40.631801  1678 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:40.662454  1663 consensus_queue.cc:1243] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:40.606316  1506 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.587124  1541 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.662969  1506 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:40.606411 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:40.664179 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57846.5us
I20260709 12:22:40.664474 31491 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.665089  1541 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.665679  1541 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.665757 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:40.616755  1637 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:40.667249  1684 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.667639  1684 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:40.667892 31497 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:40.668007  1684 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.661531  1692 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:40.647256 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.605811  1471 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:40.661535 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.681448 31498 raft_consensus.cc:2410] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:22:40.662974  1663 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:40.680272 31496 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:40.621165  1728 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:40.631445 32108 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:22:40.647075 31463 leader_election.cc:336] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.677s (SENT)
I20260709 12:22:40.655144  1687 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:39.896616 31415 rpcz_store.cc:276] 0709 12:22:38.153861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.428883 (+275022us) service_pool.cc:224] Handling call
0709 12:22:38.430004 (+  1121us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:38.471799 (+ 41795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.471829 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:38.474336 (+  2507us) log.cc:844] Serialized 52 byte log entry
0709 12:22:38.989990 (+515654us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:39.341978 (+351988us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.530743 (+188765us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.534427 (+  3684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.534497 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:39.895995 (+361498us) raft_consensus.cc:1685] finished
0709 12:22:39.896017 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:39.896170 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104657,"prepare.queue_time_us":863310,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3872,"raft.queue_time_us":706002,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":31813,"thread_start_us":530260,"threads_started":2,"wal-append.queue_time_us":1385837}
W20260709 12:22:40.602110 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.657943 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.674322 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:40.679747 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54972.5us
W20260709 12:22:40.718096 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43874.2us
W20260709 12:22:40.679533  1513 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.945s	user 0.014s	sys 0.004s
I20260709 12:22:40.719244 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:40.720368 31422 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:40.681942 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.721196 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.721544 31495 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:40.683939 31416 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:40.685348 31496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 439) took 1693 ms (client timeout 1836 ms). Trace:
I20260709 12:22:40.722003 31498 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:40.687561 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 153212us
I20260709 12:22:40.691221 31418 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:22:40.702183 31493 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:40.722822 31418 pending_rounds.cc:85] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 6
I20260709 12:22:40.722992 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 448) took 1551 ms. Trace:
I20260709 12:22:40.622028  1690 consensus_queue.cc:1243] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:40.732453 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.732961 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.733184 31415 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:40.734091 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:40.734148 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.735756  1662 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:40.735366 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.737243 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.738147 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.738802  1638 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:40.738942 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:40.739300  1641 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.325s	user 0.002s	sys 0.004s
I20260709 12:22:40.739737 31495 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:40.739392  1638 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.740496 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:40.740984 31495 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.678982 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:40.741540  1638 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.623646  1634 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.679227  1577 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.744158  1577 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.744206 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:40.718072  1471 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:40.745476  1471 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.746532  1528 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:40.746932  1528 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:40.747296  1528 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:40.716657 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.747852 31497 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:40.673792 31494 raft_consensus.cc:2410] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:40.662065 31424 rpcz_store.cc:276] 0709 12:22:38.297890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.024700 (+1726810us) service_pool.cc:224] Handling call
0709 12:22:40.025001 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.659137 (+634136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.661429 (+  2292us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400352ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:40.661576 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456528768}
W20260709 12:22:40.749003 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124065us
I20260709 12:22:40.749408 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1313) took 1576 ms. Trace:
I20260709 12:22:40.723084 31418 pending_rounds.cc:107] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:22:40.749922 31418 raft_consensus.cc:2889] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:40.723412 31493 rpcz_store.cc:276] 0709 12:22:39.172117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.541386 (+1369269us) service_pool.cc:224] Handling call
0709 12:22:40.722926 (+181540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.587473  1526 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:40.749032 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95958.7us
I20260709 12:22:40.752555 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.753216 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:40.753690 31417 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.754055 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.623797  1681 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:40.686986  1656 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.684578  1663 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:40.661573  1566 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:40.713861 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:40.691704  1467 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.004s
I20260709 12:22:40.749747 31494 rpcz_store.cc:276] 0709 12:22:39.173117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.639498 (+1466381us) service_pool.cc:224] Handling call
0709 12:22:40.749350 (+109852us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:40.723412 31496 rpcz_store.cc:269] 0709 12:22:38.991787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.991919 (+   132us) service_pool.cc:224] Handling call
0709 12:22:40.522302 (+1530383us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:40.685285 (+162983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4937472}
I20260709 12:22:40.756023 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:40.729056 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:40.756968 31416 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:40.757341 31493 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:40.770793 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:40.772769 31491 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:40.763577 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:40.773904 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:40.775060 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.776357 31496 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.721355  1637 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.783933 31418 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
W20260709 12:22:40.852828 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 205783us
I20260709 12:22:40.748890  1646 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.796849 31497 raft_consensus.cc:606] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:40.796047 31498 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:40.795111 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66173.6us
I20260709 12:22:40.795994 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 447) took 1801 ms. Trace:
I20260709 12:22:40.795617 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.799224 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:40.854099 31463 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.857s (SENT)
W20260709 12:22:40.770129  1648 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.930s	user 0.003s	sys 0.009s
I20260709 12:22:40.755584  1588 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.855723 31495 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:40.758105  1645 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:40.868876 31493 rpcz_store.cc:276] 0709 12:22:38.995146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.756742 (+1761596us) service_pool.cc:224] Handling call
0709 12:22:40.757034 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.795763 (+ 38729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.795943 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:40.872924 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:40.870319 32110 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:40.764955  1526 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.870793 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:40.871034 31497 raft_consensus.cc:614] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:40.870625 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:40.874696 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:40.875058  1729 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:22:40.874764 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:40.767330  1676 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:22:40.895484 31571 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:40.875429  1650 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.875761 31493 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:40.875936  1696 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:22:40.877202  1703 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:40.877908  1681 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:40.878881  1533 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:22:40.879472  1706 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:40.754957 31492 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
W20260709 12:22:40.883775 31463 leader_election.cc:336] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.903s (SENT)
I20260709 12:22:40.885825 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.717829  1728 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.889161 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:40.892225 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.892966 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.894569 32108 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:40.895008 31566 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:40.932264 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:40.898311 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.893939 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:40.750800  1513 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.911090 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.913829 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:40.941502 31567 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.911013 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:40.917145  1685 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.945942 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:40.902972 32107 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:40.887259  1643 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:40.846812  1656 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:40.922884 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 178699us
I20260709 12:22:40.923007 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:40.784615  1688 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:40.923923 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:40.900647  1676 consensus_queue.cc:1243] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:40.927503 31572 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:40.971208 31492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:22:40.971952 31492 raft_consensus.cc:606] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:22:40.972353 31492 raft_consensus.cc:614] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:40.973134 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.872241  1646 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.974932 31420 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:40.774614  1677 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.976257  1677 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.976399  1513 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:40.979137  1678 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:40.979501  1678 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:40.980366  1678 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.981679  1678 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.984604  1665 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:40.987630  1649 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.243s	user 0.016s	sys 0.000s
I20260709 12:22:40.912945  1566 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.988451  1566 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.987644 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1307) took 1057 ms. Trace:
I20260709 12:22:40.990265 31500 rpcz_store.cc:276] 0709 12:22:39.930311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.335070 (+404759us) service_pool.cc:224] Handling call
0709 12:22:40.987450 (+652380us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001d1fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:40.987579 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593060736}
I20260709 12:22:40.940961  1663 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.992197  1663 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.992323  1656 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:40.993031 31416 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7. Re-sending same reply.
I20260709 12:22:40.994931 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.940631  1690 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:40.900902  1650 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:40.853866  1552 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.941604 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.013937 31415 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6. Re-sending same reply.
I20260709 12:22:40.913265  1666 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.941005 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:40.758960  1506 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.950205 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:40.874792  1660 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:22:40.888598  1588 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:41.045284 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 95129.9us
W20260709 12:22:40.996817  1696 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:40.940858  1687 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.963122 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:40.945385  1685 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:40.955466  1578 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:40.881891  1648 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:41.148047  1685 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.148149  1648 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.149237  1603 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.149734  1603 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:40.921073  1706 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:41.015237 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:40.946125  1593 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.955651  1637 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 12:22:41.167271 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.168712 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.169397 31415 raft_consensus.cc:2376] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5. Re-sending same reply.
W20260709 12:22:40.991282  1734 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:22:41.036931  1647 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.322s	user 0.000s	sys 0.002s
W20260709 12:22:41.037163 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 153412us
I20260709 12:22:41.037458 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:41.037804  1694 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:41.116271  1666 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.077275 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:41.081166 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:41.081687 31540 connection.cc:256] RPC call timeout handler was delayed by -2.411739617999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29009999999999997s for a response
I20260709 12:22:41.116844 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:41.024113  1651 raft_consensus.cc:993] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:40.995898  1690 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:41.139983 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58228.2us
W20260709 12:22:41.212524 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135327us
W20260709 12:22:41.140604 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.214869 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.215466 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.048136  1657 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:41.152573 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.025331  1650 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:41.154320 31416 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:41.157017 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:41.159965 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 387) took 2989 ms. Trace:
I20260709 12:22:41.163340 31424 raft_consensus.cc:2410] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:41.024711  1552 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:41.161432 31417 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:41.161975 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 384) took 3007 ms. Trace:
I20260709 12:22:40.860932 31496 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:41.219575 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1314) took 1234 ms. Trace:
I20260709 12:22:41.218982 31420 rpcz_store.cc:276] 0709 12:22:38.170981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.285885 (+1114904us) service_pool.cc:224] Handling call
0709 12:22:39.286152 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.975362 (+1689210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.159667 (+184305us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540022ef54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:41.159896 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3883485568}
I20260709 12:22:41.184391 31567 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:41.186087  1603 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.186664  1637 consensus_queue.cc:1243] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:22:41.192085 31463 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.023s (SENT)
I20260709 12:22:41.192147 32106 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:41.153486  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.679s	user 0.005s	sys 0.025s
I20260709 12:22:41.037174 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:41.200207 31540 connection.cc:256] RPC call timeout handler was delayed by -1.9358567419999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 12:22:41.226729 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5083567419997053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26120000000000004s for a response
I20260709 12:22:41.186393  1728 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.228318 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.228545 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:41.218850 32110 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:41.229449 31417 raft_consensus.cc:2410] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:22:41.206782 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.229449 31420 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:41.196630  1541 consensus_meta.cc:287] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
I20260709 12:22:41.116446  1700 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:22:41.159807  1680 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:22:41.220279 31496 rpcz_store.cc:276] 0709 12:22:39.985256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.802442 (+817186us) service_pool.cc:224] Handling call
0709 12:22:40.860703 (+ 58261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.219272 (+358569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.219513 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:41.162709 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.219017 31423 rpcz_store.cc:276] 0709 12:22:38.154254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.448993 (+294739us) service_pool.cc:224] Handling call
0709 12:22:38.465117 (+ 16124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.465683 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:38.989162 (+523479us) log.cc:844] Serialized 14 byte log entry
0709 12:22:39.972140 (+982978us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.972633 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.972821 (+   188us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:22:39.977466 (+  4645us) log.cc:844] Serialized 14 byte log entry
0709 12:22:40.034540 (+ 57074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:40.034659 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.664187 (+629528us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b48000030d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:22:41.161768 (+497581us) raft_consensus.cc:1685] finished
0709 12:22:41.161798 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.161923 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138348,"prepare.queue_time_us":1339278,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":91782,"raft.run_cpu_time_us":2675,"raft.run_wall_time_us":648301,"spinlock_wait_cycles":7716608,"thread_start_us":1148779,"threads_started":2,"wal-append.queue_time_us":1305192}
I20260709 12:22:41.162236  1706 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.225817 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:41.171315  1593 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:41.231940 32114 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:41.232129 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.189560  1528 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:41.230474  1527 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.001s
W20260709 12:22:41.227749  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.176s	user 0.005s	sys 0.026s
I20260709 12:22:41.224943  1552 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:41.227939  1516 raft_consensus.cc:1081] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:22:41.224720  1550 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:41.247581 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55561.7us
W20260709 12:22:41.249434 31463 leader_election.cc:336] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.028s (SENT)
I20260709 12:22:41.249929 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:41.250300 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.251662 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.252756 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.253996 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.254644 31415 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:41.254791 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.255484 31423 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:41.255280 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:41.253440 31496 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:41.257066 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:41.257229 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.235348  1541 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:41.235515  1694 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.192898  1684 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:41.266108 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:41.210114  1666 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:41.248461  1710 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.007s
I20260709 12:22:41.267064 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1406) took 3156 ms. Trace:
I20260709 12:22:41.267488 31568 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:41.246639  1593 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:41.270423  1726 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.784s	user 0.002s	sys 0.001s
W20260709 12:22:41.270771  1735 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:22:41.273644 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.273595 31419 rpcz_store.cc:276] 0709 12:22:38.111100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.123580 (+ 12480us) service_pool.cc:224] Handling call
0709 12:22:38.123938 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.387081 (+263143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:38.387119 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:38.400006 (+ 12887us) log.cc:844] Serialized 26 byte log entry
0709 12:22:38.995358 (+595352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:39.188020 (+192662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.188107 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.995504 (+1807397us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:41.249305 (+253801us) raft_consensus.cc:1685] finished
0709 12:22:41.249325 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.266994 (+ 17669us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90661,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4335,"spinlock_wait_cycles":12903168,"thread_start_us":641408,"threads_started":2,"wal-append.queue_time_us":2172991}
I20260709 12:22:41.273953 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.277164 31570 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:41.261879  1663 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.263311  1578 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.248526  1527 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:41.269021  1692 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:41.290035 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:41.292542 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.293088 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.301954 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.303930 31419 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:41.315653 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.316687 31567 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:41.295112  1731 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:22:41.322120 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.316263 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.328390 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.329269 31419 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:41.330345 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:41.314522 31492 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:41.333225 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:41.298408  1506 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:41.337776 31566 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:41.340325 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.340937 31423 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:41.341542 31419 raft_consensus.cc:2376] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5. Re-sending same reply.
I20260709 12:22:41.343972 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.344760 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.342599 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:41.278926  1710 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:41.320766  1657 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:41.376576 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.333753  1588 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.254344  1690 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:41.365875  1471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.008s	sys 0.015s
I20260709 12:22:41.368765 31493 raft_consensus.cc:2410] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:22:41.388599 31499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.055s
I20260709 12:22:41.389389 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:41.389673 31499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.055s
W20260709 12:22:41.392663 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.393204 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.400089 31423 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:41.384435  1634 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.003s
I20260709 12:22:41.390303 31496 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:41.385742  1471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.016s
I20260709 12:22:41.395377 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:41.395277  1645 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 12:22:41.407876 31419 raft_consensus.cc:2410] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:22:41.414951 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.282397  1694 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:41.423265  1694 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.394747  1690 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:41.428781 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:41.581396 31497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.024s
W20260709 12:22:41.571166 31573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.018s	sys 0.020s
W20260709 12:22:41.578481 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 365021us
I20260709 12:22:41.633013 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1319) took 2458 ms. Trace:
W20260709 12:22:41.583520 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 326719us
W20260709 12:22:41.588925 31494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.029s	sys 0.036s
W20260709 12:22:41.655905 31495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.015s	sys 0.024s
I20260709 12:22:41.475767 32106 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:41.659775 31497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.038s
I20260709 12:22:41.666496 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:41.665355 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:41.668095 31494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.030s	sys 0.038s
I20260709 12:22:41.476150 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.701469 31423 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:41.665217 31495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.016s	sys 0.025s
I20260709 12:22:41.659880 31493 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:41.707260 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:41.739630 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.766528 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:41.564465  1638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.031s	sys 0.029s
I20260709 12:22:41.668571 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:41.459029  1745 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:22:41.428797  1634 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:41.796239 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:41.881881 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.882187 31493 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:41.429594 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:41.430538 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:41.616489 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.883834 31419 raft_consensus.cc:2410] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:22:41.884035 31466 leader_election.cc:336] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.966s (SENT)
W20260709 12:22:41.884382 31498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.007s	sys 0.044s
I20260709 12:22:41.884560 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:41.884806 31498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.007s	sys 0.044s
W20260709 12:22:41.819465 31573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.021s	sys 0.020s
I20260709 12:22:41.491525  1527 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:41.467402  1666 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:41.664615 31499 rpcz_store.cc:276] 0709 12:22:39.174529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.845819 (+1671290us) service_pool.cc:224] Handling call
0709 12:22:40.846141 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.846351 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:41.400662 (+554311us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.632607 (+231945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.632668 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:41.632715 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.632782 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.632951 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28473,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2379,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":16772,"thread_start_us":785614,"threads_started":2}
W20260709 12:22:41.493050  1662 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.000s
I20260709 12:22:41.811178 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1308) took 1874 ms. Trace:
W20260709 12:22:41.820734 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 152226us
I20260709 12:22:41.917706 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.918241 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:41.406157 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:41.662747  1566 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.000s
I20260709 12:22:41.486821  1528 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:41.483981  1710 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:41.793599  1638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.037s	sys 0.045s
I20260709 12:22:41.810026  1665 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:41.914366 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1375) took 1020 ms. Trace:
I20260709 12:22:41.977281 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:41.982221 31573 rpcz_store.cc:276] 0709 12:22:40.893574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.893684 (+   110us) service_pool.cc:224] Handling call
0709 12:22:40.911919 (+ 18235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.912117 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:40.913960 (+  1843us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.914001 (+1000041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.914066 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:41.914114 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.914185 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.914308 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":530,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3068,"raft.queue_time_us":90708,"thread_start_us":971151,"threads_started":1,"wal-append.queue_time_us":879842}
I20260709 12:22:41.463119  1738 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:41.917302 31494 rpcz_store.cc:276] 0709 12:22:39.938619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.775835 (+837216us) service_pool.cc:224] Handling call
0709 12:22:40.776097 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.776280 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:40.776513 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.810765 (+1034252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.810822 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:41.810871 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.810946 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.811107 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93362,"prepare.queue_time_us":3412,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":94331,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":941202,"threads_started":1}
I20260709 12:22:41.920723 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:41.919592 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.047s
I20260709 12:22:41.558636  1678 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.429888  1670 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.455s
I20260709 12:22:42.053550 31496 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:42.054952 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.010s	sys 0.054s
W20260709 12:22:42.055452 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 681570us
W20260709 12:22:41.880625  1677 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.904s	user 0.007s	sys 0.007s
W20260709 12:22:41.929116 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.022s	sys 0.039s
W20260709 12:22:42.064415 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.024s	sys 0.045s
I20260709 12:22:41.934331 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:41.929142 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45143.5us
I20260709 12:22:41.881134  1541 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.087834  1541 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:42.090092  1541 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:41.884230  1633 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:41.974375 31492 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:42.039776  1749 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:22:42.038470  1748 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
W20260709 12:22:42.090157  1706 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.836s	user 0.005s	sys 0.002s
I20260709 12:22:42.097065 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1316) took 2082 ms. Trace:
I20260709 12:22:42.102622 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.110571 31423 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 3: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:42.040582  1744 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.364s	user 0.000s	sys 0.000s
I20260709 12:22:42.128494 31415 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:41.975018  1753 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:42.107156 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.122864 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1423) took 1183 ms. Trace:
I20260709 12:22:42.204708 31423 rpcz_store.cc:276] 0709 12:22:40.938930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.809933 (+871003us) service_pool.cc:224] Handling call
0709 12:22:42.122787 (+312854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36992}
I20260709 12:22:42.110123 31495 rpcz_store.cc:276] 0709 12:22:40.014546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.872413 (+857867us) service_pool.cc:224] Handling call
0709 12:22:40.872801 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.882652 (+  9851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.882695 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.896564 (+ 13869us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.705442 (+808878us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:41.705499 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.705577 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.096738 (+391161us) raft_consensus.cc:1685] finished
0709 12:22:42.096775 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.096989 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9329,"raft.queue_time_us":9443,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12995,"thread_start_us":787546,"threads_started":1,"wal-append.queue_time_us":875821}
I20260709 12:22:41.928982  1662 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:41.981499  1694 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:42.102633 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.099715  1761 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.145961  1650 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.003s
W20260709 12:22:42.090638  1552 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.002s
I20260709 12:22:42.251472  1650 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.251647  1552 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.252770 32109 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.253723  1552 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.253605  1761 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:42.098379  1593 consensus_meta.cc:287] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.002s
W20260709 12:22:42.091497  1746 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:22:42.255016  1593 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.256187 31419 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:42.259884  1593 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.090966  1633 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:42.239769 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.262440  1633 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.263621 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:42.265303  1761 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:42.263732  1650 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:42.106783 32113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.033s
I20260709 12:22:42.242079 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.242655 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.247025 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:42.092825  1678 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.273787 32112 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:42.274482 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:42.274489 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:42.275784  1678 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.129253  1665 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.276894  1665 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.130941  1706 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:42.274523 32113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.003s	sys 0.033s
I20260709 12:22:42.280686  1706 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:42.281543 31574 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:42.283792 32110 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:42.285533  1665 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.224685  1694 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.092911  1738 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.288079  1694 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.289651  1738 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:42.296942 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1370) took 1405 ms. Trace:
I20260709 12:22:42.297412 31570 rpcz_store.cc:276] 0709 12:22:40.891471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.891602 (+   131us) service_pool.cc:224] Handling call
0709 12:22:40.891844 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:41.284861 (+393017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.296717 (+1011856us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400273154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:42.296883 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885678848}
I20260709 12:22:42.300565 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2485) took 4023 ms. Trace:
I20260709 12:22:42.301028 31422 rpcz_store.cc:276] 0709 12:22:38.277599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.762812 (+1485213us) service_pool.cc:224] Handling call
0709 12:22:39.802553 (+ 39741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.720780 (+918227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.300240 (+1579460us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54003edd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:42.300482 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110182144}
I20260709 12:22:42.302596 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.303692 31422 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:22:42.305261 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.347767 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1424) took 1408 ms. Trace:
I20260709 12:22:42.334144  1700 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:42.343806 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.345021 31540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.012s	sys 0.012s
I20260709 12:22:42.354185 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2500) took 1628 ms. Trace:
I20260709 12:22:42.240965 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.355384 31423 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:42.355990 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1429) took 1276 ms. Trace:
I20260709 12:22:42.356380 31423 rpcz_store.cc:276] 0709 12:22:41.079683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.221608 (+1141925us) service_pool.cc:224] Handling call
0709 12:22:42.355922 (+134314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.306115 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1369) took 1420 ms. Trace:
I20260709 12:22:42.357535 31568 rpcz_store.cc:276] 0709 12:22:40.885340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.885539 (+   199us) service_pool.cc:224] Handling call
0709 12:22:42.305946 (+1420407us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540023fd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.306057 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789713152}
I20260709 12:22:42.348433 31420 rpcz_store.cc:276] 0709 12:22:40.939171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.305046 (+1365875us) service_pool.cc:224] Handling call
0709 12:22:42.347675 (+ 42629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.360924 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.220345 31499 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 3.
I20260709 12:22:42.361716 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1332) took 1109 ms. Trace:
I20260709 12:22:42.362198 31420 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:42.362102 31499 rpcz_store.cc:276] 0709 12:22:41.252293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.984704 (+732411us) service_pool.cc:224] Handling call
0709 12:22:42.361639 (+376935us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:42.360172 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.365005 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.366024 31494 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:42.354431 31540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.013s	sys 0.012s
W20260709 12:22:42.368330 31540 connection.cc:256] RPC call timeout handler was delayed by -1.2851567419997991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.286s for a response
W20260709 12:22:42.368871 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0874224770000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:22:42.369319 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0793224770000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:22:42.369774 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0523224769999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 12:22:42.353650  1700 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:42.371917  1700 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.375808 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2501) took 1649 ms. Trace:
I20260709 12:22:42.376201 31420 rpcz_store.cc:276] 0709 12:22:40.726203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.360727 (+1634524us) service_pool.cc:224] Handling call
0709 12:22:42.375744 (+ 15017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.377205 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.377632  1684 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.377902 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1428) took 1298 ms. Trace:
I20260709 12:22:42.378290 31420 rpcz_store.cc:276] 0709 12:22:41.079391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.376920 (+1297529us) service_pool.cc:224] Handling call
0709 12:22:42.377855 (+   935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.379137 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.379769 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2506) took 1648 ms. Trace:
I20260709 12:22:42.380074 31420 rpcz_store.cc:276] 0709 12:22:40.730998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.378869 (+1647871us) service_pool.cc:224] Handling call
0709 12:22:42.379714 (+   845us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:42.345362 32105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.002s	sys 0.022s
W20260709 12:22:42.405797 31465 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.018s	sys 0.034s
W20260709 12:22:42.406345 31465 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.018s	sys 0.034s
W20260709 12:22:42.406783 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 647982us
I20260709 12:22:42.407336 31568 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:22:42.409164 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.409441 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.383091 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.410959 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.410983 31423 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:42.411530 31417 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:42.410058 31570 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:42.412185 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2499) took 1686 ms. Trace:
I20260709 12:22:42.359020  1678 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.415076 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:42.412639 31423 rpcz_store.cc:276] 0709 12:22:40.725616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.357284 (+1631668us) service_pool.cc:224] Handling call
0709 12:22:42.412114 (+ 54830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.416074 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.416757 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.361788 31422 rpcz_store.cc:276] 0709 12:22:40.725898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.302159 (+1576261us) service_pool.cc:224] Handling call
0709 12:22:42.354108 (+ 51949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.417527 31423 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:42.346572  1633 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:42.410701 32105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.002s	sys 0.023s
I20260709 12:22:42.419430 31496 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.412199 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2512) took 1647 ms. Trace:
I20260709 12:22:42.414971 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.425593 31417 rpcz_store.cc:276] 0709 12:22:40.764518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.382625 (+1618107us) service_pool.cc:224] Handling call
0709 12:22:42.412148 (+ 29523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.359762  1753 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.422053 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.422515 31420 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:42.418150 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.425930 31565 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
W20260709 12:22:42.426801 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.048s	sys 0.100s
I20260709 12:22:42.427009 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.430130 31573 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 3.
I20260709 12:22:42.427949 31569 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:42.430425 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.430553 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.431236 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.431576 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2502) took 1705 ms. Trace:
I20260709 12:22:42.432097 31423 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:42.430997 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.048s	sys 0.100s
I20260709 12:22:42.432041 31420 rpcz_store.cc:276] 0709 12:22:40.726489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.380755 (+1654266us) service_pool.cc:224] Handling call
0709 12:22:42.431521 (+ 50766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.411394  1679 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.431614 31568 raft_consensus.cc:2410] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:42.433557 31422 raft_consensus.cc:2410] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:42.432327 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.415122  1566 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.439234 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2510) took 1675 ms. Trace:
I20260709 12:22:42.437431 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1430) took 1357 ms. Trace:
I20260709 12:22:42.439460 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.440598 31565 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:42.439651 31423 rpcz_store.cc:276] 0709 12:22:40.763951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.418327 (+1654376us) service_pool.cc:224] Handling call
0709 12:22:42.439172 (+ 20845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.440686 31568 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:42.441581 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.439503 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.442236 31565 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:42.442588 31417 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:42.441510 31422 rpcz_store.cc:276] 0709 12:22:41.079909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.417943 (+1338034us) service_pool.cc:224] Handling call
0709 12:22:42.436789 (+ 18846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.443048 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2514) took 1678 ms. Trace:
I20260709 12:22:42.443506 31417 rpcz_store.cc:276] 0709 12:22:40.765041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.426331 (+1661290us) service_pool.cc:224] Handling call
0709 12:22:42.442999 (+ 16668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.447427 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.448904 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.449419 31568 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.449985 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.450474 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.451725 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:42.451108 31573 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:42.452467 31569 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:42.453349 31565 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:42.453348 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.456319 31423 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:22:42.457064 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2511) took 1692 ms. Trace:
I20260709 12:22:42.457371 31423 rpcz_store.cc:276] 0709 12:22:40.764246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.441207 (+1676961us) service_pool.cc:224] Handling call
0709 12:22:42.456078 (+ 14871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.456801 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.457009 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.458204 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:42.458845 31494 raft_consensus.cc:2410] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:42.448851  1762 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:42.420369  1678 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.461752 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:42.465945 31423 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:42.465876 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.466817 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1433) took 1256 ms. Trace:
I20260709 12:22:42.467162 31423 rpcz_store.cc:276] 0709 12:22:41.210280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.458023 (+1247743us) service_pool.cc:224] Handling call
0709 12:22:42.465739 (+  7716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.466509 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.466770 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.468302 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:42.471131 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 207617us
I20260709 12:22:42.471941 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.472084 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:42.473227 31494 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:42.478600  1634 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:42.479274  1759 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:22:42.480521  1694 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.483084  1694 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.483822  1633 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.483938  1694 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.485793 31418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2509) took 1734 ms (client timeout 1785 ms). Trace:
I20260709 12:22:42.486052 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 621) took 1596 ms. Trace:
W20260709 12:22:42.486203 31418 rpcz_store.cc:269] 0709 12:22:40.751126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.752331 (+  1205us) service_pool.cc:224] Handling call
0709 12:22:42.485651 (+1733320us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5400148054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.485743 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70628736}
I20260709 12:22:42.487808 31418 pending_rounds.cc:85] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 5
I20260709 12:22:42.486537 32113 rpcz_store.cc:276] 0709 12:22:40.889944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.890486 (+   542us) service_pool.cc:224] Handling call
0709 12:22:40.890824 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.338001 (+447177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.338034 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.366275 (+ 28241us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.280162 (+913887us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:42.280200 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.280264 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.485806 (+205542us) raft_consensus.cc:1685] finished
0709 12:22:42.485830 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.485961 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20277,"raft.queue_time_us":24235,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":1311755,"threads_started":2,"wal-append.queue_time_us":991929}
I20260709 12:22:42.488094 31418 pending_rounds.cc:107] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:22:42.488441 31418 raft_consensus.cc:2889] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:42.444247  1679 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.491984  1675 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.492477  1675 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.494560  1675 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:42.490665 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.495060  1704 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:42.450816  1566 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:42.490096 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.495604 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.495982 31416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1410) took 1729 ms (client timeout 1641 ms). Trace:
W20260709 12:22:42.496176 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.496411 31416 rpcz_store.cc:269] 0709 12:22:40.766515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.994649 (+228134us) service_pool.cc:224] Handling call
0709 12:22:42.495811 (+1501162us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540024fc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.495922 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364666240}
I20260709 12:22:42.496770  1527 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:42.497104  1566 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.497309  1527 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.438153  1753 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.498750  1677 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.499454  1527 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.499250  1677 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.499691  1753 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.500286  1753 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:42.500820  1753 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.501261  1677 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.490250  1770 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:42.501745 31499 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.502035  1770 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:42.502241  1646 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:42.494836 31491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 446) took 3500 ms (client timeout 2011 ms). Trace:
W20260709 12:22:42.505730 31491 rpcz_store.cc:269] 0709 12:22:38.994213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.994346 (+   133us) service_pool.cc:224] Handling call
0709 12:22:40.384979 (+1390633us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:42.494628 (+2109649us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400013954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.494745 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305838080}
I20260709 12:22:42.504683 31420 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.500993 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 396) took 1700 ms. Trace:
I20260709 12:22:42.507040 31419 rpcz_store.cc:276] 0709 12:22:40.800404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.913764 (+1113360us) service_pool.cc:224] Handling call
0709 12:22:42.500811 (+587047us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5400351bd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.500937 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72683136}
I20260709 12:22:42.508571 31419 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:42.509330 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2517) took 1141 ms. Trace:
I20260709 12:22:42.509836 31419 rpcz_store.cc:276] 0709 12:22:41.368377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.507970 (+1139593us) service_pool.cc:224] Handling call
0709 12:22:42.508317 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.508971 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.509264 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.485239 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 393) took 1797 ms. Trace:
I20260709 12:22:42.485152  1694 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:42.510980 31421 rpcz_store.cc:276] 0709 12:22:40.689867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.690399 (+   532us) service_pool.cc:224] Handling call
0709 12:22:40.741177 (+ 50778us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:40.769666 (+ 28489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.769695 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:40.868954 (+ 99259us) log.cc:844] Serialized 52 byte log entry
0709 12:22:41.318508 (+449554us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:41.332367 (+ 13859us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.342029 (+  9662us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.372920 (+1030891us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b18003297a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:42.484649 (+111729us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003297a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:22:42.484836 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.484921 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.484967 (+    46us) raft_consensus.cc:1685] finished
0709 12:22:42.485030 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.485174 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52253,"prepare.queue_time_us":50060,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":1142,"raft.queue_time_us":1175825,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":113870,"spinlock_wait_cycles":77239424,"thread_start_us":398761,"threads_started":1,"wal-append.queue_time_us":665682}
W20260709 12:22:42.496034 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.516701 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:42.492744  1679 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.503670 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:42.519621 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:42.485356 31424 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2494) took 1761 ms (client timeout 1966 ms). Trace:
W20260709 12:22:42.521322 31424 rpcz_store.cc:269] 0709 12:22:40.724175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.756668 (+ 32493us) service_pool.cc:224] Handling call
0709 12:22:42.485169 (+1728501us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540010de54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.485297 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843001728}
I20260709 12:22:42.501032  1690 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:42.496176  1526 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.500249  1527 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:42.471505  1650 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:42.545182 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.538899 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.546113 31491 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:42.545835 31494 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:42.540221 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:42.548518 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.541469 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.522305 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:42.541757 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.543503 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:42.551997 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.556572 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.558211 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:42.599279 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 47386.9us
I20260709 12:22:42.601868 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.544093  1646 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:22:42.605000 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.495613  1704 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.543036  1588 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:42.606782 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.632263 31491 raft_consensus.cc:2410] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:22:42.593945  1527 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:42.594960  1675 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:42.639719 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.033s
W20260709 12:22:42.640220 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.004s	sys 0.033s
I20260709 12:22:42.642129 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.642397 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.603030  1513 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:42.556911  1743 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.643002 32109 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:42.643070 32113 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:42.653654 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.555275  1526 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.543256  1690 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.609131  1762 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.542939  1769 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:22:42.657665 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.555572  1679 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:22:42.658564  1770 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.662955 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.645080  1681 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:22:42.631232  1650 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:42.636862  1710 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.646361  1677 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:42.653918  1513 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.645453  1675 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.670457 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1315) took 2676 ms. Trace:
I20260709 12:22:42.669147  1682 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:42.686394 32109 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Advancing to term 7
I20260709 12:22:42.689916 31491 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:42.702486 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:42.709456 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:42.719158 32110 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.719230 31569 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.670490  1566 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:42.709784  1753 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.713973 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 399) took 1834 ms. Trace:
I20260709 12:22:42.715903 31498 rpcz_store.cc:276] 0709 12:22:39.993728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.860466 (+866738us) service_pool.cc:224] Handling call
0709 12:22:40.912098 (+ 51632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.919996 (+  7898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.920028 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.958178 (+ 38150us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.103914 (+1145736us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:42.103973 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.104077 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.670194 (+566117us) raft_consensus.cc:1685] finished
0709 12:22:42.670223 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.670387 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1517,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":1996,"thread_start_us":725258,"threads_started":1,"wal-append.queue_time_us":1361527}
I20260709 12:22:42.670379  1762 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:42.685212  1743 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:42.722415 31573 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:42.731161 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.742534 32112 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:42.709803  1677 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.734756 31570 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:42.707245  1694 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.733536 31422 rpcz_store.cc:276] 0709 12:22:40.879908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.443592 (+1563684us) service_pool.cc:224] Handling call
0709 12:22:42.443848 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.444051 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:42.460996 (+ 16945us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.713556 (+252560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:42.713611 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:42.713677 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.713761 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.713903 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18696,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":929,"raft.queue_time_us":524,"thread_start_us":252080,"threads_started":1}
I20260709 12:22:42.714838  1513 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:42.722144  1682 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.748939 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.722393  1566 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.753800 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.754015 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:42.756901 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.757308 32110 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:42.721822  1675 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:42.759171 31574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1371) took 1867 ms (client timeout 1976 ms). Trace:
I20260709 12:22:42.723140  1527 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:42.739794  1738 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:42.857808 31574 rpcz_store.cc:269] 0709 12:22:40.891767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.892011 (+   244us) service_pool.cc:224] Handling call
0709 12:22:42.758988 (+1866977us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002a2bd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:42.759108 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3114134912}
W20260709 12:22:42.782943 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 224804us
W20260709 12:22:42.858731 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 105007us
W20260709 12:22:42.859167 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 1.1927e+06us
I20260709 12:22:42.860972 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:42.861421 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.814185 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:42.863451 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:42.740993  1762 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:42.841914 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 285414us
I20260709 12:22:42.906314 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.748378  1677 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.859171 31491 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:42.870658 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:42.910424 32110 raft_consensus.cc:606] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:42.875798 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.883308 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:42.910883 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.884660 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:42.718598 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 190304us
W20260709 12:22:42.911768 31540 leader_election.cc:336] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.715s (SENT)
I20260709 12:22:42.913174 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:42.915544 31422 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:42.912407 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:42.916368 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.753095  1678 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:42.924037 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.860116  1566 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.918062 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:42.839110  1686 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:42.760648  1682 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.836726  1526 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.859764  1769 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.851763  1690 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.940277 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:42.916162  1753 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:42.889926  1588 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.864943  1552 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.941094 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:42.888653  1577 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:42.951166 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 407698us
I20260709 12:22:42.764163  1779 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 12:22:42.954829 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:42.991809 31422 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:42.940356 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:42.917662  1775 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:42.931368  1679 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:42.918048  1694 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:42.933668 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:42.956604 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88469.4us
I20260709 12:22:42.936691  1650 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:42.993072 32112 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:42.747076  1743 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.006048 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 717) took 2208 ms. Trace:
I20260709 12:22:43.010548  1244 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.012403 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.103828 31495 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.014077 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.104908 31494 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:43.017350 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 451) took 2657 ms. Trace:
I20260709 12:22:43.019151 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.106264 31499 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:43.107136 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.108088 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.109023 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.109452 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.109964 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.111738 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:43.113221 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:43.111776  1776 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:22:43.114559 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:43.120191  1784 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:22:43.105942 31497 rpcz_store.cc:276] 0709 12:22:40.360442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.904472 (+544030us) service_pool.cc:224] Handling call
0709 12:22:40.989359 (+ 84887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.037273 (+ 47914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.037309 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.037865 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.795062 (+757197us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:41.795128 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.795210 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.104304 (+309094us) raft_consensus.cc:1685] finished
0709 12:22:42.104322 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.017012 (+912690us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54001d1fd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:43.017272 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25388,"raft.queue_time_us":23159,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":16677,"spinlock_wait_cycles":159104768,"thread_start_us":627751,"threads_started":1,"wal-append.queue_time_us":891179,"wal-append.run_cpu_time_us":2086,"wal-append.run_wall_time_us":1122652}
I20260709 12:22:43.121224 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.122255 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.123365  1650 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:43.053086 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.125286 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.053627  1646 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.056310  1786 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.057337 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:43.057531  1710 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:43.057971  1785 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.058787 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.061056  1526 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:43.061331 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 121114us
I20260709 12:22:42.954634  1686 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.056337 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:43.068594  1761 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:43.070066  1651 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:43.142439 31424 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 4: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:43.137286 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:43.146806 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.147819 31496 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:43.103500  1244 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:43.022317 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 462) took 1631 ms. Trace:
I20260709 12:22:43.084786 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:43.159384 32110 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.086400  1657 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:43.088327 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:43.090663  1672 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.096272 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:43.096228  1679 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.093273  1775 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.967335  1753 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:42.969463  1773 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:43.127388 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 251659us
I20260709 12:22:43.129541 31419 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:43.130115 31499 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:43.128463 31497 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:43.126489  1646 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:43.132820 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 221082us
W20260709 12:22:43.173391 31540 leader_election.cc:336] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.732s (SENT)
I20260709 12:22:43.173885 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.134405 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.135175 32109 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:43.130177  1552 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:43.156133 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:43.183344 31424 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.157042 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.083835  1704 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:42.992326  1588 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.169713  1753 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.171707 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:43.172117  1761 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:43.178990 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.169330 31495 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:43.164341  1679 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.225916 31497 raft_consensus.cc:2410] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:22:43.101600 32105 rpcz_store.cc:276] 0709 12:22:40.797944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.859775 (+ 61831us) service_pool.cc:224] Handling call
0709 12:22:40.918096 (+ 58321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.195244 (+277148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.198550 (+  3306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.254736 (+ 56186us) log.cc:844] Serialized 26 byte log entry
0709 12:22:42.434969 (+1180233us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:42.444132 (+  9163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.005508 (+561376us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54007300d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:43.005576 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.005650 (+    74us) raft_consensus.cc:1685] finished
0709 12:22:43.005668 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.005968 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6278,"raft.queue_time_us":8628,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":534890240,"thread_start_us":1128264,"threads_started":1,"wal-append.queue_time_us":1053468}
I20260709 12:22:43.189898 32112 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:43.167168  1775 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.192637 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:43.145094  1541 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.221177 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:43.238499 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45928.8us
I20260709 12:22:43.182116  1657 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:43.225868 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.172680  1672 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.264127 31495 raft_consensus.cc:2410] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:43.181473 32110 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:43.191665  1790 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.223052 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:43.182910  1552 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:43.230960 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.232384 32112 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.224926 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:43.135849  1710 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.224895 31419 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:43.242041 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.261366 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.291608 32106 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEARNER]: Advancing to term 6
I20260709 12:22:43.310105 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 402) took 2072 ms. Trace:
I20260709 12:22:43.311581  1577 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:43.312260 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 175060us
I20260709 12:22:43.363098 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:43.312999  1467 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:43.316644 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2504) took 2586 ms. Trace:
I20260709 12:22:43.366581 31420 rpcz_store.cc:276] 0709 12:22:40.730363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.433093 (+1702730us) service_pool.cc:224] Handling call
0709 12:22:42.504469 (+ 71376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.514780 (+ 10311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.316348 (+801568us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b5400351bd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:43.316553 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118200576}
I20260709 12:22:43.334237 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:43.334950  1687 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:43.335323  1645 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:43.383019 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48912.6us
I20260709 12:22:43.385250 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:43.340708 31466 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.785s (SENT)
I20260709 12:22:43.386766 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:43.387847 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47177.6us
I20260709 12:22:43.343576 31500 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
W20260709 12:22:43.345605 31415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2515) took 2580 ms (client timeout 1883 ms). Trace:
W20260709 12:22:43.390488 31415 rpcz_store.cc:269] 0709 12:22:40.765333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.263488 (+498155us) service_pool.cc:224] Handling call
0709 12:22:43.345440 (+2081952us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54003ec954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:43.345541 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943963904}
I20260709 12:22:43.165977 31492 rpcz_store.cc:276] 0709 12:22:41.390844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.095282 (+704438us) service_pool.cc:224] Handling call
0709 12:22:43.021307 (+926025us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:43.021576 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.021847 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.021893 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.021955 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.022014 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.022094 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.022244 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15080832}
I20260709 12:22:43.296271 31499 raft_consensus.cc:2376] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5. Re-sending same reply.
I20260709 12:22:43.133013  1786 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.354574 31416 rpcz_store.cc:276] 0709 12:22:41.237829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.497267 (+1259438us) service_pool.cc:224] Handling call
0709 12:22:42.497618 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:42.497941 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.497965 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:42.498527 (+   562us) log.cc:844] Serialized 52 byte log entry
0709 12:22:42.858992 (+360465us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:42.967935 (+108943us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.309286 (+341351us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b180029b4e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:22:43.309527 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.309633 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.309693 (+    60us) raft_consensus.cc:1685] finished
0709 12:22:43.309815 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.310013 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164831,"prepare.queue_time_us":86535,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":344643,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":234,"spinlock_wait_cycles":76726656,"thread_start_us":334332,"threads_started":1,"wal-append.queue_time_us":492588}
W20260709 12:22:43.365146 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 103858us
I20260709 12:22:43.417145 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.418622 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.224566  1761 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:43.422778 31422 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:43.378057  1763 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.371747 31494 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:22:43.430506 31494 pending_rounds.cc:85] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 6
I20260709 12:22:43.430858 31494 pending_rounds.cc:107] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:22:43.431185 31494 raft_consensus.cc:2889] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:43.372722 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:43.366364  1467 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.376025 31495 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:43.379148 31419 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:43.140267  1785 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.291905  1471 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:43.395082  1777 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:22:43.434559 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 444657us
W20260709 12:22:43.429287  1759 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:43.376736  1687 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:43.467869 31495 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:43.404366  1635 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:43.476203 32114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.036s	sys 0.053s
W20260709 12:22:43.503746 32114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.037s	sys 0.054s
I20260709 12:22:43.504303  1662 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.504571 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 626) took 1267 ms. Trace:
I20260709 12:22:43.504729  1662 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:43.504926 32114 rpcz_store.cc:276] 0709 12:22:42.237230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.237341 (+   111us) service_pool.cc:224] Handling call
0709 12:22:42.248002 (+ 10661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.248451 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:42.531004 (+282553us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.504186 (+973182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.504276 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.504333 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.504400 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.504508 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37673,"prepare.queue_time_us":463758,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":5779,"raft.queue_time_us":84335,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6912,"spinlock_wait_cycles":84847232,"thread_start_us":1242075,"threads_started":3,"wal-append.queue_time_us":439599}
I20260709 12:22:43.507992  1672 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:43.508560  1672 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:43.509553  1654 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.509995  1654 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:43.520949 31566 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:43.523990  1785 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:43.527486  1750 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 1.613s	user 0.010s	sys 0.021s
I20260709 12:22:43.532217  1646 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:43.535346  1794 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 12:22:43.537138  1791 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.302s	user 0.000s	sys 0.000s
W20260709 12:22:43.543370  1787 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 12:22:43.556250  1786 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:43.561167  1758 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:43.566569  1783 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.595s	user 0.002s	sys 0.000s
I20260709 12:22:43.580338  1588 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.582537  1710 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.423070  1769 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.455752  1467 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.601315  1577 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.404891  1645 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.505614  1662 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.265614  1244 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.632459  1244 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.632305  1798 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:43.435138 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:43.635262 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 200229us
I20260709 12:22:43.635986 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.637042 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.637979 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:43.638788  1706 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.639176  1706 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.639520  1706 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.608034  1684 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.641417  1684 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.643093  1800 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:43.643769  1684 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.644428  1684 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:43.468580  1634 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.729760  1634 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:43.730379  1634 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.468106  1789 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:43.735216  1789 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.735761  1789 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.739107  1684 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:43.621244  1552 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.623998  1686 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:43.474555  1501 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.743460  1501 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.643834  1800 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.745011  1800 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.745498  1800 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.644737 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:43.430349  1763 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.747206  1763 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:43.747313 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102649us
I20260709 12:22:43.748420 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.749687  1798 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:43.649655  1762 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.000s
I20260709 12:22:43.654958  1706 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.672616  1743 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:43.677124  1700 consensus_meta.cc:287] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.305s	user 0.005s	sys 0.007s
I20260709 12:22:43.677254 32113 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:43.753297 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 724) took 1096 ms. Trace:
I20260709 12:22:43.753733  1552 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.753641 32113 rpcz_store.cc:276] 0709 12:22:42.657239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.657374 (+   135us) service_pool.cc:224] Handling call
0709 12:22:43.676854 (+1019480us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b54005210a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196dadc0 00007fc119766e18 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:43.753233 (+ 76379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9939200}
I20260709 12:22:43.494561  1773 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.686411 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 567) took 1020 ms. Trace:
I20260709 12:22:43.755183  1700 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.755275 31573 rpcz_store.cc:276] 0709 12:22:42.665964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.666088 (+   124us) service_pool.cc:224] Handling call
0709 12:22:42.684397 (+ 18309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.684856 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:42.863807 (+178951us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.143796 (+279989us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.144369 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.144545 (+   176us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:43.144585 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.144676 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.686161 (+541485us) raft_consensus.cc:1685] finished
0709 12:22:43.686188 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.686337 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10205,"raft.queue_time_us":23503,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":42524,"thread_start_us":196288,"threads_started":1,"wal-append.queue_time_us":773622}
W20260709 12:22:43.757169 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.757361  1700 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:43.760970 32105 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.763412  1790 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:43.765403  1684 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.702142 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1339) took 1197 ms. Trace:
I20260709 12:22:43.768016 31500 rpcz_store.cc:276] 0709 12:22:42.504350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.405861 (+901511us) service_pool.cc:224] Handling call
0709 12:22:43.406188 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.699796 (+293608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.699842 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.699919 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.699966 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.701819 (+  1853us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400024ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:43.701880 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.702051 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674643200}
I20260709 12:22:43.699074  1645 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.708403  1640 raft_consensus.cc:993] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:43.775722  1640 raft_consensus.cc:1081] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:43.593207 31497 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:43.474144  1471 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.778116  1471 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.711306  1662 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.712515  1687 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:43.783042  1687 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:43.714210 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82602.5us
I20260709 12:22:43.493971  1657 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.723405  1793 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:43.790138  1793 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.620095  1761 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.792893  1761 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.750178  1798 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:43.794498  1798 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.801959 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:43.802076 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:43.766312 32111 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.491178 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:43.813457 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 322360us
I20260709 12:22:43.814740 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:43.817543 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69233.5us
I20260709 12:22:43.818608 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.821071 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 565) took 1762 ms. Trace:
I20260709 12:22:43.705353  1654 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:43.827289 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.055s	sys 0.189s
W20260709 12:22:43.833161 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.055s	sys 0.189s
W20260709 12:22:43.824647  1675 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.766s	user 0.007s	sys 0.000s
I20260709 12:22:43.850944 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 508) took 3247 ms. Trace:
I20260709 12:22:43.853027 32111 rpcz_store.cc:276] 0709 12:22:40.603433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.603548 (+   115us) service_pool.cc:224] Handling call
0709 12:22:43.318508 (+2714960us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:43.578748 (+260240us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663ee9c 00007fc11663ea5b 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:43.766066 (+187318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.804184 (+ 38118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.850663 (+ 46479us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400520dd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:43.850870 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454859776}
W20260709 12:22:43.832710  1513 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.067s	user 0.012s	sys 0.000s
I20260709 12:22:43.842327  1541 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:43.842725  1633 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:43.869158 32106 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:43.875860 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.863245  1654 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.836438  1762 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.866534  1633 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:43.864091  1541 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:43.876631  1677 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.931s	user 0.002s	sys 0.007s
I20260709 12:22:43.859244  1790 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:22:43.911406  1706 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.933070  1803 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:43.968489  1803 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:43.860978  1675 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:43.940739  1793 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:43.951678  1650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.041s	sys 0.073s
I20260709 12:22:43.968709  1799 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:43.968946  1803 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:43.973431  1650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.041s	sys 0.073s
I20260709 12:22:43.973562  1799 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:43.963497  1633 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:43.976218  1742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.007s	sys 0.016s
I20260709 12:22:43.986359  1799 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.004158  1789 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.005221  1799 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.006982  1789 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.012249  1800 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.015224  1800 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:43.368929 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:43.410990 31415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:50108
I20260709 12:22:44.042479 31415 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.043797 31415 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:44.044021 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 674949us
I20260709 12:22:44.046111 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:44.051440 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.008s	sys 0.019s
W20260709 12:22:44.052013 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.008s	sys 0.019s
W20260709 12:22:44.052255 31390 connection.cc:256] RPC call timeout handler was delayed by -1.5203956639998069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:22:44.052783 31390 connection.cc:256] RPC call timeout handler was delayed by -1.5122338529999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 12:22:44.052910 31416 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:22:44.053213 31390 connection.cc:256] RPC call timeout handler was delayed by -1.4987956639997719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:22:44.053660 31390 connection.cc:256] RPC call timeout handler was delayed by -1.4321956639996642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:22:44.054109 31390 connection.cc:256] RPC call timeout handler was delayed by -1.3628956639995522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 12:22:44.054455 31417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.014s	sys 0.015s
W20260709 12:22:44.055008 31417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.015s	sys 0.015s
W20260709 12:22:44.055804 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.113s (SENT) [suppressed 46 similar messages]
I20260709 12:22:44.056140 31419 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:44.056367 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 400) took 3176 ms. Trace:
W20260709 12:22:44.054484 31418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.009s	sys 0.007s
W20260709 12:22:44.057394 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.057623 31418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.009s	sys 0.007s
W20260709 12:22:44.058929 31388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.008s	sys 0.019s
W20260709 12:22:44.059219 31423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.018s	sys 0.022s
W20260709 12:22:44.059329 31388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.008s	sys 0.019s
W20260709 12:22:44.059563 31423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.018s	sys 0.022s
I20260709 12:22:44.060809 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1434) took 2850 ms. Trace:
W20260709 12:22:44.061959 31421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.014s	sys 0.018s
W20260709 12:22:44.062505 31421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.015s	sys 0.018s
I20260709 12:22:44.061231 31423 rpcz_store.cc:276] 0709 12:22:41.210559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.467813 (+1257254us) service_pool.cc:224] Handling call
0709 12:22:42.506246 (+ 38433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.506426 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:42.546336 (+ 39910us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.060115 (+1513779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.060252 (+   137us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.060414 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.060552 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.060740 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117400,"prepare.queue_time_us":49060,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3944,"raft.queue_time_us":120999,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":1395768,"threads_started":2,"wal-append.queue_time_us":617954}
I20260709 12:22:44.056886 31417 rpcz_store.cc:276] 0709 12:22:40.880255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.444868 (+1564613us) service_pool.cc:224] Handling call
0709 12:22:42.456746 (+ 11878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.456948 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:22:42.638148 (+181200us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.055672 (+1417524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.055801 (+   129us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:44.055928 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.056028 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.056261 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122034,"prepare.queue_time_us":23913,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":117526,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":1458565,"threads_started":3,"wal-append.queue_time_us":990642}
W20260709 12:22:44.068359 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.068989 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.071530 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:44.072921 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:44.076015 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:44.054499 31390 connection.cc:256] RPC call timeout handler was delayed by -1.29508122299967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 12:22:44.079339 31390 connection.cc:256] RPC call timeout handler was delayed by -1.210795663999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2417s for a response
I20260709 12:22:44.079412 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:44.079845 31390 connection.cc:256] RPC call timeout handler was delayed by -1.1840181600000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 12:22:44.081107 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.082268 31417 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:44.082203 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.083920 31423 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:44.084697 31419 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:44.085608 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.086603 31417 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:44.086931 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.088174 31419 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:44.088917 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.089917 31417 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
W20260709 12:22:44.090164 31463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.044s	sys 0.031s
W20260709 12:22:44.092193 31463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.045s	sys 0.032s
I20260709 12:22:44.092597 31419 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:22:44.093032 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.093631 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.096832 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 280691us
I20260709 12:22:44.098744 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:44.099216 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.100306 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:44.108078 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.110227 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:44.111498 31493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.018s	sys 0.063s
W20260709 12:22:44.112010 31493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.019s	sys 0.063s
I20260709 12:22:44.113222 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.114204 31495 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:44.115527 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.116921 31495 raft_consensus.cc:2410] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:44.118050 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.118144 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.119299 31495 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:44.119617 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:44.120728 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.121212 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.121757 31495 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:44.122231 31500 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:43.821650 31572 rpcz_store.cc:276] 0709 12:22:42.058443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.058611 (+   168us) service_pool.cc:224] Handling call
0709 12:22:42.059025 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:42.098913 (+ 39888us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:42.452267 (+353354us) log.cc:844] Serialized 14 byte log entry
0709 12:22:42.906292 (+454025us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b180048f940. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a
0709 12:22:43.158031 (+251739us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.223825 (+ 65794us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.224108 (+   283us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.224162 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.224252 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:43.341613 (+117361us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b48001302d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:22:43.820785 (+479172us) raft_consensus.cc:1685] finished
0709 12:22:43.820816 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.820996 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456495,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":20354,"raft.queue_time_us":75933,"raft.run_cpu_time_us":2431,"raft.run_wall_time_us":389817,"spinlock_wait_cycles":31460480,"thread_start_us":762409,"threads_started":3,"wal-append.queue_time_us":292515}
I20260709 12:22:44.136206 31573 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.145027 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.135385 31571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:22:44.138469 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.129554 31565 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:44.147094 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.147359 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.147830 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.146059 31571 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.148710 31571 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.149389 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.150921 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.152302 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.148098 31572 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:44.137557 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.148098 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:44.138499 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.164250 31574 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:44.164536 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.164613 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.165177 31570 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:44.155512 31569 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.166302 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:43.869685 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:43.928740 32108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.142s	sys 0.310s
W20260709 12:22:44.169526 32108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.142s	sys 0.311s
I20260709 12:22:44.171059 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 515) took 1303 ms. Trace:
I20260709 12:22:44.171569 32108 rpcz_store.cc:276] 0709 12:22:42.867702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.116667 (+248965us) service_pool.cc:224] Handling call
0709 12:22:43.117072 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.155200 (+ 38128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.162214 (+  7014us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.170339 (+  8125us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.170367 (+1000028us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:44.170489 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.170635 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.170743 (+   108us) raft_consensus.cc:1685] finished
0709 12:22:44.170769 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.170939 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29279,"raft.queue_time_us":23861,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":17177,"thread_start_us":999350,"threads_started":1,"wal-append.queue_time_us":819850}
I20260709 12:22:44.161588 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.128595 31566 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:44.115530 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:44.163110 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.163518 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.182003 32113 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:44.183126 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67762.8us
I20260709 12:22:44.184376 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:44.184608 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.185603 31419 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:44.185652 31417 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:44.186625 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.188023 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 461) took 2807 ms. Trace:
I20260709 12:22:44.188475 31493 rpcz_store.cc:276] 0709 12:22:41.380213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.066318 (+686105us) service_pool.cc:224] Handling call
0709 12:22:42.104364 (+ 38046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.104605 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:42.153434 (+ 48829us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.027499 (+874065us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b18004a6740. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a 00007fc11976da2a
0709 12:22:44.187260 (+1159761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.187359 (+    99us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:44.187513 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.187674 (+   161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.187903 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74547,"prepare.queue_time_us":114024,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":24620672,"thread_start_us":1084740,"threads_started":1}
I20260709 12:22:44.189949 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:44.190840 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78054.1us
I20260709 12:22:43.863104  1513 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.207465  1501 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.210335 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:44.211282  1526 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.211877 31493 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:44.213171 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.216174  1541 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:44.219796  1775 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.004s
I20260709 12:22:44.221335 31493 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:44.220813  1775 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.160671 32106 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEARNER]: Advancing to term 7
W20260709 12:22:43.986653  1742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.017s
I20260709 12:22:44.224139 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:44.225015 31493 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.227440  1770 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:44.154780 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:43.955732 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.286944  1690 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.288883  1762 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.277617 31571 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.165117 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.231612 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:44.174775 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:44.298518 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.298655 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.299445 31570 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:44.299913 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.300535 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.301265 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:43.968909  1677 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:44.302095 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6482665470002758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 12:22:44.302495 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6059665470002074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 12:22:44.303866  1677 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.267122 32106 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 12:22:44.304703  1798 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.012s
W20260709 12:22:44.304944  1679 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.041s	user 0.011s	sys 0.004s
I20260709 12:22:44.273118  1665 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:44.306285  1682 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.341s	user 0.015s	sys 0.010s
I20260709 12:22:44.306751  1682 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.306506  1679 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:44.307622 31424 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.124s	user 0.009s	sys 0.009s
I20260709 12:22:44.308009 31424 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:44.308295 31492 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:44.308550 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 405) took 1210 ms. Trace:
I20260709 12:22:44.308995  1682 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:44.309473  1753 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.074s	user 0.012s	sys 0.003s
I20260709 12:22:44.310009  1753 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.313591  1753 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.315737 31500 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.316636 31496 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:44.317444  1738 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.430s	user 0.034s	sys 0.001s
I20260709 12:22:44.318113  1738 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.319794  1806 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:44.320106  1805 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:44.321391  1807 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:44.321983  1807 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.322315  1807 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.324532  1679 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:44.326442  1662 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.545s	user 0.000s	sys 0.016s
I20260709 12:22:44.327050  1808 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.328014  1808 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.327677 31415 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.329381  1809 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.330277  1809 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.330397  1244 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.330770  1809 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.331182  1809 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.332513 31415 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.333137 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50108 (request call id 403) took 1236 ms. Trace:
I20260709 12:22:44.333433 31415 rpcz_store.cc:276] 0709 12:22:43.097753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.391685 (+293932us) service_pool.cc:224] Handling call
0709 12:22:44.332923 (+941238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.308925 31424 rpcz_store.cc:276] 0709 12:22:43.098321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.155867 (+ 57546us) service_pool.cc:224] Handling call
0709 12:22:44.308443 (+1152576us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:44.334954 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 125588us
I20260709 12:22:44.273906  1672 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.274237  1578 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:44.275442 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 68569.8us
I20260709 12:22:44.302548 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.279920 31569 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:44.281093  1800 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:44.282656  1467 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.003s
I20260709 12:22:44.283236  1742 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:44.283594  1566 consensus_meta.cc:287] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.327s	user 0.012s	sys 0.008s
W20260709 12:22:44.361058  1552 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.607s	user 0.016s	sys 0.008s
I20260709 12:22:44.361130  1566 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.363088 31491 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:44.364240  1566 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:44.284051 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.292856 31571 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.366287 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.296396  1775 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.297053 31498 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:44.301338 31570 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:44.236045  1675 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.270645  1643 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:44.305047 32106 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 4
I20260709 12:22:44.271890  1645 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:44.211877  1526 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.277168 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.243103  1593 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:44.346973 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 115507us
I20260709 12:22:44.347826  1588 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.347380  1742 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.348768  1578 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:44.350086 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:44.350943 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.351689  1637 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:44.353808  1513 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:44.353832  1684 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.584s	user 0.014s	sys 0.000s
I20260709 12:22:44.354586 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:44.357136  1634 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.010s
I20260709 12:22:44.360136  1533 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:43.802733  1703 consensus_queue.cc:1175] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8553a13b444649b9a19e5488aabaf1c5" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:22:44.360464 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71905.3us
I20260709 12:22:44.427488  1533 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:44.374408  1467 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.428905  1533 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.379544  1526 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.431458  1501 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:44.370342 31571 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.373286 32106 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:22:44.434289 32106 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:44.368292  1798 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.377207 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:44.435580 31565 raft_consensus.cc:2410] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:44.378263 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.436353 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.376325 31574 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:44.436798  1798 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.437582 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.438305 31574 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:44.438794  1742 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.439328 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.440361 31574 raft_consensus.cc:2410] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:44.437603 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.442489  1467 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.444798 31571 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:44.446923 31574 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:44.448282 31574 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:22:44.448997  1471 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.670s	user 0.003s	sys 0.012s
I20260709 12:22:44.449580  1471 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.451457 31574 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:44.418340 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45098.7us
W20260709 12:22:44.454133 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78903.4us
I20260709 12:22:44.328718  1808 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.422940 31572 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:44.423658  1578 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.423959  1684 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.424834 32108 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.425338  1637 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.426578  1634 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.430069 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:44.369062 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:44.478971 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 401) took 3244 ms. Trace:
W20260709 12:22:44.455634 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 118435us
I20260709 12:22:44.367882  1672 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:44.481979 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 178929us
I20260709 12:22:44.358428  1803 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.453302  1633 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.473017 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:44.474205  1577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.017s	sys 0.029s
I20260709 12:22:44.475824  1513 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:44.474896  1678 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:22:44.505638 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:44.506855 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 91125.5us
I20260709 12:22:44.482909 32108 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:44.509514 31499 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:44.496316  1577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.017s	sys 0.029s
W20260709 12:22:44.509301 31465 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.727s (SENT)
W20260709 12:22:44.512427  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.002s	sys 0.005s
I20260709 12:22:44.498802  1513 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.479643 31418 rpcz_store.cc:276] 0709 12:22:41.231299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.487270 (+1255971us) service_pool.cc:224] Handling call
0709 12:22:42.487609 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:42.543331 (+ 55722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:42.543361 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:42.543916 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 12:22:42.813797 (+269881us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:42.864827 (+ 51030us) log.cc:844] Serialized 14 byte log entry
0709 12:22:43.041109 (+176282us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b1800383d40. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:22:44.375980 (+1334871us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.474917 (+ 98937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.475015 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.475149 (+   134us) raft_consensus.cc:1685] finished
0709 12:22:44.475163 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.475309 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72481,"prepare.queue_time_us":74368,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":7060,"raft.queue_time_us":248115,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":49265,"spinlock_wait_cycles":42533248,"thread_start_us":1536718,"threads_started":3,"wal-append.queue_time_us":387552}
W20260709 12:22:44.526579 31540 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.731s (SENT)
W20260709 12:22:44.526125  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.002s	sys 0.006s
I20260709 12:22:44.530893 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:44.527889 31493 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:44.497725  1806 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:44.486656  1805 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:44.536381 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106406us
I20260709 12:22:44.533023  1675 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:44.538254 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5204665470000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:22:44.538756 31540 connection.cc:256] RPC call timeout handler was delayed by -1.4709665469999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:22:44.539150 31540 connection.cc:256] RPC call timeout handler was delayed by -1.407966547000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 12:22:44.539527 31540 connection.cc:256] RPC call timeout handler was delayed by -1.346766547000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 12:22:44.540750 32106 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEARNER]: Advancing to term 8
I20260709 12:22:44.531788  1513 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:44.547425 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44373us
I20260709 12:22:44.526176  1786 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:44.508922  1467 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:44.536219  1541 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.526782  1526 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.555994 31568 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:44.551853 31466 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.005s	sys 0.017s
I20260709 12:22:44.538269  1675 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:44.555374 31540 connection.cc:256] RPC call timeout handler was delayed by -1.2864665470001455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 12:22:44.561539 31540 connection.cc:256] RPC call timeout handler was delayed by -1.2810665470001368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 12:22:44.561895 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1307665470003485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 12:22:44.562204 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0137665470001593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2501s for a response
W20260709 12:22:44.562740 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.565333 31466 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.005s	sys 0.017s
W20260709 12:22:44.567541 31465 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.845s (SENT)
W20260709 12:22:44.553819  1761 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.013s
I20260709 12:22:44.573701 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:44.572366 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:44.568672 31494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.003s	sys 0.007s
I20260709 12:22:44.562892  1675 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:44.580376 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 72560.5us
I20260709 12:22:44.583737 31420 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:44.583891 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:44.579939 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 1.18791e+06us
I20260709 12:22:44.584625  1232 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 12:22:44.586958  1687 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.004s
I20260709 12:22:44.587015  1806 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.587908  1812 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.590345 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:44.587859 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.595947 31494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.003s	sys 0.007s
I20260709 12:22:44.615289 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:44.618803  1687 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:44.618954 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.619809 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:44.620429 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:44.621011 31466 connection.cc:256] RPC call timeout handler was delayed by -1.6827913739998621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.257s for a response
W20260709 12:22:44.621718 31466 connection.cc:256] RPC call timeout handler was delayed by -1.459591373999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2818s for a response
W20260709 12:22:44.622090 31466 connection.cc:256] RPC call timeout handler was delayed by -1.4478913739999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2831s for a response
I20260709 12:22:44.571617  1541 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.621078 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:44.622443 31466 connection.cc:256] RPC call timeout handler was delayed by -1.3677913739998075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.292s for a response
I20260709 12:22:44.618671 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:44.596060  1471 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.631357 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.633548 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:44.639086 32106 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:44.642128 31415 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:44.595927  1808 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:44.648409 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.653290 31417 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:44.647658 31418 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:44.661249 31493 raft_consensus.cc:2410] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:44.619058  1672 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.629174 32107 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:44.679613 31466 connection.cc:256] RPC call timeout handler was delayed by -1.02939137400017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3296s for a response
W20260709 12:22:44.683866 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.577395  1786 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.601693 32108 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.644915  1700 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:44.689463 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 128040us
I20260709 12:22:44.688913 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1438) took 1804 ms. Trace:
I20260709 12:22:44.712657 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.715618 31421 rpcz_store.cc:276] 0709 12:22:42.884834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.885340 (+   506us) service_pool.cc:224] Handling call
0709 12:22:42.915977 (+ 30637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.063467 (+1147490us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:44.383187 (+319720us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.687281 (+304094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.687337 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.688525 (+  1188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.688644 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.688842 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164206,"prepare.queue_time_us":431999,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3502,"raft.queue_time_us":169981,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9027,"thread_start_us":1505446,"threads_started":3}
W20260709 12:22:44.693033  1635 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.978s	user 0.007s	sys 0.007s
I20260709 12:22:44.717638  1635 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.717943 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.718397  1635 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:44.719630  1635 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:44.720590  1635 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:44.720762  1501 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.720947  1635 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:44.721222  1501 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:44.722173  1501 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.723762 32108 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.723956  1501 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:44.726876  1743 consensus_queue.cc:1175] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:22:44.728329  1662 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:44.728549 31422 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1441) took 1842 ms (client timeout 1858 ms). Trace:
I20260709 12:22:44.728758  1662 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:44.729833  1662 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.698788 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.699016  1637 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.699117  1785 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:44.751132  1662 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.751720  1785 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:44.685660  1763 consensus_meta.cc:287] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.021s
I20260709 12:22:44.753751  1763 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.699354 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.755335 31567 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:44.701036 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 469) took 1575 ms. Trace:
I20260709 12:22:44.756158 31494 rpcz_store.cc:276] 0709 12:22:43.125857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.461788 (+335931us) service_pool.cc:224] Handling call
0709 12:22:43.462206 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.462598 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.462635 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.463198 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.689067 (+1225869us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:44.700397 (+ 11330us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.700631 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.700704 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.700748 (+    44us) raft_consensus.cc:1685] finished
0709 12:22:44.700761 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.700959 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9286,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":55542,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"thread_start_us":881171,"threads_started":1,"wal-append.queue_time_us":855647}
I20260709 12:22:44.689105  1687 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:44.701548 31491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1329) took 2275 ms (client timeout 2073 ms). Trace:
I20260709 12:22:44.701855 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:44.706184  1786 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.707046 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.707911 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.707825  1807 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.685425  1526 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.584666  1805 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.767325  1700 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.733623 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:44.770514 32113 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.773058  1807 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.733976 31418 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.773907 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 578) took 1329 ms. Trace:
I20260709 12:22:44.735782 31493 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:44.774271 31567 rpcz_store.cc:276] 0709 12:22:43.444800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.445098 (+   298us) service_pool.cc:224] Handling call
0709 12:22:43.496681 (+ 51583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.755775 (+1259094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.773631 (+ 17856us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001ce154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:44.773831 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893826944}
W20260709 12:22:44.728965 31422 rpcz_store.cc:269] 0709 12:22:42.885695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.095914 (+210219us) service_pool.cc:224] Handling call
0709 12:22:44.718640 (+1622726us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540010ca54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:44.728390 (+  9750us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600089984}
I20260709 12:22:44.736929  1809 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:44.775620 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 87760.8us
I20260709 12:22:44.776302  1798 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:44.776906  1798 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:44.777179 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:44.777480  1809 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.740411  1679 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:44.778260  1799 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:44.778445  1679 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:44.697381 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.779706 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:44.779559  1679 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.741401  1690 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:44.657615  1541 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.774636 32105 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:44.780261 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82978.4us
W20260709 12:22:44.748885 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.759212 31491 rpcz_store.cc:269] 0709 12:22:42.425841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.910629 (+484788us) service_pool.cc:224] Handling call
0709 12:22:44.701291 (+1790662us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003b9f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:44.701467 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3337416448}
I20260709 12:22:44.777932  1798 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.758466  1687 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.787454 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.792979 31495 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:44.782229  1742 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.783334  1690 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.796073 31419 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:44.803975 32114 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:44.807129 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:44.808033 31493 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:44.798557 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.809458 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.812994  1657 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.813163 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.815925  1687 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.816416  1703 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:22:44.817801 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.806623  1700 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.805317  1513 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.819199  1657 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:44.829411 32114 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:44.826160 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.832964 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:44.837567 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:44.840274 31424 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:44.840716 32112 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:44.842927 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.833653  1657 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:44.850215 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.017s	sys 0.025s
I20260709 12:22:44.845860  1742 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.835808  1687 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.856340 31570 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:44.834080  1679 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:44.857182 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.018s	sys 0.025s
I20260709 12:22:44.836555 32107 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.821130  1635 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.856335  1763 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.865633 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:44.865397 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:44.869863 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 69947.8us
I20260709 12:22:44.883885 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1380) took 1043 ms. Trace:
I20260709 12:22:44.884291 31568 rpcz_store.cc:276] 0709 12:22:43.840774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.841023 (+   249us) service_pool.cc:224] Handling call
0709 12:22:43.841463 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.573605 (+732142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.872493 (+298888us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54002a1cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:44.883833 (+ 11340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501747968}
I20260709 12:22:44.871380  1541 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:44.873785  1703 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:22:44.894081  1785 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.897302 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1335) took 2443 ms. Trace:
I20260709 12:22:44.897990  1516 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:44.897740 31496 rpcz_store.cc:276] 0709 12:22:42.453910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.200820 (+746910us) service_pool.cc:224] Handling call
0709 12:22:44.897078 (+1696258us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400362754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:44.897222 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476819712}
W20260709 12:22:44.908046 31389 leader_election.cc:336] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 3.068s (SENT)
I20260709 12:22:44.912622 32109 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:44.913021 32109 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:44.914541  1690 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.915935  1684 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:44.917156 31498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1350) took 2425 ms (client timeout 2098 ms). Trace:
I20260709 12:22:44.917456 32107 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:22:44.917572 31498 rpcz_store.cc:269] 0709 12:22:42.491878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.103029 (+611151us) service_pool.cc:224] Handling call
0709 12:22:44.916939 (+1813910us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000244d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:44.917094 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661917952}
I20260709 12:22:44.918296  1690 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.922034 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 408) took 1686 ms. Trace:
I20260709 12:22:44.923269 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2519) took 2037 ms. Trace:
W20260709 12:22:44.923584 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48450us
I20260709 12:22:44.923771 31420 rpcz_store.cc:276] 0709 12:22:42.885994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.367854 (+481860us) service_pool.cc:224] Handling call
0709 12:22:43.407006 (+ 39152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.584282 (+1177276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.922905 (+338623us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400352ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:44.923199 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673313536}
I20260709 12:22:44.924432 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.926625  1637 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.927013  1637 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.927337  1637 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.928694  1541 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:44.929582  1633 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.930928  1682 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:44.932488  1682 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:44.932977  1682 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:44.935112  1513 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:44.939069 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 749287us
I20260709 12:22:44.939849 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:44.941179 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.942631  1690 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.943506  1690 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:44.944769 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:44.945684  1690 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:44.946082 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:44.946833  1690 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:44.947243  1690 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.947618  1690 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.947842 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:44.947947  1675 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.948863  1805 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:44.949254  1805 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.949584  1805 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.950256  1675 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.930245  1633 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:44.947728 31568 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:44.956772 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 132282us
I20260709 12:22:44.958287  1687 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:44.958967  1687 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.922523 31416 rpcz_store.cc:276] 0709 12:22:43.236146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.416073 (+179927us) service_pool.cc:224] Handling call
0709 12:22:43.416377 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.053784 (+637407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.921650 (+867866us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54004493d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:44.921958 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461669760}
I20260709 12:22:44.934077  1682 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.960057  1803 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.960829  1682 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.961338  1687 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.963761  1811 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:44.964179  1811 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:44.965116  1811 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.931109 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.967995 31568 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:44.970026  1552 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:22:44.961421 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.977494 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:44.976215  1633 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:44.984521 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 53502us
W20260709 12:22:44.987624 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.987886  1513 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:44.988770  1513 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:44.989120  1513 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:44.992643  1513 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.993914  1513 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.994928 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.995044  1637 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:44.996924  1578 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:44.997488  1637 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:44.982270  1675 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:44.997570  1578 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:44.998319  1675 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.998762  1675 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.998787  1633 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.001143  1633 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:45.001338  1578 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:44.995065 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:45.005815  1578 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:45.006417  1578 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.983675  1811 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.992976 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:44.984925  1742 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.006867  1687 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:45.010413 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.008164  1679 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:45.015259  1533 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.007797  1578 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.016376  1687 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.037684  1687 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.043486  1635 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.018827 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:45.019547  1232 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.020228  1634 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:45.021034 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:45.022779 32109 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.024539  1805 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.026038  1678 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:45.020251  1657 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:45.029191 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.996377 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.074743 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:45.030447 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.047227 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:45.048136 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.051721 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.052116 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:45.054615  1552 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:45.056224 32109 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.052170  1743 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.062937  1690 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.047891  1232 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:45.054478 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:45.012454  1700 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:45.051005 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61805.3us
I20260709 12:22:45.072883  1678 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:45.077078  1467 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.100308 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.077348 32113 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.100672 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:45.077948 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67071.9us
I20260709 12:22:45.101399 31493 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.101146  1678 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.101805 31498 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:45.102028 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.078415  1634 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.102926 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.103595 31496 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.105268 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:45.085170 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.086323 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 65394.1us
I20260709 12:22:45.088207  1700 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:45.095077  1703 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:45.073045 32108 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:45.099107  1516 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:45.099761 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:45.100088  1633 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.100906 31497 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.102355  1678 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.079018  1657 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.106647 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:45.099146 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.108341 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:45.100762  1467 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.123961  1467 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.117552  1633 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.126998  1633 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.129045  1770 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:45.129419  1770 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:45.130270  1770 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.131825  1770 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.132483  1798 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:45.133348  1798 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:45.133659  1798 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:45.118865 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.135128 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.135519 31498 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.136039  1805 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.137706 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:45.138422 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.138664  1637 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.139060  1637 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.139385  1637 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.139523  1803 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:45.139981  1803 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.140334  1803 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:45.129956  1686 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.096506  1232 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.141409  1679 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:45.142146 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:45.142686  1679 consensus_queue.cc:1243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:45.140830  1686 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.143357  1679 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:45.143759  1686 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.143883  1679 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:45.134466  1798 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.145476  1679 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:45.146220  1798 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.146710  1679 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.147408 31499 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:45.151501 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.115101 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.108862  1700 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.152271 31499 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.066602  1687 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.141506  1232 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.120628 31495 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:45.141556  1501 consensus_queue.cc:1175] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:22:45.120800 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.107460  1811 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:45.155925  1811 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.117187  1703 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:45.160652  1703 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.115445  1742 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.115692  1800 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.135901  1761 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:45.151645 31492 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:22:45.171151 31492 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:22:45.176901 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.177992 31498 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.126574 31496 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
W20260709 12:22:45.186926 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47703.8us
I20260709 12:22:45.114336 31493 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:45.112125 32109 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:22:45.221210 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 115998us
I20260709 12:22:45.171504 31492 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:45.228503 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:45.229512 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.230275 31496 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:45.222790  1812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:22:45.236639 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.241935 32109 raft_consensus.cc:2368] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:45.235219 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:45.116811  1675 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.262882 32113 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:45.227142  1785 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.226200  1811 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:45.271766 32112 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:45.234365  1687 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.227070  1552 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.283442 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.283310  1552 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.284622 31537 leader_election.cc:400] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:45.284950 31537 leader_election.cc:403] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.285555  1684 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.265663 31322 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.275753 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.287097 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.239154  1690 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.241513  1800 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:22:45.239971  1657 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.288395 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:45.289036 31540 leader_election.cc:400] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
I20260709 12:22:45.305302  1807 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:45.322022  1807 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:45.322080 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 51519us
I20260709 12:22:45.322585 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.294442 31322 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 5, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.266094 31416 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:45.259171 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.315335 32106 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:45.332376 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:45.282454  1743 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:45.354718 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 66373.9us
I20260709 12:22:45.355818 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:45.333763 32110 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:45.360570 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:45.292261 32107 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:22:45.322984 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.292014  1742 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.363960 31497 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:45.375571 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:45.377087 31322 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 6, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.309564  1684 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:45.276212  1785 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.380736 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:45.328491  1675 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.376394  1635 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.432758  1635 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.436969  1634 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:45.438318 31322 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:22:45.442243 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.403666 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:45.405480 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.377261  1643 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.389860  1800 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:45.415128  1682 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.419438  1467 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.465538  1467 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:45.466509 31424 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.469022  1662 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.469458  1662 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:45.470542  1662 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.472565  1800 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.473193  1800 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.366830  1805 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.323105  1807 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.379518  1687 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:45.422933 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 100041us
I20260709 12:22:45.478533 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.386950  1806 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.479758  1806 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:45.480201 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.480698  1806 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.481673  1634 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:45.483393  1662 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.430909  1686 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.485435  1785 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.331498  1809 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:22:45.344267  1657 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.422159  1578 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:45.452471 31319 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 186) took 21040 ms (client timeout 15000 ms). Trace:
I20260709 12:22:45.455055  1643 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:45.456247 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52694.6us
I20260709 12:22:45.456694  1552 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.504308 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.506158  1643 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:45.474368  1637 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.507140  1686 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:45.510135 31499 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.512028 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.512715 31499 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.514874  1637 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.516360 31500 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:45.517588  1635 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:45.517715 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:45.459921 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:45.423449  1513 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.483126  1684 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.482493  1634 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:45.424467  1803 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:45.489485 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.497748 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.501737 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:45.502164  1809 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:45.502777  1633 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:45.512823 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.537017 31570 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:45.530965 31322 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 5, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.538388 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.538431  1633 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.539161  1803 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.539300  1809 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:45.540081 31497 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.540879  1513 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:45.540117 31322 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 4, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.541458 31491 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.541867  1513 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.540438  1809 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.512729  1643 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.544205  1809 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:45.547438 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.518489 31500 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:45.549122 31500 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:45.549865 31491 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:45.550313 31500 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:45.539323  1770 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.551244  1770 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.551589  1770 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.551911 31494 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.554322  1578 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.506330  1700 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:45.492666 31319 rpcz_store.cc:269] 0709 12:22:24.080089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.080460 (+   371us) service_pool.cc:224] Handling call
0709 12:22:45.118174 (+21037714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:35.823168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:35.824082 (+   914us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:35.824154 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:22:35.824184 (+    30us) tablet.cc:662] Decoding operations
0709 12:22:35.828750 (+  4566us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:35.828831 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:35.828864 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:35.875270 (+ 46406us) tablet.cc:701] Row locks acquired
0709 12:22:35.893633 (+ 18363us) write_op.cc:260] PREPARE: finished
0709 12:22:35.893829 (+   196us) write_op.cc:270] Start()
0709 12:22:35.894138 (+   309us) write_op.cc:276] Timestamp: P: 1783599755893760 usec, L: 0
0709 12:22:35.894168 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:22:35.895035 (+   867us) log.cc:844] Serialized 3306 byte log entry
0709 12:22:37.519068 (+1624033us) op_driver.cc:464] REPLICATION: finished
0709 12:22:38.510245 (+991177us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18002a8140. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:38.544912 (+ 34667us) write_op.cc:301] APPLY: starting
0709 12:22:38.545030 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:38.545326 (+   296us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:38.545361 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:38.666319 (+120958us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:38.854214 (+187895us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:38.854300 (+    86us) write_op.cc:312] APPLY: finished
0709 12:22:38.854842 (+   542us) log.cc:844] Serialized 65 byte log entry
0709 12:22:40.646622 (+1791780us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b
0709 12:22:41.266641 (+620019us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:41.268620 (+  1979us) write_op.cc:454] Released schema lock
0709 12:22:41.279742 (+ 11122us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:41.337857 (+ 58115us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:41.339039 (+  1182us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10107,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":15073,"apply.run_cpu_time_us":46901,"apply.run_wall_time_us":2769854,"num_ops":8,"prepare.queue_time_us":429570,"prepare.run_cpu_time_us":22843,"prepare.run_wall_time_us":1017433,"raft.queue_time_us":377172,"raft.run_cpu_time_us":1422,"raft.run_wall_time_us":11581,"replication_time_us":1624739,"spinlock_wait_cycles":31300864,"thread_start_us":3750385,"threads_started":5,"wal-append.queue_time_us":2849801,"wal-append.run_cpu_time_us":41622,"wal-append.run_wall_time_us":3103877}]]}
I20260709 12:22:45.521642 31495 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:45.457828 32111 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:45.542207 31322 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.589576 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:45.593037 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 360087us
I20260709 12:22:45.593379 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:45.597153 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 327791us
I20260709 12:22:45.521823  1657 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.605634 31322 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 5 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:45.607204 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:45.528437  1800 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:45.597306  1805 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.612946 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.598441  1690 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.620463 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.621400 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:45.621166 31499 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:22:45.621564 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.623656 32105 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:45.624306  1578 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.624711  1578 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:45.625058  1578 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.633562  1578 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.636096  1578 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:45.637354 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.637158  1785 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:45.639398  1675 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:45.640157  1675 consensus_queue.cc:1243] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:45.617626 31494 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:45.598884  1467 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:22:45.616228  1805 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.608354  1634 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:22:45.700590 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.644104  1808 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.648280  1690 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:45.655710 31322 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.649874  1800 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.708225 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.711455 32111 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:45.712956 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:45.713479 32109 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.719059  1516 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.719301 32113 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:45.719614  1516 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.656785  1805 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.724252 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.721187 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.726869 31424 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.699352  1686 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.728487 31322 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 6, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.732218 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.733269 31423 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.701563  1232 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:45.732270 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.735177 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.744644 31422 raft_consensus.cc:2368] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:45.736093 32109 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:45.737483 32106 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:45.749943 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.755643 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.730880  1800 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:45.760037 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:45.751938 31322 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.765880 32113 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:45.740321  1761 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:45.769366 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 329075us
I20260709 12:22:45.776660 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.780884 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:45.789968 31389 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.515s (SENT)
I20260709 12:22:45.790719 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:45.759577  1635 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.792434 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.735409  1686 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.795233 31424 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.797511 31322 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 3, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.811226 31322 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.786739  1798 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.812884 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:45.821722 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183613us
I20260709 12:22:45.822149 31418 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.813575 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.806159 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.822395 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:45.822956 31422 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.823305 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:45.816817 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 336758us
I20260709 12:22:45.821120 32111 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:45.764451  1232 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.827035  1858 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.787173 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:45.829810 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:45.757117  1808 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:45.834915 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.832906 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:45.851979 31494 pending_rounds.cc:85] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:22:45.852487 31494 pending_rounds.cc:107] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:22:45.852789 31494 raft_consensus.cc:2889] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:45.857473 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:45.860224 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 70862.8us
I20260709 12:22:45.780126  1761 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.829401  1467 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.876178 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.879335 31424 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.860503 31322 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 6, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.838482  1806 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:45.772979  1690 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.881073  1684 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:22:45.891023 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.891605 31423 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:45.881556 31421 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.896518  1770 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.841208  1855 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:45.899051  1855 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:45.900189  1855 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.902171  1516 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:45.903728  1686 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.905411  1808 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.803675  1635 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.907308  1232 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.803862  1657 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:22:45.861697  1798 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:45.909386  1798 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.885807  1800 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:45.910079 31417 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:45.914150 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:45.916164 31418 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:45.912317 31421 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:45.918221 31423 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:45.920467  1761 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.922514 31571 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:45.885134 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:45.864029  1643 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:45.938257 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:45.934944 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47384.8us
W20260709 12:22:45.931914 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 166469us
I20260709 12:22:45.862246 32107 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:45.938472 31322 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 6, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.947793 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:45.950640 31493 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:45.958807 31540 leader_election.cc:400] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 3. Current term is 4.
W20260709 12:22:45.959164 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.960979 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:45.962169  1855 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:45.955780  1806 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:45.968237  1742 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:22:45.968689  1806 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:45.968739  1742 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:22:45.972118 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:45.972877 31570 raft_consensus.cc:2410] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:45.961658 31568 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:45.973658 31322 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.985800 31424 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:22:45.985731 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 202091us
I20260709 12:22:45.955246  1643 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:45.991485 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 51440.9us
I20260709 12:22:45.993402 31322 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 4, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.977164  1770 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:45.997596 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.003476 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.008435  1738 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.009491 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:46.011788  1849 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.191s	user 0.003s	sys 0.000s
I20260709 12:22:46.012950  1805 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.013343 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.015050 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.016341 31419 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:46.016759 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.017454 31567 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.018842  1467 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:46.019424 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.020474  1855 raft_consensus.cc:1064] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:45.999761  1807 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:46.023121  1807 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:46.024762  1854 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:22:46.024453  1807 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.025897  1807 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.026585  1742 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:46.028589  1742 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:46.029654  1742 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.030035  1742 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.030372  1742 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.030989  1863 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:46.031524  1863 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:46.032567  1863 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.034052  1863 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.035243  1805 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.036077 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.036660 31567 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:46.038157 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.038901 31573 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.040283 31573 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:46.040418 31498 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:46.041399 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.041697 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.041958 31492 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.042250 31567 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.043356 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.044116 31573 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.045006 31493 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:46.049773 31571 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.053059 31570 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.064432  1700 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.068989 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.069828  1859 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:46.071794  1675 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:46.071902  1859 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.074786  1859 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:46.087312 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.088042 31571 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:46.059620  1808 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:22:46.094449 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.101559 31492 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:46.105410 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:46.107913 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.109308 31570 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.113514 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.114289 31491 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.115887 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.116896 31499 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.119000 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.119405 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.120041 31496 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:46.115151 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.123498 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.123939 31571 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:46.110347  1662 consensus_meta.cc:287] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 12:22:46.106590  1874 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.112295  1805 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:46.095994  1533 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:46.131608  1643 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:46.141265 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.145365 32111 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:46.127213  1859 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.152290 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:46.157222 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.159335 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 203217us
I20260709 12:22:46.150532 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.160881 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
W20260709 12:22:46.161756 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.166934 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.132720  1874 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:46.167791 31570 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:46.169368 31496 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:46.167616 31573 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.171558 31567 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:46.187074 31491 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:46.173910 32107 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:46.175089 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.175920 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.177903 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.191340 31466 leader_election.cc:400] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:46.191771 31466 leader_election.cc:403] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:46.181185 32111 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:46.182104 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.143110  1805 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:46.183439 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.183336  1738 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.184998 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.204871 31569 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.205120 31417 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:46.205721 31566 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.159601  1859 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.212065 31570 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:46.195597 31572 raft_consensus.cc:2376] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:22:46.209563 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.111920  1855 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.221604 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:46.217437  1886 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:46.227228 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.228890 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.188305  1874 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.229619 31566 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:22:46.231963 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.219686  1578 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.223661  1859 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.219527  1657 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:46.224980  1533 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:46.242430 32107 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:22:46.244038 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.244673 31566 raft_consensus.cc:2376] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6. Re-sending same reply.
I20260709 12:22:46.246345 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.247156 31572 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:46.210085  1738 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.260174 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.260546 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.260869 31566 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.261374 31570 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.264941 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.266609 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.269254 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.269961 31565 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.272516 31566 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:46.273423 31417 raft_consensus.cc:2410] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:46.273897 31421 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:46.248967  1533 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:46.236287  1886 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.283880 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.287947 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.288702 31570 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.288487 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.287062 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.289572 31571 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:46.293411  1877 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:22:46.293299 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.293452 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.294490  1662 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.294593 31421 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.294085 31567 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.297878  1662 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:46.298949 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.303216 31421 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:46.304592 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.305125 31574 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.305292 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.303839 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.307442 31566 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.267257  1690 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.300724 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.306531 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.311354 31567 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.314522 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.314939 31419 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:46.315399  1738 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:46.315470  1662 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.316171 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.316220  1533 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.316650 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.316901 31572 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:46.317387 31567 raft_consensus.cc:2376] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:22:46.317778 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.318226 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.318802 31567 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.320569  1684 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.322882 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.323491 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.324254 31420 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:46.325482 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.327744 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.327826 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.272193  1578 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.335041 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.331935 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.336057 31424 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:46.336329 31570 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.333042 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.334439 31573 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.338811 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.340057 31416 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:46.339030 31567 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:46.344151 31419 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.345870 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:46.346789 31420 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:46.347498  1879 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:22:46.267655  1805 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.349256  1859 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.351994 31571 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:46.352113 31574 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.354943 31419 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:46.369810 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:46.371819 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 150312us
I20260709 12:22:46.372606 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:46.374219 31420 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.377197 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.377957 31424 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.381250 31565 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:46.391285 31418 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:22:46.394251 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:46.395049 31418 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.395434 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.396108 31565 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.398972 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:46.358989  1859 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:46.402640 31389 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.568s (SENT)
I20260709 12:22:46.405397 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.406924 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.408401 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:46.412243 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.412802 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.413364 31571 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.413460 31567 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.415506 31565 raft_consensus.cc:2410] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:46.412811 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.416949 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.416953 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.417186 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.417689 31566 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:46.417775 31570 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:46.418067 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.418619 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.419044 31565 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.419154 31570 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.420344 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.420778 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.420993 31423 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:46.421090 31574 raft_consensus.cc:2376] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8. Re-sending same reply.
I20260709 12:22:46.421362 31566 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:46.422075 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.422283 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.422861 31574 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.423069 31566 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.424600 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.425379 31565 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.335325  1690 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:46.427220 31389 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.686s (SENT)
I20260709 12:22:46.427806 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.415562  1657 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.413955  1643 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.401456  1896 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.455933 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.479204 31571 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.455654 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.475299 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.480332 31574 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.455631 31565 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:22:46.456744 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.484079 31565 pending_rounds.cc:85] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:22:46.484405 31565 pending_rounds.cc:107] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:22:46.484691 31565 raft_consensus.cc:2889] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:46.476840 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 76135us
I20260709 12:22:46.427906 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.424321  1853 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:46.476819 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.487381 31567 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:46.491191 31566 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:46.491988 31568 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:46.493456 31570 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:46.494354 31423 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:46.501366 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:46.503206 31574 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:46.503409 31537 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.505990  1853 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:46.506206  1785 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:46.516090 31565 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:46.517892 31569 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:46.513406  1742 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.503722  1657 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:46.519222  1700 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.536695 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.516988  1635 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.543516  1662 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:46.544344 32114 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:46.519342  1859 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 12:22:46.536645  1863 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:22:46.533046  1738 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:46.554204 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.555344 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.556250 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.567018 31491 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.567168 31495 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.567687 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:46.556600 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.558491 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.558853  1896 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.559293  1643 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:46.559393 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.560561 31500 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:46.560391 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:46.563107 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.570781 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 143573us
W20260709 12:22:46.571367 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 162985us
I20260709 12:22:46.534086  1657 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:46.575443 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:46.579674 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.582602 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.583184 31495 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.548005  1690 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:46.589658 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:46.604998 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.615005 31491 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:46.614903 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.573797  1812 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.596112 31494 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.546080  1700 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.580217  1886 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:46.578933  1635 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:46.620640 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45536.3us
I20260709 12:22:46.631522 31491 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:46.631906 31389 leader_election.cc:336] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.787s (SENT)
I20260709 12:22:46.623479 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.617874 31498 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:46.623536 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74458.8us
I20260709 12:22:46.631057 31496 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:46.631237 31500 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:46.633298 31494 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:46.506955  1853 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.645140 31497 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:46.635548  1894 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:22:46.579159  1896 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:46.648164 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.631608  1635 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:46.668255  1635 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.668761  1684 raft_consensus.cc:1064] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:46.638797  1904 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:46.669211  1684 raft_consensus.cc:1068] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Unable to promote non-voter e166c1cb41f04d55a85e6c0d7966e32e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:46.631177  1905 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:22:46.669477  1904 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:46.656675 31491 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:22:46.670324  1904 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.670943 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.671797  1905 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.673301  1662 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:46.674079  1662 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:46.675414  1874 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.676339  1662 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:46.676710  1662 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:46.691980 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:46.692953 32111 raft_consensus.cc:2410] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:46.699246 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:46.701174 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53068.6us
I20260709 12:22:46.701010 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.703214 31495 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:46.702376 31491 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.724596 32106 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:46.692062  1886 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.698169  1770 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.691349  1738 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:46.736943 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.691570  1684 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:22:46.738794 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.743091 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:46.744752  1896 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.758723 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.722366  1742 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:46.729732  1662 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.724357  1874 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:46.747191  1900 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:22:46.751416  1700 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.733428  1690 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:22:46.756795 31495 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.756742 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.773211 31568 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:46.698930  1657 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:46.771941 31465 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.650s (SENT)
I20260709 12:22:46.703290  1806 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:22:46.760670 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.765213 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:46.761278  1501 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.769199 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.769502 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:46.777726 31492 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.778115 31574 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:46.764569  1896 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:46.775890 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.761404  1643 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.768530 31415 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:22:46.699425  1467 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:22:46.787537 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:46.763252 32108 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.734356  1770 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.766373  1907 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.790625 31571 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:46.790756  1700 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:46.775255  1809 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:46.787132  1501 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:46.792740 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57251.3us
I20260709 12:22:46.793095 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.776705  1881 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:46.798586 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.790066  1662 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.805338 31495 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:46.803274 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.807464 31491 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:46.802722  1874 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:46.799566  1578 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.803169  1809 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.826391  1809 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:46.807423  1700 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:46.828413  1700 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.829787  1785 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.836323  1578 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:46.836956  1501 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:46.823662 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.840257  1501 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.840672  1501 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.841029  1501 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.814610  1874 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.842073  1874 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.840690 32114 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:46.845162  1770 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:46.836897  1578 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:46.849886  1578 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:46.793097  1643 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:46.793180  1896 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:46.866659 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:46.870464 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:46.871398 31491 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:46.850435  1578 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:46.873353 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 297995us
I20260709 12:22:46.880168 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:46.882227 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79027.1us
I20260709 12:22:46.883240 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:46.803571  1738 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:46.889159 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.884361 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147518us
I20260709 12:22:46.884418 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.895397 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.887208 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:46.867286  1684 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:46.903177 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.901240  1552 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.905861  1552 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.906237  1552 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.881135  1578 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:46.929039 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:46.964656 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 66796.9us
I20260709 12:22:46.966467 31491 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:22:46.967926 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.902791  1805 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:22:46.972923 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.931408  1924 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.983239 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:46.994596 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.964818  1919 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:47.009209 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:46.986585  1467 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.049657 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.052366 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.058364 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.061918 32108 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:46.986876  1807 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:47.050171  1881 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:47.007860  1800 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.043871  1858 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.020519  1806 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:47.073977 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.002528  1690 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:47.075135 32114 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEARNER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:47.077493 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:47.067694  1785 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.071002  1809 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.020565  1635 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.071254  1927 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:47.093873 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.069100  1874 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.103545 32107 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:47.088953  1917 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:22:47.086755  1896 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.089927  1657 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:47.172101 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 78332us
I20260709 12:22:47.096982  1578 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.080094  1858 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.106750  1785 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.180860 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:47.185406  1923 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:22:47.114492  1690 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.084578  1926 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:22:47.110517  1809 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:47.103962  1927 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:47.190573 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.199679 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.200331 31415 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:47.194316  1785 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.244946  1785 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.245532  1874 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:47.400496 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.173362  1501 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.405278 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:47.411892 32111 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:47.412752 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.407274 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.413388 31415 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:47.408236  1927 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.415764 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:47.423560 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 520447us
I20260709 12:22:47.424691 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:47.400177  1803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.084s	sys 0.142s
W20260709 12:22:47.428211 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 320657us
W20260709 12:22:47.427610 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 237107us
I20260709 12:22:47.430429 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:47.442728 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.012s
W20260709 12:22:47.489990 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.022s	sys 0.013s
W20260709 12:22:47.494493 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69911.5us
W20260709 12:22:47.496199 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:47.496546 31463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.012s	sys 0.026s
W20260709 12:22:47.497738 31463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.012s	sys 0.026s
I20260709 12:22:47.497969 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.415248  1919 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:47.488669  1803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.084s	sys 0.142s
W20260709 12:22:47.489423  1798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.031s
I20260709 12:22:47.503901 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:47.508088 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 623723us
I20260709 12:22:47.506893  1863 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.441326  1940 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.545429  1806 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:47.545837  1806 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:47.192807  1931 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:47.495777  1934 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:47.542881  1935 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:22:47.543287  1939 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:47.553122  1912 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:47.553710  1912 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:47.554770  1931 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.557027  1931 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.544281  1886 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:47.544791  1662 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.000s
I20260709 12:22:47.495616  1690 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.530095  1805 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.507296  1932 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:47.551311 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47547.8us
I20260709 12:22:47.570080 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.548677  1940 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:22:47.538398  1798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.032s
I20260709 12:22:47.526108  1809 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:47.549305  1635 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.575851 31465 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:47.561264  1800 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.561363  1886 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:47.572285  1552 consensus_meta.cc:287] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.004s
I20260709 12:22:47.579762 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:47.579913 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:47.533267  1937 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:22:47.667408  1886 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:47.678980  1930 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:22:47.554585  1934 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.681905  1934 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.599563  1944 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.578930  1803 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:22:47.667268  1926 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:22:47.682627  1944 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.677628  1858 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.677546  1919 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.684767  1944 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.678350  1501 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.675379  1552 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.691782 32106 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:47.692705  1552 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:47.695884  1886 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.707098  1809 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.708472  1886 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.572037  1805 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.574946  1806 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.712612  1806 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.713011  1805 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.554620  1912 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.578536  1657 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:47.671902  1896 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:47.726312 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 295964us
W20260709 12:22:47.727893 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 148063us
I20260709 12:22:47.672940  1932 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.731972 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:47.733928 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:47.729534  1896 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.736359  1896 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.738945  1634 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:47.739360  1634 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:47.740253  1634 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.741607  1634 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.730975  1805 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.743407  1805 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.745342  1946 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:47.745519  1805 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.745857  1946 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:47.746240  1946 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:47.727720  1926 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:47.747040  1926 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:47.747809  1926 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.749002  1926 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:47.749701 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.750907  1803 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.751449  1803 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.751989 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:47.753093 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:47.753396  1803 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:47.758867 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.759685 31415 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:47.725520  1934 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:47.674022  1800 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.672271  1945 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:22:47.772053 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:47.750862  1896 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.764599 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.765700 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:47.788178 32111 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.766433 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:47.790503  1798 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.791155 31421 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:47.791031  1798 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:47.767674 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 278573us
I20260709 12:22:47.792192 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:47.793119  1798 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:47.804963 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:47.807072 32111 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:22:47.763715 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 184003us
I20260709 12:22:47.814901 31493 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:47.763180  1501 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.768867  1944 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.817899 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:47.767283  1934 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.771008  1850 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.770839  1863 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:47.770300  1552 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.772862  1657 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.836820 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:47.837291 31492 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.840387 31491 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:47.839437 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:47.867449 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 352910us
I20260709 12:22:47.879851 31565 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:47.836776  1662 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.887547 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:47.892722 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74938.6us
I20260709 12:22:47.895083  1951 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.894373 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:47.838459  1690 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.898506  1912 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:22:47.899456  1953 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:47.841631  1924 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.838454  1934 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.834928  1798 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:47.834764  1935 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:47.903525 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 62591.4us
I20260709 12:22:47.918498 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.919015 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.919680 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.920274 31492 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:47.922856 31570 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:47.924170 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.925151 31570 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:47.928781 31570 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:47.837860  1501 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.841543  1947 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:47.935585 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.936419 31569 raft_consensus.cc:2410] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:47.904258  1690 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:47.943089 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:47.939854  1863 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:47.842128  1850 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.915432  1945 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.877935  1552 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:47.952781 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:47.901171  1662 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:47.955147 31573 raft_consensus.cc:2376] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5. Re-sending same reply.
I20260709 12:22:47.937948  1935 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:48.004657 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 251622us
I20260709 12:22:48.005861 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:47.950883  1947 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:47.937093  1937 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:47.974962  1932 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:47.973802  1952 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:47.913821  1809 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:22:48.010444 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:48.013406 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:47.916278  1951 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:47.933493  1798 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:48.005261  1933 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.833s	user 0.000s	sys 0.030s
I20260709 12:22:48.014835 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:48.029080 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:48.030857 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:47.915694  1924 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.032595 31572 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:48.012070  1904 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.019318  1657 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:48.037614  1935 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:48.019043  1944 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.027081  1952 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.019274  1896 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:48.004962  1738 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:48.057070 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.057921 31421 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 3.
I20260709 12:22:48.058872 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.059561 31415 raft_consensus.cc:2368] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
I20260709 12:22:48.060110  1513 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:48.060390 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:48.060986 31423 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.060861  1513 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.003577  1945 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.063874  1643 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.064353  1945 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.032121  1919 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.067134 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.050313 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.045363  1501 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.052687 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:48.055395  1951 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.056579  1690 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.051167  1896 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:48.046300  1944 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.067693 31415 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:48.069715 31568 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:22:48.050663  1925 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.990s	user 0.004s	sys 0.000s
I20260709 12:22:48.077605 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:48.085445 31565 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.078492 31573 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:48.079089 31423 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:48.071630  1533 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:48.079231 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:48.067022  1800 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.069178  1657 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:48.093999 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:48.082691  1896 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.087055  1944 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.062538  1946 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.052057 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:48.070477  1961 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:48.042641  1904 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.097223 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:48.060127  1952 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:48.103816 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 182080us
I20260709 12:22:48.104728 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.116166 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:48.128424 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:48.130779 31422 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:48.083451  1690 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.128124  1800 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:22:48.100570  1960 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:48.106969  1643 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:48.076171  1951 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.140944 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:48.145928 31568 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:48.141464 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 89534.9us
I20260709 12:22:48.116096  1513 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.147845 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:48.116688  1919 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:48.150489 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:48.150753 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.155551 31565 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:48.101689  1533 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.153448 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:48.090325  1863 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.169498 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:48.170547 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54495.5us
I20260709 12:22:48.175453 31495 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:48.172362 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:48.180912 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:48.147529  1643 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.189679  1886 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:22:48.153117  1960 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.192523  1952 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:48.194185  1960 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.191095 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:48.195495 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1462) took 1472 ms. Trace:
I20260709 12:22:48.196059 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:48.197321  1806 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.195880 31416 rpcz_store.cc:276] 0709 12:22:46.723268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.723418 (+   150us) service_pool.cc:224] Handling call
0709 12:22:46.730611 (+  7193us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:46.764974 (+ 34363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.765003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:46.793782 (+ 28779us) log.cc:844] Serialized 52 byte log entry
0709 12:22:46.884904 (+ 91122us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:46.895564 (+ 10660us) log.cc:844] Serialized 14 byte log entry
0709 12:22:46.898252 (+  2688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.898321 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:47.554398 (+656077us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b1800386080. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116676522 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:48.004040 (+449642us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:48.195275 (+191235us) raft_consensus.cc:1685] finished
0709 12:22:48.195295 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:48.195438 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3154,"prepare.queue_time_us":11584,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1697,"raft.queue_time_us":31932,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":20968,"spinlock_wait_cycles":31209088,"thread_start_us":89017,"threads_started":1,"wal-append.queue_time_us":178256}
I20260709 12:22:48.198094  1806 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.198650  1798 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.174613  1501 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.180706  1513 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:48.176360  1951 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.182981  1662 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:48.190599  1643 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.199772  1924 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.202723  1850 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.208094  1552 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.190760  1467 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:22:48.210750  1961 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:48.217023  1960 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.220103  1947 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:48.264259 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43701.6us
W20260709 12:22:48.239359  1970 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:22:48.241798  1957 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:22:48.217546  1951 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:22:48.207104  1657 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.305310  1533 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.308281 31568 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
W20260709 12:22:48.308836  1971 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:22:48.314038  1634 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 12:22:48.305408  1947 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:48.315563  1961 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.275691  1798 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.278555  1972 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.276495  1977 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.285389  1963 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:22:48.277706  1951 consensus_queue.cc:1243] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:48.335984 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:48.302245  1960 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:48.345671 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:48.344211 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 130360us
I20260709 12:22:48.346257 31494 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.276247  1805 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:22:48.337314  1970 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:48.349807 31418 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:48.351197 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:48.351773 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:48.353807 31416 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.354445 31498 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:48.335871  1690 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.356184 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:48.356494 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:48.356930 31500 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:48.357018 31495 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:48.358060 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 210273us
I20260709 12:22:48.358785 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:48.359851 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:48.360608 31497 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.342296  1946 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.364646 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.366254 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:48.365226 31420 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:48.364269 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:48.369117 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:48.369382 31420 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:48.342105  1972 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:48.377549  1975 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:22:48.377647 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:48.378954  1980 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:48.379652  1980 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:48.379809  1981 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:48.380048  1980 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.380407  1981 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:48.381410  1981 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.386195 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:48.387032  1919 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.350808  1904 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:48.405247 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:48.404403 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:48.413829 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:48.340384  1798 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.349974  1960 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.345014  1977 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.404836  1972 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.336158  1947 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.439472 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.416137 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.503531 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.379017 31416 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:48.363986  1850 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:22:48.521847 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 657) took 1886 ms. Trace:
I20260709 12:22:48.360352  1552 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.525847  1858 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:48.526834 31421 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:48.529068 31494 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:48.529211 31497 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:48.538647 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.538900 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.535012 32107 rpcz_store.cc:276] 0709 12:22:46.635377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.635526 (+   149us) service_pool.cc:224] Handling call
0709 12:22:46.635851 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.104064 (+468213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.521625 (+1417561us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54002b9154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:48.521791 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075092736}
I20260709 12:22:48.526400 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:48.442133  1896 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.546948 31420 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
W20260709 12:22:48.532423  1934 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.001s
I20260709 12:22:48.524945  1501 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:48.519030  1904 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:48.568415 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:48.539774  1552 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.566376  1968 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.586464  1552 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.585565  1501 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:48.552444  1858 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.557708  1934 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.630241  1700 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:48.676270  1921 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.000s	sys 0.016s
I20260709 12:22:48.676563  1967 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.676931  1969 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.677273  1996 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.677802  1974 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.277s	user 0.009s	sys 0.002s
W20260709 12:22:48.678819  1985 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:22:48.679608  1987 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:22:48.713863 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 166627us
W20260709 12:22:48.668889  1991 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:22:48.565214  1904 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.734970 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:48.747359 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 198974us
I20260709 12:22:48.667943  1863 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.186408 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.009s	sys 0.009s
W20260709 12:22:49.186810 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.009s	sys 0.009s
I20260709 12:22:48.797377 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:48.780568 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:49.188411 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:49.187076 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 822833us
I20260709 12:22:49.193773 32114 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:48.987478 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:49.194069 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:49.194643 32112 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:49.195739 31494 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:48.670037  1968 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:49.199899  1994 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 12:22:49.200332 31497 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:22:49.162964  1944 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.042s	user 0.011s	sys 0.001s
I20260709 12:22:49.185631 32108 raft_consensus.cc:2410] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:22:49.185375  1643 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.000s
W20260709 12:22:48.733254  1921 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.000s	sys 0.017s
I20260709 12:22:49.197499 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:49.124435  1977 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.968390  1960 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.733318  1924 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.186117 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.007s	sys 0.010s
I20260709 12:22:48.810281  1800 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.170128  1881 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.207473 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:49.061280  1980 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.006s
W20260709 12:22:49.016427 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 384425us
I20260709 12:22:49.183575  1896 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.076175  1805 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.215175 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:49.252471 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:48.883271 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:49.047008  1785 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.183460  1947 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:48.820622  1979 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:49.048838  1926 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.299s	user 0.011s	sys 0.007s
I20260709 12:22:48.809957  1989 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:48.960806  1634 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.994410  1798 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.075942  1951 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.193257  1972 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.231627 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.008s	sys 0.011s
I20260709 12:22:49.204109  1982 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:49.250396 32112 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:49.242674 32113 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:48.750782  1700 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.296626  1700 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.214423  1850 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:49.297609  1850 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.300329  1850 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.262228 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1372) took 1344 ms. Trace:
I20260709 12:22:49.303169 31491 rpcz_store.cc:276] 0709 12:22:47.917596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.929779 (+ 12183us) service_pool.cc:224] Handling call
0709 12:22:47.940712 (+ 10933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.999510 (+ 58798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.999543 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.003163 (+  3620us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.146920 (+143757us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:48.219747 (+ 72827us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.219996 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.220091 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:48.380260 (+160169us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:49.257712 (+877452us) raft_consensus.cc:1685] finished
0709 12:22:49.261986 (+  4274us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.262165 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1659,"prepare.queue_time_us":162593,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":76007,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":2972,"spinlock_wait_cycles":5216128,"thread_start_us":141004,"threads_started":2,"wal-append.queue_time_us":188536}
I20260709 12:22:49.308246  1926 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.308905  1926 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.253235 31497 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:48.795838  1996 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.316742  1996 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.264561 31495 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:49.262646 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.267891 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:49.204319  1863 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:48.773689  1967 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.320452  1863 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.324012  1967 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.226830  1643 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:48.780730  1969 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.257248  1968 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.326334  1969 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.331209 31498 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.331919 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:49.332579 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 342104us
I20260709 12:22:49.264185  1947 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.262540  2002 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.334617 31499 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:49.270620  1934 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.243177  1924 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.247936  1800 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.326334  1643 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.336125 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.284978  1858 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.283335  1992 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.351166 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.255570  1980 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.367410 31572 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:49.219862  1944 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:49.358954 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.344058 31500 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:49.340957 31537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.094s (SENT) [suppressed 22 similar messages]
I20260709 12:22:49.006984  1501 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.353358 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.372861 31568 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:49.373476 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.374075 31571 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:49.369136 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.374955 31567 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:49.375161 31570 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:22:49.370324 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:49.378661 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:49.259961  2005 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:22:49.260174  1805 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.264092  1785 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:49.351111  1988 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.078s	user 0.010s	sys 0.016s
I20260709 12:22:49.380002 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.390859 31497 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:49.392017 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.254886  1881 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.338478  2004 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.329022  1951 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.331717  1972 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.264297  1979 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.332311  1634 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.409631 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.410521 31497 raft_consensus.cc:2368] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:22:49.284821  1989 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.400121 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.350843  1947 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.420240 31491 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:49.395713  2005 consensus_queue.cc:1243] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:49.429235  1881 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.429783  1881 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.431238  2003 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:22:49.431895  1800 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.434921  1972 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.435092  1992 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.435530  1992 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.435851  1992 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.440523  1805 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.442741  1979 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.352869  2002 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.444041  1904 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.445719  2002 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.446383  1968 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.446991  1968 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.449412  1968 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.450011  1969 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.450592  1969 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.457497  1863 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.458166  1863 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.458662  1989 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.426262  2004 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.465190  2004 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.465595  2004 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.467736  1924 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.430177  1881 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.470651  1951 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.472036 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 511) took 1105 ms. Trace:
I20260709 12:22:49.538754 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:49.453298 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 199800us
I20260709 12:22:49.543002 32080 leader_election.cc:400] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
W20260709 12:22:49.541182 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162582us
I20260709 12:22:49.475279 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.543318 32080 leader_election.cc:403] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:49.545171 31491 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:22:49.557734 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.005s
W20260709 12:22:49.558322 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.005s
I20260709 12:22:49.543103 31495 rpcz_store.cc:276] 0709 12:22:48.366511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.366645 (+   134us) service_pool.cc:224] Handling call
0709 12:22:49.471874 (+1105229us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54002e6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:49.471976 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643624192}
I20260709 12:22:49.413818  2011 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.566473 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:49.584203 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:49.592547 31568 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:49.547905  1785 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.480195  1634 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.609189 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.609398 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.568140  1926 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.563362  1989 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
I20260709 12:22:49.570914  1800 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.568570  1968 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:49.611302 31565 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:49.619458 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.620134 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:49.621027 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.610149 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:49.617074 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.622560 31567 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:49.573509  1738 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:49.618716 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.620201 31574 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:49.621698 31571 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:49.570079  1980 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.581887  1924 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.606729  2010 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.611989  1805 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:49.628544 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.640662 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.573156  2011 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.586381  1967 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:49.628165 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:49.642153 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.642084 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.633788  2010 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:49.627185 32106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.014s	sys 0.004s
I20260709 12:22:49.642874 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:49.645747 31570 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:22:49.648464 32106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.014s	sys 0.004s
W20260709 12:22:49.643810 32109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.006s	sys 0.023s
I20260709 12:22:49.646064 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
W20260709 12:22:49.649169 32109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.007s	sys 0.023s
I20260709 12:22:49.643929 31572 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 4: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:49.648017 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.629231  1863 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:49.653452 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 83653.4us
I20260709 12:22:49.655434  1989 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:49.630595  1969 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.656615 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.658776 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.659185 31572 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:49.627669  1968 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.660391 31572 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:49.630822 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:49.661072 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:49.666575 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48483.1us
I20260709 12:22:49.646488  2010 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.623675  1800 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.675333 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:49.651419  1881 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.632287  2014 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.676733 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.684047 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.641748  1924 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.674407 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:49.679077 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:49.680755 31567 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:49.630468  1738 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.632274  1850 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:22:49.689795 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:49.675242  1969 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:49.647228  1805 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.754274 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 664) took 1069 ms. Trace:
W20260709 12:22:49.737861  2015 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:49.674515  1944 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.650534  1967 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.752599 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.759891 31499 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 3.
I20260709 12:22:49.683830  1798 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:49.683022  2014 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:49.767267 31570 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:49.769616 31498 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:49.754761 32106 rpcz_store.cc:276] 0709 12:22:48.684685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.684806 (+   121us) service_pool.cc:224] Handling call
0709 12:22:48.781270 (+ 96464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.781560 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:49.649006 (+867446us) log.cc:844] Serialized 14 byte log entry
0709 12:22:49.753830 (+104824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.753897 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:49.753962 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.754058 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.754210 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33387,"prepare.queue_time_us":626168,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":800057,"threads_started":3}
I20260709 12:22:49.774269 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.787720  2011 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.739159  1881 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.788707  1992 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.789722  1881 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.772405  1798 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.791029  1798 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:49.796356  1863 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.796906  1863 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:49.772264  1634 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:49.800530  1634 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.831223  1634 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:49.831967  2021 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:22:49.755686  1947 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:49.838635  1552 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.190s	user 0.009s	sys 0.002s
I20260709 12:22:49.839093  1552 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.777556  2014 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.839416 31565 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.888707 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.890242 31416 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:49.903712 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.904855 31416 raft_consensus.cc:2410] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:22:49.906965 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 246968us
I20260709 12:22:49.907850 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:49.910444 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.911456 31497 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:49.922489 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.922806 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.923177 31499 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:49.923467 31421 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:49.863271 31418 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:49.861974 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:49.840328  2008 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.401s	user 0.004s	sys 0.000s
I20260709 12:22:49.864647 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.860693  1921 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.853114  1805 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:49.941584 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:49.948395 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.978971 31494 raft_consensus.cc:2376] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7. Re-sending same reply.
I20260709 12:22:49.954219 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:49.961145 31419 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:49.962013 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:49.928449 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 661) took 1339 ms. Trace:
I20260709 12:22:49.852025  1967 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:49.964282 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.991937 31422 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:49.966559 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:49.980225 31566 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:49.981057 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.981787  2011 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:49.982587 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:49.984236  1785 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:49.985543  1858 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.986917  1533 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:49.989168 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:50.002250 31500 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:49.990818 31417 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:50.002540 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1375) took 1853 ms. Trace:
I20260709 12:22:49.929615  1552 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:49.980224 32109 rpcz_store.cc:276] 0709 12:22:48.589398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.732925 (+143527us) service_pool.cc:224] Handling call
0709 12:22:48.733291 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.733517 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:22:49.651223 (+917706us) log.cc:844] Serialized 14 byte log entry
0709 12:22:49.928087 (+276864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:49.928143 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:49.928195 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.928260 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.928384 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17910,"prepare.queue_time_us":630651,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":9986,"raft.queue_time_us":18017,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":23936,"thread_start_us":1096903,"threads_started":2}
I20260709 12:22:49.996265 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:49.844147  2004 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:49.997207 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.997290 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.997612 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:49.915211  1948 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.998653 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.998893 31416 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
W20260709 12:22:49.949831  2015 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:49.855285  1924 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:50.003093 31493 rpcz_store.cc:276] 0709 12:22:48.149174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.149295 (+   121us) service_pool.cc:224] Handling call
0709 12:22:48.149567 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.461705 (+1312138us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b18004a6b00. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc11975b060 00007fc11975bbfb 00007fc11976664b
0709 12:22:49.461907 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:49.613781 (+151874us) log.cc:844] Serialized 14 byte log entry
0709 12:22:49.672204 (+ 58423us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.672826 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.672956 (+   130us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:49.672990 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.673051 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.991460 (+318409us) raft_consensus.cc:1685] finished
0709 12:22:50.002261 (+ 10801us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.002463 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188981,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":51978,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":5333,"spinlock_wait_cycles":12933504,"thread_start_us":231522,"threads_started":3,"wal-append.queue_time_us":291928}
I20260709 12:22:50.016144  1944 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:49.991604  1969 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.082614 31494 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:49.997901  1738 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:50.113837 31494 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:50.141353 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 662) took 1459 ms. Trace:
I20260709 12:22:50.143581 32111 rpcz_store.cc:276] 0709 12:22:48.683623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.684958 (+  1335us) service_pool.cc:224] Handling call
0709 12:22:48.685236 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.685626 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.685653 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.734845 (+ 49192us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.292296 (+557451us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:49.292357 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.292457 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.839650 (+547193us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:50.092902 (+253252us) raft_consensus.cc:1685] finished
0709 12:22:50.092933 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.141259 (+ 48326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21378,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":28687,"spinlock_wait_cycles":28946688,"thread_start_us":343577,"threads_started":1,"wal-append.queue_time_us":641191}
I20260709 12:22:50.145629 31498 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:50.143851 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147690us
I20260709 12:22:50.148559 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 503) took 1807 ms. Trace:
I20260709 12:22:50.149027 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:50.148939 31496 rpcz_store.cc:276] 0709 12:22:48.341520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.341825 (+   305us) service_pool.cc:224] Handling call
0709 12:22:48.342070 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:48.532102 (+190032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.532147 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:48.532201 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:22:48.532252 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.148363 (+1616111us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001d1fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:50.148410 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.148508 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436504832}
I20260709 12:22:50.010632  1785 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:50.170917 31494 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:49.861696  2014 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.163880 31566 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:22:50.169507 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 490496us
I20260709 12:22:50.083977  1858 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.183432 31499 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:49.991410  1921 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:50.077642  1919 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.114391  1863 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:50.217593 31568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.052s
W20260709 12:22:50.273855 31568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.021s	sys 0.053s
I20260709 12:22:50.273958 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.218227 31494 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:22:50.215688 32107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.015s	sys 0.021s
I20260709 12:22:50.216914 31498 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:50.274971 32107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.016s	sys 0.021s
I20260709 12:22:50.151422  1968 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:50.080402  1948 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:50.234087  2021 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:22:50.171281  1992 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.142952  1969 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.187211  1858 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:50.092643  1944 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:50.217857  1881 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:50.270059 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 344168us
I20260709 12:22:50.351078 31498 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:22:50.366942 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 407646us
I20260709 12:22:50.367636 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:50.369771 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:50.354657  1858 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.351977  2034 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:50.265198  1533 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:50.378437 31420 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.014s	sys 0.039s
I20260709 12:22:50.377843 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:50.382270 31420 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.015s	sys 0.040s
I20260709 12:22:50.357235  2029 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:50.381108 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.387684 31417 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:50.280035  1919 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.443961 31416 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:50.382076  1533 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.443135 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.347745  1785 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:50.431432 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 282448us
I20260709 12:22:50.379592  1805 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:50.460291 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.460352 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.371716  1881 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:22:50.271494  1634 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:50.378227  1467 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 12:22:50.502662  2042 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:22:50.503763  2035 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:22:50.458468  1533 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:50.507125  2040 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:22:50.443450  2045 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.514392 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.516502 31416 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:50.518500  2037 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.519182  2037 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.520309  2050 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:50.520896  2050 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.521584  2037 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.523043  2044 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.524081  1948 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.524817  1948 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.525441  1948 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.470456  2034 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:50.527786  2034 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.533914  1800 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:50.471771  2004 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.442756  2029 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.556869 31417 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:50.510143  1467 consensus_queue.cc:1243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:50.564556  1921 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:50.565599  2046 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:22:50.567883  1634 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:50.471335  1863 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:22:50.568987  2029 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:50.569198  1863 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:50.569737  1863 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:50.570780  1863 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.572438  1863 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.573503 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.574286 31565 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 4.
I20260709 12:22:50.576211 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.577037 31565 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:50.578670 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.471131  1912 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:22:50.581219 31422 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:50.560741  1798 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.002s
I20260709 12:22:50.591996 31565 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:22:50.584913 31416 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
W20260709 12:22:50.581617  2012 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.133s	user 0.003s	sys 0.009s
I20260709 12:22:50.605854 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.606985 31565 raft_consensus.cc:2410] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:50.608279 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.609942 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.612396 31565 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:50.617268 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.620152 31565 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:50.622483 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.623773 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:50.626461 31565 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:22:50.653541 31565 pending_rounds.cc:85] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 2
I20260709 12:22:50.656136 31565 pending_rounds.cc:107] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:50.659133 31565 raft_consensus.cc:2889] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:50.665158 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 70948.7us
W20260709 12:22:50.662281 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 286551us
I20260709 12:22:50.674806 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.672426 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:50.685971 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:50.612604  1798 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.662410  2014 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.690763 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.691872 31416 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:50.692333 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1449) took 2537 ms. Trace:
W20260709 12:22:50.682169  2010 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.000s
I20260709 12:22:50.671238  1919 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:50.684223  1944 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:50.692703 31573 rpcz_store.cc:276] 0709 12:22:48.149628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.149744 (+   116us) service_pool.cc:224] Handling call
0709 12:22:48.169806 (+ 20062us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:48.170271 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.170315 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:48.183289 (+ 12974us) log.cc:844] Serialized 52 byte log entry
0709 12:22:48.265652 (+ 82363us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:48.553916 (+288264us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.643722 (+ 89806us) log.cc:844] Serialized 14 byte log entry
0709 12:22:48.643930 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.643997 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:50.680502 (+2036505us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b240020d848. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc1164fc9c4 00007fc1164faacb 00007fc1166b5dc9 00007fc1166b5a55 00007fc1166b4fb0 00007fc11932b488 00007fc11932bbe8 00007fc119303398 00007fc1192fe76a 00007fc1192fdbb6
0709 12:22:50.687212 (+  6710us) raft_consensus.cc:1685] finished
0709 12:22:50.687249 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.687435 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76779,"prepare.queue_time_us":235910,"prepare.run_cpu_time_us":3754,"prepare.run_wall_time_us":94706,"raft.queue_time_us":3414,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":42516,"spinlock_wait_cycles":21339008,"thread_start_us":340474,"threads_started":2,"wal-append.queue_time_us":160905}
I20260709 12:22:50.736606 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.737547 31417 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:50.731266 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.738883 31422 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:50.674939  1921 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:22:50.760977 31416 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:50.798709 31416 pending_rounds.cc:85] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 2
I20260709 12:22:50.799147 31416 pending_rounds.cc:107] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:50.799458 31416 raft_consensus.cc:2889] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:50.801183 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.732336  2050 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:50.802731 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 424988us
I20260709 12:22:50.803026 32111 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:50.804602 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.693789 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:50.823243 32109 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:50.824689 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.826043 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:50.827158 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.827955 31421 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:50.829389 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135694us
I20260709 12:22:50.751178  1944 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.831470 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:50.836707 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.837862 32109 raft_consensus.cc:2410] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:50.848659 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.849386 31422 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:50.850241 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.850878 31418 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.851923 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.852699 32106 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:50.734849  2010 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.865370 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:50.867587 32109 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:50.886991 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61013us
I20260709 12:22:50.870000 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.830245  2013 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.835060  1919 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.920418 31421 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:50.922885 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 663) took 2206 ms. Trace:
I20260709 12:22:50.923301 32107 rpcz_store.cc:276] 0709 12:22:48.683937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.684060 (+   123us) service_pool.cc:224] Handling call
0709 12:22:48.684327 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.301079 (+616752us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:49.540891 (+239812us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.346164 (+805273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:50.346234 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:50.346301 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.889924 (+543623us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54005c94d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:50.889980 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.890160 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142720,"prepare.queue_time_us":151089,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":103713,"raft.run_cpu_time_us":8916,"raft.run_wall_time_us":66824,"spinlock_wait_cycles":1418760960,"thread_start_us":903539,"threads_started":2,"wal-append.queue_time_us":815272}
I20260709 12:22:50.802147  2051 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:50.889784  2048 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:22:50.932960 31572 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:50.848161  1961 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:50.942628 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.952669 32105 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:50.865903  1912 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:50.971140 31568 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:50.990959 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:50.981115 31571 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:51.017732 31421 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.864665  1800 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:51.001646 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 108844us
I20260709 12:22:51.021088 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:50.963054  2047 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
W20260709 12:22:51.024849 31465 connection.cc:256] RPC call timeout handler was delayed by -1.0803196770002614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:22:51.044224 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:50.855221  1944 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.975221  1578 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.044224 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 213353us
I20260709 12:22:51.047350 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:50.962571  1948 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:50.966857  2061 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:50.968022  2064 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.019243  2011 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:51.082777 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.086326 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.100615 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.101289 31497 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:51.090579 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.102066 32111 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:22:51.094199 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46947.5us
I20260709 12:22:51.103597 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:51.095315 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.105477 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.105993 31424 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:51.106849 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.107755 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.108728 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.109597 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.112246 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.096966 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.113739 31423 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:51.096480 31421 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:51.115474 31419 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:51.117184 31497 pending_rounds.cc:85] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 1
I20260709 12:22:51.117588 31497 pending_rounds.cc:107] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:51.117836 31497 raft_consensus.cc:2889] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:51.062741 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.087467 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:51.091032 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.932310  1919 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:51.113246 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.122933 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.110488 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:50.961396  1533 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:51.065428  1881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.013s
I20260709 12:22:51.166807 31418 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:22:51.082329  1467 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.155535 31497 pending_rounds.cc:107] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:51.079066  2013 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.161509 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.186961 31498 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:51.163599 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.188251 31421 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:51.135879 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.164881 31424 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:51.085021  1578 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:51.192056 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.188061 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:51.176752 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.073268  1921 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:51.086426  2061 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:51.138942 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.161291 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.180032 31497 raft_consensus.cc:2889] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:51.160313 32113 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:51.017771  1961 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:50.999814  2051 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.046401  1800 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.209870 31418 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
W20260709 12:22:51.175863  1881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.006s	sys 0.016s
I20260709 12:22:51.216918 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:51.223999 31390 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 1.501s (SENT)
I20260709 12:22:51.044596  1912 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.186101  1948 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.182412  1467 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.120553  2011 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:51.234133 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:51.224656 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.246456 31424 raft_consensus.cc:2368] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:22:51.235494 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.235652 32106 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.120947  2064 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.224839  1921 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:51.247339 31421 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
W20260709 12:22:51.234323  2047 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:51.225237 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.243834 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.254776 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.226833  2061 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.231763  2063 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.291432  2063 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.294160  2063 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:51.267587 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43609.7us
W20260709 12:22:51.295085  2072 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:22:51.268321  2058 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.283571  2071 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.296952  2071 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.297451 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.298457 31421 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:51.245441  1881 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:51.299615  1881 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:51.303560  2066 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:22:51.305999 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1470) took 1444 ms. Trace:
I20260709 12:22:51.306493 31420 rpcz_store.cc:276] 0709 12:22:49.861906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.862030 (+   124us) service_pool.cc:224] Handling call
0709 12:22:49.862347 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.862750 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.862786 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.863268 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.382782 (+519514us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:22:50.475075 (+ 92293us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.691504 (+216429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.691588 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.305746 (+614158us) raft_consensus.cc:1685] finished
0709 12:22:51.305773 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.305930 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25410,"prepare.queue_time_us":86288,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":5940,"raft.queue_time_us":91808,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":544,"thread_start_us":709597,"threads_started":2,"wal-append.queue_time_us":711701}
I20260709 12:22:51.239892  1948 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.318027 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.318209 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:51.327432 31573 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.319643 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:51.328365 31568 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.247506  2013 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:51.246701  1467 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.244261  1798 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.329417 31420 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:51.241443  2078 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.252082  2070 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:51.261837  1921 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.344118 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:51.347550 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.378433 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.379302 31495 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:51.383675  2075 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:51.384019  2068 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:51.384177 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.384279  2075 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.384918  2070 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.331025  2013 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.386842  1881 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.387234  2013 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:51.348265  2069 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:51.391924  2069 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.392359 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.392755 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1419) took 1778 ms. Trace:
I20260709 12:22:51.393067 32112 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:51.393946 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.378341 32106 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:51.397028 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.398017 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:51.398537 32114 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.326257  1948 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.393226 31496 rpcz_store.cc:276] 0709 12:22:49.614084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.150079 (+535995us) service_pool.cc:224] Handling call
0709 12:22:50.216628 (+ 66549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.216865 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:50.264936 (+ 48071us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.392211 (+1127275us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b1800466a20. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287
0709 12:22:51.392322 (+   111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.392384 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:51.392452 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.392547 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.392690 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2872,"prepare.queue_time_us":47983,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4063,"raft.queue_time_us":201615,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":45299,"spinlock_wait_cycles":204308608,"thread_start_us":563857,"threads_started":2,"wal-append.queue_time_us":589402}
I20260709 12:22:51.452244 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1456) took 1072 ms. Trace:
I20260709 12:22:51.382562 32105 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:51.367540  2078 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.455359 31574 rpcz_store.cc:276] 0709 12:22:50.379771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.379883 (+   112us) service_pool.cc:224] Handling call
0709 12:22:50.446164 (+ 66281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:50.446646 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.446711 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:50.466968 (+ 20257us) log.cc:844] Serialized 52 byte log entry
0709 12:22:50.695491 (+228523us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.185634 (+490143us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.192305 (+  6671us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.451910 (+259605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.451987 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.452030 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:51.452056 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.452191 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138022,"prepare.queue_time_us":595012,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":3007,"raft.queue_time_us":188364,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":22705,"thread_start_us":718338,"threads_started":3,"wal-append.queue_time_us":758659}
I20260709 12:22:51.485867 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:51.486625 31574 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:51.501533 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 414151us
I20260709 12:22:51.621671 32114 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:22:51.495743 31390 leader_election.cc:336] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 1.779s (SENT)
I20260709 12:22:51.504451 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:51.440239  2055 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.680634 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.680727 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.680872 31568 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:51.476425  2078 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.638984 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:51.676929 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:51.713227 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 217526us
W20260709 12:22:51.716638 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77794.5us
I20260709 12:22:51.560938  1881 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.637951  1800 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:51.652410  1858 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.262s	user 0.000s	sys 0.013s
I20260709 12:22:51.675586  1912 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.605136  1533 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:51.742614 31574 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:51.733518 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:51.736145 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.763298 31495 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:51.597231  2081 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.738778  2039 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:51.749063  1785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.008s	sys 0.014s
I20260709 12:22:51.657153  2070 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.604508  2051 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:51.603394  2011 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:51.752763 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1407) took 2508 ms. Trace:
W20260709 12:22:51.743371  1863 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.170s	user 0.010s	sys 0.005s
I20260709 12:22:51.676587  1921 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:51.725811  2058 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:51.737049 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.007s
I20260709 12:22:51.732911  1643 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:22:51.763790 31494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.006s	sys 0.015s
I20260709 12:22:51.760751  2064 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.743460  2075 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.792742 31492 rpcz_store.cc:276] 0709 12:22:49.244546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.244730 (+   184us) service_pool.cc:224] Handling call
0709 12:22:49.245091 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:49.245324 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:49.416579 (+171255us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.398628 (+1982049us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b180049be80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a
0709 12:22:51.399059 (+   431us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.752245 (+353186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.752329 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.752419 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.752564 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.752700 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20499,"prepare.queue_time_us":428561,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":77,"raft.queue_time_us":288161,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12198,"spinlock_wait_cycles":4160768,"thread_start_us":724801,"threads_started":3,"wal-append.queue_time_us":351828,"wal-append.run_cpu_time_us":1180,"wal-append.run_wall_time_us":1019216}
I20260709 12:22:51.764300  2081 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:51.802100 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.007s
W20260709 12:22:51.809773 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 610476us
W20260709 12:22:51.775765  1785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.015s
I20260709 12:22:51.739435  1881 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.795650 31466 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:51.805066 31494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.015s
W20260709 12:22:51.787258 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 73904.2us
I20260709 12:22:51.743459  1858 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.814028  2081 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.791004  2039 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:51.821185  2099 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:22:51.822335 32112 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.823330  1944 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.825459 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2580) took 1027 ms. Trace:
I20260709 12:22:51.795985  2036 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:51.816450  2091 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.802983  2070 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:51.827854 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:51.840626 31465 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:51.840931 31465 leader_election.cc:403] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:51.825858 31416 rpcz_store.cc:276] 0709 12:22:50.797935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.798073 (+   138us) service_pool.cc:224] Handling call
0709 12:22:50.798441 (+   368us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:51.088012 (+289571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.088054 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:51.103773 (+ 15719us) log.cc:844] Serialized 78 byte log entry
0709 12:22:51.335394 (+231621us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:51.341724 (+  6330us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.639745 (+298021us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.640086 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.640211 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.825231 (+185020us) raft_consensus.cc:1685] finished
0709 12:22:51.825251 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.825398 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5680,"prepare.queue_time_us":2214,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3430,"raft.queue_time_us":235983,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":76152,"thread_start_us":425401,"threads_started":2,"wal-append.queue_time_us":648215}
I20260709 12:22:51.804488  2058 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.802301  1912 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.807723  1643 consensus_queue.cc:1243] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:51.843215 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:51.852903 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:51.864766  1946 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.865195  1946 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.865531  1946 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.871527  1980 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.871940  1980 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:51.872306  1980 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.884326  2068 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:51.884881  2068 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:51.885767  2068 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:51.887240  2083 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:22:51.889155 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1450) took 3739 ms. Trace:
I20260709 12:22:51.889556 31569 rpcz_store.cc:276] 0709 12:22:48.149915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.150231 (+   316us) service_pool.cc:224] Handling call
0709 12:22:48.171606 (+ 21375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.181178 (+  9572us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:48.353351 (+172173us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.311094 (+2957743us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180036cbe0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a 00007fc11976da2a
0709 12:22:51.734124 (+423030us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.734304 (+   180us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.734847 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.734976 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:51.735010 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.735081 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.888920 (+153839us) raft_consensus.cc:1685] finished
0709 12:22:51.888944 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.889090 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35428,"prepare.queue_time_us":224065,"prepare.run_cpu_time_us":5972,"prepare.run_wall_time_us":95940,"raft.queue_time_us":28918,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7447,"spinlock_wait_cycles":39617792,"thread_start_us":567653,"threads_started":2,"wal-append.queue_time_us":3458694}
I20260709 12:22:51.892028 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1458) took 1500 ms. Trace:
W20260709 12:22:51.892380  2013 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 12:22:51.892954  2013 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:51.892429 31565 rpcz_store.cc:276] 0709 12:22:50.391345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.652808 (+261463us) service_pool.cc:224] Handling call
0709 12:22:50.653344 (+   536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.002245 (+348901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.002275 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.002824 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 12:22:51.347281 (+344457us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:51.381812 (+ 34531us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.382259 (+   447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.382324 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.891789 (+509465us) raft_consensus.cc:1685] finished
0709 12:22:51.891813 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.891956 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34284,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":10609,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":48513,"thread_start_us":569512,"threads_started":2,"wal-append.queue_time_us":656491}
I20260709 12:22:51.861740  2091 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.895645  1912 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:51.896903  2091 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:51.905004  2061 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.614s	user 0.002s	sys 0.006s
I20260709 12:22:51.906600  1881 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:51.862422  2058 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:51.909564  2086 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:22:51.914252  2045 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:51.924592 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.823455  1858 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:51.927395 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 127258us
I20260709 12:22:51.932093 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:51.926050 31573 consensus_meta.cc:287] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 12:22:51.598466  2063 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:22:51.743306  2084 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:22:51.970108 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:51.940778 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 163697us
I20260709 12:22:51.943133 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:51.944799 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.908375  2101 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:22:51.945627 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.983002 31420 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:51.923342  2070 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:51.954375 31573 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:51.988831 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:51.955829 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 115328us
I20260709 12:22:51.959461 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.960284 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:51.911259  2089 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:51.993711 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.994882 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.995647 31492 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:51.971145 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:51.972002 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.974546 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.978763 31419 raft_consensus.cc:2376] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8. Re-sending same reply.
I20260709 12:22:51.981993 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.997627 31421 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:51.946343 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.998008 31418 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:51.998425 31424 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:51.984501 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:51.989977 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:51.984992 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:52.000648 31415 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.002360 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.005291  2090 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 12:22:51.930838  2061 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.007225 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.007815 31419 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:51.945578  2045 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:52.010334 31416 raft_consensus.cc:2368] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 4. Current term is 5.
W20260709 12:22:52.066483 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 87560.9us
I20260709 12:22:52.060876  2061 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:52.103343 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 250516us
I20260709 12:22:52.103801 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.104982 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:51.999483 31422 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:52.008632 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:52.106032 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 116158us
W20260709 12:22:52.092712 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 166367us
I20260709 12:22:52.106856 31418 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 4.
I20260709 12:22:52.052412 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.107420 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:52.102895 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 259768us
W20260709 12:22:52.003381 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48390.7us
I20260709 12:22:52.113557 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.114840 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.120461 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:52.121670 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:51.963150  1944 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:52.110508 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:52.111933 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.044849 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.135829 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.139061 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.139838 31422 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:51.863255  2036 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.140954 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.079627  2090 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:52.148676  2096 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:22:52.106005  2098 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:52.160609 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.161185 31491 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:52.153054 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:52.155872 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45447.6us
W20260709 12:22:52.161285 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53949.3us
I20260709 12:22:52.165154 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:52.155063 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:52.140847  1467 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.006s
I20260709 12:22:52.175669 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.176587 31495 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:52.177749 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.178627 31495 raft_consensus.cc:2410] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:52.178980 31415 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:52.183609 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:52.190426 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.196333 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.200088  2119 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:52.202812  2000 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:52.203243  2000 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.203634  2000 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.127255  2061 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:22:52.244999 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.109668  2055 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:22:52.158257  2098 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:52.163928  2013 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.176358  2091 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:52.249168 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 59618.7us
I20260709 12:22:52.257179 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:52.284915 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.204734  1858 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:52.285679 31492 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:52.203259  1921 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.180418  1467 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.258364  2091 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:52.259009  2098 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.320892 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.206144  2084 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:22:52.322288  1858 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:52.269913  2090 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:22:52.336870 31491 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:52.341564 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:52.343214 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 229736us
I20260709 12:22:52.343736 31417 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:52.344460 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.356942 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.357551 31492 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.322798  2109 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:52.335366  2091 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:52.363001 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 179461us
I20260709 12:22:52.256214  2070 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.369885 31465 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:52.371717 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:52.377496 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.313552  1946 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.185089  2045 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.381889 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.383292 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.362747  2084 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:52.393748 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.375020  2090 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:52.395279  2089 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:52.408438  2125 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.399381  2045 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:52.408663  2081 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.002s
I20260709 12:22:52.409168  2081 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.410287  1967 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:52.410696  1967 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:52.392815  1980 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
W20260709 12:22:52.415251  2054 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.523s	user 0.005s	sys 0.012s
I20260709 12:22:52.417488  1961 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.406352  2109 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:52.419445 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 650) took 2572 ms. Trace:
I20260709 12:22:52.420526  2081 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.414959  1980 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.422029  1738 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.422451  1738 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.422819  1738 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.423173  1980 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.423976 31497 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:52.424958 31492 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:52.426215 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.426234  1919 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.427328 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.428251 31497 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:52.443104 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.443975 31492 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:52.425725  2058 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.419921 31572 rpcz_store.cc:276] 0709 12:22:49.847402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.847499 (+    97us) service_pool.cc:224] Handling call
0709 12:22:49.847976 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.000288 (+1152312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.419142 (+1418854us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400262ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:52.419375 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494526336}
I20260709 12:22:52.428896 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1415) took 3027 ms. Trace:
I20260709 12:22:52.367214  2119 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:22:52.443164 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.445845 31493 rpcz_store.cc:276] 0709 12:22:49.401751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.079227 (+677476us) service_pool.cc:224] Handling call
0709 12:22:50.143253 (+ 64026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.153861 (+ 10608us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:50.187048 (+ 33187us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.824133 (+637085us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.838640 (+ 14507us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.838840 (+   200us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:50.838906 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.839001 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.310026 (+471025us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b180036a540. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:52.414522 (+1104496us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:52.428720 (+ 14198us) raft_consensus.cc:1685] finished
0709 12:22:52.428739 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.428844 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49167,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":167612,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":20454,"spinlock_wait_cycles":80361728,"thread_start_us":473872,"threads_started":2,"wal-append.queue_time_us":533267}
I20260709 12:22:52.401815  2036 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.451754 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.452103  2036 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:52.452409 31497 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:52.452554  2036 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.452981  2036 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.453251 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:52.404477  2100 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:22:52.411038  1967 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.393102  2084 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:52.451558 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.455967 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:52.453485 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81819.3us
I20260709 12:22:52.456599 31492 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:52.457062 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.405236  2103 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:52.458910 31493 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.459060 31497 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.404999  2090 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:52.365011  2108 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.290s
W20260709 12:22:52.459628 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 65942us
I20260709 12:22:52.459774 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.516829 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.567821 31495 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:52.568815 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:52.567862 31540 leader_election.cc:400] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:22:52.569854 31540 leader_election.cc:403] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:52.529754 31537 connection.cc:256] RPC call timeout handler was delayed by -1.1958973450000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:22:52.571295 31537 leader_election.cc:336] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.947s (SENT)
W20260709 12:22:52.571808 31537 connection.cc:256] RPC call timeout handler was delayed by -1.0983099820000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:22:52.569705 31495 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:22:52.572379 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:52.560503 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 313641us
I20260709 12:22:52.433341  2125 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:52.575816 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:52.578176 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:52.578902  2068 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:52.498608  1467 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.485175  2122 raft_consensus.cc:1064] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:22:52.497967  2084 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.483085  2115 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:52.579298  2091 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:52.579953  1800 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:52.517997  2078 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.784s	user 0.007s	sys 0.001s
W20260709 12:22:52.522269  1948 consensus_meta.cc:287] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.060s	user 0.008s	sys 0.000s
I20260709 12:22:52.581051  2125 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.526280  1969 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.504948  1738 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.711696 31574 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:52.712548  1467 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:52.713188  2055 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.713084  1467 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.713815  2055 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.715308  1467 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.521715 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1485) took 1423 ms. Trace:
I20260709 12:22:52.716264  2055 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.716565 31423 rpcz_store.cc:276] 0709 12:22:51.098081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.114415 (+ 16334us) service_pool.cc:224] Handling call
0709 12:22:51.115744 (+  1329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.246246 (+130502us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:51.517605 (+271359us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.677262 (+159657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.677316 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:51.677365 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.520394 (+843029us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b18004482a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:22:52.521473 (+  1079us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540010bb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:52.521524 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.521655 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23987,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":30460,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7015,"spinlock_wait_cycles":310560384,"thread_start_us":399877,"threads_started":2,"wal-append.queue_time_us":205365}
I20260709 12:22:52.716739  1467 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:52.718994  1967 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.720459  2039 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:52.486088  2118 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:22:52.721361  1967 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:52.583874 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:52.726119 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 142302us
I20260709 12:22:52.567710 31492 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:52.728049  1968 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.728478  1968 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:52.728909  1968 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.730814  2091 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.731671  2125 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.586421 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.483685  2087 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.748848  2087 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.749269  2087 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.750330  2124 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:52.579490  2121 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.750744  2124 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:52.751598  2124 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.752626  2124 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.517886  2058 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.754985  2058 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:52.755491  2058 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:22:52.484294  2102 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:52.408635  2089 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.757318  2089 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.482897  2120 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:52.759624  2120 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.761909  2120 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:52.601444 31497 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:52.583053  1946 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.587921  1980 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:52.588109  2106 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.583775  2103 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:52.605237 31493 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:52.588378  2063 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:52.606314  2078 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.607813  2131 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:22:52.606465  1948 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.430445  1858 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.616055  1578 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.594395  2000 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:52.625876  2129 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:22:52.592167  1919 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:22:52.599007  1800 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:52.638540 31494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.019s	sys 0.027s
W20260709 12:22:52.696249 32079 connection.cc:256] RPC call timeout handler was delayed by -1.2980930300000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:22:52.789381 31494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.031s	sys 0.041s
I20260709 12:22:52.791076 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:52.697336 31499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1436) took 1620 ms (client timeout 2074 ms). Trace:
W20260709 12:22:52.698783 31570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2432) took 3101 ms (client timeout 2219 ms). Trace:
I20260709 12:22:52.698454  2098 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.700943 31495 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:52.623009  2090 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.593266  2115 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.780432 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.704684 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 684) took 1308 ms. Trace:
I20260709 12:22:52.796821 31421 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:52.705993 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.708148  1921 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:52.803759 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:52.708199 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.804369 31491 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:52.708906 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.703158  2036 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.710261 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.807202 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.710805 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:52.711306  2094 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.947s	user 0.003s	sys 0.003s
I20260709 12:22:52.584353 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:22:52.787391  1982 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.438s	user 0.016s	sys 0.015s
I20260709 12:22:52.807945 31572 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.736809  2010 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.737756  2069 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.740221 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.740430 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.741101 31571 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:52.743182 31496 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:22:52.743880  1968 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.745198  2039 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:52.763144 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 176831us
W20260709 12:22:52.765887 31417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1494) took 1523 ms (client timeout 1752 ms). Trace:
I20260709 12:22:52.776700 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1379) took 3388 ms. Trace:
I20260709 12:22:52.779284  1634 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:22:52.782135 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:52.784788 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:52.864470 32111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 682) took 1421 ms (client timeout 1833 ms). Trace:
I20260709 12:22:52.793713  1800 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:52.791837 31570 rpcz_store.cc:269] 0709 12:22:49.596938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:49.652887 (+ 55949us) service_pool.cc:224] Handling call
0709 12:22:52.629053 (+2976166us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b5400058054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:52.698660 (+ 69607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182722944}
I20260709 12:22:52.794170 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:52.772367  1980 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:52.795704 32112 rpcz_store.cc:276] 0709 12:22:51.395913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.397890 (+  1977us) service_pool.cc:224] Handling call
0709 12:22:51.398147 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.822818 (+424671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.625700 (+802882us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400720e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:52.704618 (+ 78918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975037824}
I20260709 12:22:52.870560 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1439) took 1792 ms. Trace:
I20260709 12:22:52.807873 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:52.809338 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 225038us
I20260709 12:22:52.871708 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.810040  2075 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:52.734522 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1452) took 2547 ms. Trace:
W20260709 12:22:52.872095 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 77990.8us
I20260709 12:22:52.859494 32114 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:22:52.873301 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98920.4us
I20260709 12:22:52.862190 31567 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:52.861737 31417 rpcz_store.cc:269] 0709 12:22:51.242878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.243351 (+   473us) service_pool.cc:224] Handling call
0709 12:22:52.638928 (+1395577us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003534d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:52.765833 (+126905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427391232}
I20260709 12:22:52.813186  2125 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:52.863097 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:52.815889  1982 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.471s	user 0.017s	sys 0.015s
I20260709 12:22:52.870926 31494 rpcz_store.cc:276] 0709 12:22:51.078071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.215443 (+137372us) service_pool.cc:224] Handling call
0709 12:22:51.218384 (+  2941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.821275 (+602891us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:51.928161 (+106886us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.790171 (+862010us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.795286 (+  5115us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.795439 (+   153us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:52.795476 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.795566 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.870357 (+ 74791us) raft_consensus.cc:1685] finished
0709 12:22:52.870374 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.870490 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7311,"prepare.queue_time_us":101466,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":10443,"raft.queue_time_us":439518,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17766,"thread_start_us":1529056,"threads_started":3,"wal-append.queue_time_us":762310}
W20260709 12:22:52.791750 31499 rpcz_store.cc:269] 0709 12:22:51.077345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.078568 (+  1223us) service_pool.cc:224] Handling call
0709 12:22:52.626239 (+1547671us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b5400361d54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:52.697272 (+ 71033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172707712}
I20260709 12:22:52.804905  2115 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.863837 31500 rpcz_store.cc:276] 0709 12:22:49.388645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.023657 (+635012us) service_pool.cc:224] Handling call
0709 12:22:50.093118 (+ 69461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.727150 (+634032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.727196 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.745748 (+ 18552us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.314551 (+568803us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:51.330052 (+ 15501us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.382120 (+ 52068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.634018 (+1251898us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400012f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:52.766250 (+132232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.766294 (+    44us) raft_consensus.cc:1685] finished
0709 12:22:52.776504 (+ 10210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.776641 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51833,"prepare.queue_time_us":4292,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":627125,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":5864,"spinlock_wait_cycles":856194432,"thread_start_us":731677,"threads_started":2,"wal-append.queue_time_us":654199,"wal-append.run_cpu_time_us":2534,"wal-append.run_wall_time_us":1139806}
W20260709 12:22:52.864876 32111 rpcz_store.cc:269] 0709 12:22:51.395237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.397814 (+  2577us) service_pool.cc:224] Handling call
0709 12:22:52.710599 (+1312785us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:22:52.816286 (+105687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901376}
I20260709 12:22:52.787153  2063 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.869153 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 559) took 1785 ms. Trace:
I20260709 12:22:52.872205 31568 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:52.817780 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.872476 31566 rpcz_store.cc:276] 0709 12:22:50.186783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.216864 (+ 30081us) service_pool.cc:224] Handling call
0709 12:22:52.698692 (+2481828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.698945 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.698984 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.699049 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:52.699097 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.699173 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.734319 (+ 35146us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b5400058050. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:52.734443 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5706857216}
I20260709 12:22:52.795872  2064 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:52.875923 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.878316 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:52.865370 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:52.803850  1921 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:52.866518 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.815783  1501 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:52.889973 31565 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:52.889226 32109 rpcz_store.cc:276] 0709 12:22:51.083985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.084120 (+   135us) service_pool.cc:224] Handling call
0709 12:22:51.084486 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.084754 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:51.325512 (+240758us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.619405 (+1293893us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b18003edca0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287
0709 12:22:52.868616 (+249211us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.868804 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.868854 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:52.868912 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.868978 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.869100 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3885,"prepare.queue_time_us":601908,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":302469,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":19209,"spinlock_wait_cycles":66939136,"thread_start_us":832795,"threads_started":4,"wal-append.queue_time_us":485151}
I20260709 12:22:52.894723 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.898459 31570 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:52.902024 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:52.875020  1980 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:52.909168 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.909983 31565 raft_consensus.cc:2410] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:52.885205  1700 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:52.906505 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.910528 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 686) took 1514 ms. Trace:
I20260709 12:22:52.919585 31566 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.919548 32108 rpcz_store.cc:276] 0709 12:22:51.396465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.398196 (+  1731us) service_pool.cc:224] Handling call
0709 12:22:52.101169 (+702973us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:22:52.101374 (+   205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.101745 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:52.101774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.102271 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.450308 (+348037us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:52.450353 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.450425 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.899670 (+449245us) raft_consensus.cc:1685] finished
0709 12:22:52.899692 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.910471 (+ 10779us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26335,"raft.queue_time_us":74484,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":22047,"spinlock_wait_cycles":5692672,"thread_start_us":347651,"threads_started":1,"wal-append.queue_time_us":424129}
I20260709 12:22:52.920827 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.910554 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.921802 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.922062 31567 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:52.912724  2137 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:52.882628  1982 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:52.875079  2039 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.919060 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1440) took 1840 ms. Trace:
I20260709 12:22:52.925806 31498 rpcz_store.cc:276] 0709 12:22:51.078303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.218385 (+140082us) service_pool.cc:224] Handling call
0709 12:22:51.238288 (+ 19903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.238649 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:51.238694 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:52.744637 (+1505943us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b2c0000e5c8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:52.745231 (+   594us) log.cc:844] Serialized 572 byte log entry
0709 12:22:52.799022 (+ 53791us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:52.799075 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.799244 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:52.918739 (+119495us) raft_consensus.cc:1685] finished
0709 12:22:52.918760 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.919001 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27315968,"thread_start_us":53409,"threads_started":1,"wal-append.queue_time_us":168233}
W20260709 12:22:52.903720 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 121668us
I20260709 12:22:52.916450  1968 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:52.932155 31569 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:52.925350 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:52.932951 31571 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:52.934777 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:52.936280 31494 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:22:52.937429 31494 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:22:52.927556 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:52.940346 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:22:52.929831  2052 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:52.930904  1921 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.931020  1982 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:52.931774  2093 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:52.932104  2019 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:52.924605 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:52.940524 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64665.7us
I20260709 12:22:52.959688 31567 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:52.911532  2034 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:52.913338 31568 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:52.943027 31500 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:52.899430  2075 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:52.912341  2120 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:52.919677  1501 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:52.929021 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:52.959901 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.950264  1634 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:52.902786  2064 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.889938  2101 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:22:52.890232  1992 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:22:52.966004 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:52.787734  2106 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.020098 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.020908 31568 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:52.995046 31566 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:22:53.004907  2075 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:52.964509  1968 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.007005  1992 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:53.024988  1992 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.025956  1992 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.027773  2063 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.029346  1948 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.030458  2078 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:53.008016 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48228.4us
I20260709 12:22:52.960566  1989 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:22:53.010810  2143 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:52.974519  2120 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:53.012086 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 46167.6us
I20260709 12:22:53.095016 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:53.097630 31537 leader_election.cc:336] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.833s (SENT)
I20260709 12:22:53.012609  2007 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:53.032912 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.951228  1700 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.035473 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.031006  1992 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:53.075394 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.112303 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 236679us
W20260709 12:22:53.064435 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.075491 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.039193 32079 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:53.098162 31537 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:52.963590  2052 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:53.104089 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71269.7us
I20260709 12:22:52.973295  2034 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:53.116707 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.034924  1921 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:53.120189 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81091us
I20260709 12:22:53.122741 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.082647  2106 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.124569  1968 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.125180  1972 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.105592  2010 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:53.112753  2014 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:53.135990 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.137526 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:52.923331  2103 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.119661  2052 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.142040 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:53.168454 31566 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:53.169380 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.120996  2034 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.142737  1798 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:53.145830  1912 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.130414  2101 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:53.186738 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:53.146222  2036 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.150365 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 564) took 1203 ms. Trace:
I20260709 12:22:53.155560  2121 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:22:53.159046  1700 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.160228  1924 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.160640  2093 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:53.160778  1967 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.166769  1501 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.189672  1968 raft_consensus.cc:2764] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:22:53.149953 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1399) took 1082 ms. Trace:
I20260709 12:22:53.121995  2007 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:53.218662  2007 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:53.184470 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.220808 31572 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:53.196389 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:53.139672  2014 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.196130 32114 rpcz_store.cc:276] 0709 12:22:51.946721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.946864 (+   143us) service_pool.cc:224] Handling call
0709 12:22:51.947162 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.873215 (+926053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.150145 (+276930us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400242a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:53.150311 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097287040}
W20260709 12:22:53.260596 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.260941 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64633.4us
I20260709 12:22:53.167742 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1447) took 1036 ms. Trace:
I20260709 12:22:53.190966  2010 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.216338 31495 rpcz_store.cc:276] 0709 12:22:52.067622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.576388 (+508766us) service_pool.cc:224] Handling call
0709 12:22:52.576692 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.792644 (+215952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.149738 (+357094us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54000235d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:53.149897 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135692160}
I20260709 12:22:53.217703  1738 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.228485  2000 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.210840  2093 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.236960  2058 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.259831  1634 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.237486  1800 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.208253  1863 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:53.241961  2064 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.268615 31574 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:22:53.250874 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.270961 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:53.271695 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.195220  2098 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.195760  2101 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.170907  2089 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.246771  1924 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.205754 31466 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.526s (SENT)
I20260709 12:22:53.280064 31466 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:53.281102 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75410.4us
I20260709 12:22:53.282577  2081 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:53.284148  2081 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:53.261433 31496 rpcz_store.cc:276] 0709 12:22:52.131626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.713945 (+582319us) service_pool.cc:224] Handling call
0709 12:22:52.742853 (+ 28908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.862648 (+119795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.167420 (+304772us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54002e7050. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:53.167647 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65787648}
W20260709 12:22:53.194440 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 272884us
I20260709 12:22:53.263689  2121 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:53.262969  2137 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.288172  1924 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.290380  2058 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:53.278321 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.291386 31495 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:53.291123  2058 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.287621 31573 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:53.273443  1967 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:22:53.292273  1924 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.293089  2071 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.293577  2058 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.290520  2121 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.294237  2121 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.298861  2014 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.278864  2101 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.277060  1968 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:53.306150  1968 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:53.278604  1738 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:53.252753  2087 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.002s
I20260709 12:22:53.269032  1863 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.306563  1968 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:53.327447 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:53.328579 31540 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.752s (SENT)
I20260709 12:22:53.328763 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.329608 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.330163 31493 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.330300 31565 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:53.331256 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.332055 31497 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:53.333587 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.334838 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.335448 31572 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:53.336459 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.337406 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.343786 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.344704 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.344954 31567 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:53.346469 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 435056us
I20260709 12:22:53.347122 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.348528 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.349022 31567 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.347445 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:53.350262 31565 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:53.326368 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:53.361066 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:53.355026 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:53.319654  1863 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.364022 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:53.364214 31567 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:53.365036 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.362593 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:53.373263 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.386545 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.409737 31565 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:53.320603  2087 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.411432 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.359050  2039 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.410794 31493 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:53.372898  1948 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:53.372752  2058 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:53.373749  2152 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:53.373801  2069 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:53.407334 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52387.8us
W20260709 12:22:53.413621 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51105.6us
I20260709 12:22:53.373852  1919 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:53.376876  2131 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:22:53.414575 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:53.417850 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:53.421072 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.424731 31491 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.414188  1501 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:53.421789 31570 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:53.420092 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:53.421432 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.420445 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.416997  1980 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:53.459362 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.475848 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.512195 31494 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:53.481732 32114 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:53.485098 31491 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:22:53.485435 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.457437 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:53.428715  2115 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:22:53.417488  2069 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:53.488005 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.489887 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.491672 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.522862 32109 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:22:53.491925  2158 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:22:53.402029  1968 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.492369 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.587496  2007 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:53.588495 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.493716  2090 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:53.495323  2155 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:22:53.495831 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.590481 32108 raft_consensus.cc:2410] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:53.591495 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.592331 32108 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:53.593106 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.594132 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.506903  2052 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.595408 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.596541  2052 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.596622 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.496435 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.597481  1800 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.434314  2058 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:53.597761 31567 raft_consensus.cc:2376] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8. Re-sending same reply.
I20260709 12:22:53.598718 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.598917 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.487291  2034 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.429514  1738 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:53.600978  1738 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:53.601455  2034 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.601915  1738 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.605593  2122 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.516880  1921 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:53.597505 31568 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:53.607131  1921 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:53.608074  1921 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.504535  2087 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.417306  2152 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:53.420725  1948 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:53.458802 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.610006 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.474778  2037 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:53.609954  1948 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.416492  2044 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:53.507855 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:53.509995 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 89989.7us
I20260709 12:22:53.420050 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.510133 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.618194 31496 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:53.618590 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.619071 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:53.514914 31498 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.515992 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.487486  1501 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.519217 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:53.519483 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.549629  2121 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.552057  1980 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.553033 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.563921 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.517040  2107 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:53.564185 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:53.565390 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.638792 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74702.6us
W20260709 12:22:53.639933 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 120797us
I20260709 12:22:53.569514  2120 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.571959  2064 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:53.575119 31495 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:53.576579 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1498) took 1614 ms (client timeout 2017 ms). Trace:
W20260709 12:22:53.652674 31421 rpcz_store.cc:269] 0709 12:22:51.962420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.017243 (+ 54823us) service_pool.cc:224] Handling call
0709 12:22:53.576375 (+1559132us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002134d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:53.576517 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591780608}
I20260709 12:22:53.581826 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.654130 31573 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:22:53.594791 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.497490 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.498903 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.598580  2058 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.501504  2014 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.608433 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.609122  2152 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.461704 31499 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:22:53.485278 31466 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.727s (SENT)
I20260709 12:22:53.611425 31567 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.676960 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:53.611785 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.678215 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 192957us
I20260709 12:22:53.612524 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.681383 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.614831 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:53.615370 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.635417 31423 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:22:53.684108 31494 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.642305  2106 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:53.619333  2037 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.643342  1501 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.639470  2044 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:53.646790 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.699187 31565 raft_consensus.cc:2376] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9. Re-sending same reply.
I20260709 12:22:53.699312 31493 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:22:53.647621  2159 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:22:53.647917  2034 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:53.540350  2069 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.566576  2010 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:53.613296 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:53.641848  2043 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.684957 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:53.723822 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:53.684122 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 69426.2us
I20260709 12:22:53.724642 31418 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.688824 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.724658 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.689746 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:53.693804 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.728562 31495 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.697657 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:53.699416 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.541114  2115 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.702555 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.704207 31498 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:53.649467  2107 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:53.652352  2064 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:53.719349 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.703347  2052 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.719723 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:53.720222 31494 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:53.702059  2120 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.687219  1643 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.753811 31420 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:53.732231 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.730304 32107 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:53.756608 31421 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:53.747080 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:53.761247 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.765406 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:53.767917 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.768837 32109 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:53.771427 31495 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:53.723491  2043 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:53.735143  2062 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:53.744890  2071 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.700369  2087 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.790138  2087 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:53.790167 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.790719  2087 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.791438 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.792006 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.792457 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.793298 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.793898 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:53.688017  2089 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.794358 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:53.720598 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 107381us
I20260709 12:22:53.794919 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:53.687861 32105 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:53.796625 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.797123 32105 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.749651 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:53.799599 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.800554 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.801466 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.724244  1981 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:53.772112  1700 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.803119  1700 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:53.803560  1700 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.770157  1533 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:22:53.802479 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:53.807168  1533 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:53.807590  1533 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.807897 32108 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.808568  1533 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.810973 32105 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:53.810753  2037 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.812201  2121 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:53.817435  2093 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.003s
I20260709 12:22:53.760246  2078 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:53.819052  2078 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.821444  2078 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.823016  2107 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.824055  2107 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.825909  2090 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:53.826324  2090 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:53.660583  1989 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:22:53.760138  2084 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.794435 31565 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.793025  2101 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.817993  2093 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.795152 32114 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:53.833194 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.832710 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:53.841898 31495 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:53.833724 31540 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 2.017s (SENT)
I20260709 12:22:53.809894  2044 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.785753  1643 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:53.741767 31418 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:53.789228  2043 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.850417 32112 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.845191  2064 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:53.866381  2051 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:53.866952  2051 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:53.867749  2051 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.870564 31570 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:22:53.872329 31570 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:53.873425 31570 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:22:53.873682 31570 pending_rounds.cc:85] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:22:53.873872 31570 pending_rounds.cc:107] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:22:53.874086 31570 raft_consensus.cc:2889] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:53.868886  2051 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.824066  2115 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:53.826665  2090 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.849706 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:53.893031 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59323us
I20260709 12:22:53.879603 31497 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:53.881723 32113 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:53.841935 31499 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:53.850536 31495 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:53.850816 32108 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:53.894381 31565 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:53.905169 31565 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.907569 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:53.834815  2062 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.861079  1968 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.914099 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:53.915486 31390 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:53.901603  1863 consensus_meta.cc:287] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 12:22:53.814602  2087 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.936425 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:53.895040  1634 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.901073  2075 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.944801  1921 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.945482  1921 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:53.945987  1921 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.952879  2069 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.955369  2101 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:53.959208  2093 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.965656  2045 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:53.902920  2078 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:22:53.906447  2152 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:53.973598 31390 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:54.020377 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46858.3us
I20260709 12:22:54.021565 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:53.984302 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 302078us
W20260709 12:22:53.994328 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.023411 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:54.037348 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:22:54.039505 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.039640 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.036742 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:54.045835 31565 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.050271  2069 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:53.940938  1863 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.068665 32111 raft_consensus.cc:2368] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8.
W20260709 12:22:54.071120 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.078423 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.082015 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.095832 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.047256  2093 raft_consensus.cc:2764] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:54.043753  2081 raft_consensus.cc:2764] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:54.117048 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1414) took 1352 ms. Trace:
I20260709 12:22:54.117519 31492 rpcz_store.cc:276] 0709 12:22:52.764410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.765057 (+   647us) service_pool.cc:224] Handling call
0709 12:22:52.765329 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:52.765641 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.765684 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.600443 (+834759us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b180039bf80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a
0709 12:22:53.601159 (+   716us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b2c0000e5c8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:22:53.601629 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.897180 (+295551us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:53.897232 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.897307 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:54.116811 (+219504us) raft_consensus.cc:1685] finished
0709 12:22:54.116832 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.116985 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7084,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10925,"spinlock_wait_cycles":30193152,"thread_start_us":295157,"threads_started":1,"wal-append.queue_time_us":513569}
I20260709 12:22:54.120900 31568 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:54.086661  2107 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.122534 31568 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.096395  2043 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.142030 32107 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:22:54.142215 31417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.024s
I20260709 12:22:54.129263  2045 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:54.128178  2081 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.142815 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.127370 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.004s
I20260709 12:22:54.126173  2107 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:54.140902 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 353276us
W20260709 12:22:54.146505 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.011s	sys 0.004s
I20260709 12:22:54.130174  2034 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:22:54.152616  2152 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:54.168637  2043 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:54.171801 31418 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 12:22:54.180827 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:54.181066 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.182179 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.174885 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.175884 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.183342 31422 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.174321 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.183629 31565 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:54.176496 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.184372 31424 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:22:54.176581 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.185071 32079 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:54.143548  2045 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:54.143633 31417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.012s	sys 0.024s
I20260709 12:22:54.185420 31415 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.143925 31568 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:22:54.144105 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 454402us
I20260709 12:22:54.150462  2107 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.201748 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.202399 31424 raft_consensus.cc:2376] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7. Re-sending same reply.
I20260709 12:22:54.203392 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.204025 31424 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.191215 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.205163 31419 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:54.196642 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.199908 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.206692 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.206970  1921 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:54.207206 31416 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.209270  1533 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.209097  1700 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.212074  2051 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:54.212493  2051 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:54.213316  2051 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.179243  2168 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.217561  2168 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.218887  2093 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:54.219856  2168 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:54.219995  2093 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:54.220786  2093 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:54.220983  1863 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.221146  2093 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:54.221686  2162 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:54.222074  2162 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:54.222937  2162 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.224069  2162 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.225793  1919 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:54.226186  1919 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:54.228013  2019 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.228499  2019 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:54.229529  2019 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.231890  2062 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.233752  2087 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.227073 31569 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.206516 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:54.226940 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 53448.6us
I20260709 12:22:54.221976  2093 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.261520 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:54.260462 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59645.9us
I20260709 12:22:54.275731 31416 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:54.278373 31415 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:54.281312 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.282696 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:54.271418 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:54.285167 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.284282  2034 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.286814 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.150632  2081 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.200433  2084 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.201041  2045 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.323235 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:54.324438 31565 raft_consensus.cc:2368] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:54.298933 31415 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:54.287724 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:54.311510 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 114934us
I20260709 12:22:54.316079 31420 raft_consensus.cc:2368] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8.
I20260709 12:22:54.214680  2051 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.227133  2152 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:22:54.355700 31423 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:22:54.342971 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:54.360055 31565 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:22:54.360833 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.361371 31415 raft_consensus.cc:1217] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Deduplicated request from leader. Original: 3.3->[5.4-9.6]   Dedup: 5.4->[7.5-9.6]
I20260709 12:22:54.367439 31415 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [5.4-9.6]
I20260709 12:22:54.318621  1981 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.390379 31565 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:54.281469  1992 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:22:54.395264 31569 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:54.281628  2131 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:22:54.403514 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.351044 31424 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:54.404387 31420 raft_consensus.cc:2410] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:54.404538 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.319710  2177 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:54.352779  2087 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.321079  2034 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:54.291505  2176 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:22:54.226970  1919 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.331699  2093 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.398824 31565 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:54.382078  2084 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:54.416654 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 218353us
I20260709 12:22:54.416666 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.404084  2120 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.392664 31571 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:54.418222 31574 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:54.405834  2169 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.427883 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.419015 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:54.433140 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:54.420531 31416 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:54.424851 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:54.425928  2090 consensus_meta.cc:287] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.001s
I20260709 12:22:54.407022  1700 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:54.435518 31466 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.926s (SENT)
I20260709 12:22:54.440071 31420 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:54.415726  1981 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:54.455457  2034 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.436782  2014 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.458038 31568 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:22:54.464991 31465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.592s (SENT) [suppressed 45 similar messages]
I20260709 12:22:54.427239  2179 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.443210  2071 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.447990  1968 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:54.414970  2087 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.443470  2090 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.445779  2120 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.445133  2169 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.486792  2014 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.486586  2179 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.546262  2179 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:54.546481  2185 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.003s
I20260709 12:22:54.549953  2064 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.559464  2120 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.556720  2081 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.561321  2090 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.526145  2084 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.561923  2087 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:54.602967 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.607915 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.610183 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.611411 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.612013 31419 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:54.613142 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:54.614244 31419 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:22:54.616973 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.618557 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:54.619287 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.489989 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1485) took 1145 ms. Trace:
I20260709 12:22:54.621683 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1483) took 1281 ms. Trace:
W20260709 12:22:54.623641 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 185700us
I20260709 12:22:54.491037 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1489) took 1145 ms. Trace:
I20260709 12:22:54.624493  1953 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:54.631959  2014 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:54.631491  1981 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.637301 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 777) took 1136 ms. Trace:
I20260709 12:22:54.639050 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 768) took 1153 ms. Trace:
I20260709 12:22:54.640166  2173 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:54.641441  2103 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.641903 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 773) took 1143 ms. Trace:
W20260709 12:22:54.606527 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.015s
I20260709 12:22:54.610374 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:54.557278  2107 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.612028 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.667845  2206 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:54.675894  2103 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.678851 31566 rpcz_store.cc:276] 0709 12:22:53.345328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.995254 (+649926us) service_pool.cc:224] Handling call
0709 12:22:53.995656 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.995942 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:54.353683 (+357741us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.490303 (+136620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.490423 (+   120us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:54.490497 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.490706 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.490918 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1341,"prepare.queue_time_us":151434,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":12618,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12713,"thread_start_us":492812,"threads_started":2,"wal-append.queue_time_us":184648}
W20260709 12:22:54.681555 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.683440 31420 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:54.683565 31424 raft_consensus.cc:2410] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:22:54.684216 31421 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:54.684435 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.003s	sys 0.015s
W20260709 12:22:54.688337 31463 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.926s (SENT)
I20260709 12:22:54.672438 32111 rpcz_store.cc:276] 0709 12:22:53.485063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.485182 (+   119us) service_pool.cc:224] Handling call
0709 12:22:54.638527 (+1153345us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54006be9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.638821 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274931456}
I20260709 12:22:54.672079 32107 rpcz_store.cc:276] 0709 12:22:53.500954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.792238 (+291284us) service_pool.cc:224] Handling call
0709 12:22:54.636559 (+844321us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400085054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.636945 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801620352}
I20260709 12:22:54.689381  1953 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.691360 31417 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:54.670105 31573 rpcz_store.cc:276] 0709 12:22:53.339719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.880309 (+540590us) service_pool.cc:224] Handling call
0709 12:22:53.880567 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.880745 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:54.312238 (+431493us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.620880 (+308642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.620978 (+    98us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:54.621119 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.621230 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.621435 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":250002,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2844,"raft.queue_time_us":32442,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":442,"thread_start_us":722321,"threads_started":2,"wal-append.queue_time_us":240978}
I20260709 12:22:54.696831  2093 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.715027 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.719748 31567 rpcz_store.cc:276] 0709 12:22:53.344335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.912051 (+567716us) service_pool.cc:224] Handling call
0709 12:22:53.915043 (+  2992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.915229 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:54.180259 (+265030us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.489646 (+309387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.489696 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:54.489743 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.489807 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.489919 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":229407,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":251,"raft.queue_time_us":640,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3323,"thread_start_us":569679,"threads_started":2,"wal-append.queue_time_us":377910}
W20260709 12:22:54.721815 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:54.737644 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.737131  2093 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.737941 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:54.674507 32106 rpcz_store.cc:276] 0709 12:22:53.498463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.498643 (+   180us) service_pool.cc:224] Handling call
0709 12:22:54.641384 (+1142741us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54004ad3d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.641685 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100336512}
I20260709 12:22:54.739454 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:54.744594  2093 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.753443 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.760288 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:54.761003 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 149217us
I20260709 12:22:54.761590 31573 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:22:54.761546  1921 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.762413 31567 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:54.763644  1980 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:54.764083 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 90455.4us
I20260709 12:22:54.762128 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:54.755020 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 730176us
I20260709 12:22:54.776361 31418 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:54.780056 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.780944  1921 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:54.781189  2173 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:54.781271 32110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 685) took 3384 ms (client timeout 2043 ms). Trace:
I20260709 12:22:54.781739  2173 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:54.781838 32110 rpcz_store.cc:269] 0709 12:22:51.396197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.397928 (+  1731us) service_pool.cc:224] Handling call
0709 12:22:54.780742 (+3382814us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b5400116f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.780971 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5333206272}
I20260709 12:22:54.782418  2173 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.794193  1921 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:54.795150 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:54.796360 31422 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.011s
I20260709 12:22:54.796739  2179 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.796815  1921 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:22:54.797502  2179 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:54.796921 31422 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:54.798441  2056 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:54.798910  2056 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:54.780129  1643 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:54.798967  2179 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.800601  2093 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.820185 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 132909us
I20260709 12:22:54.820340 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:54.812803  1643 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:54.825301  1968 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:54.813866  2206 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.833683 31573 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:54.839564  2093 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.831326  1643 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.841835  1643 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.846959  2056 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.848721  2056 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.849849 32110 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:54.851120 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:54.851771 31415 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:22:54.853461 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:54.854574 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:54.855599  2010 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.856102 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:54.856592  2207 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:54.857264  2162 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.009s
I20260709 12:22:54.855877 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:54.854589  2204 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.857103  2207 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.859088  2120 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:54.859258  2207 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.858534  2204 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.860155  2107 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.857036 32110 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:54.863034  2162 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.863700  2162 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.864104  2103 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:54.865970  2010 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:54.867318 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:54.868902 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2457) took 1532 ms (client timeout 1592 ms). Trace:
I20260709 12:22:54.869172 31565 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:54.869381 31572 rpcz_store.cc:269] 0709 12:22:53.336686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.337203 (+   517us) service_pool.cc:224] Handling call
0709 12:22:54.868461 (+1531258us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400319054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.868672 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948946304}
I20260709 12:22:54.869179 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:54.890237 32109 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:54.891345  2170 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:54.891824  2170 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:22:54.892179 32109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 701) took 1133 ms (client timeout 1506 ms). Trace:
W20260709 12:22:54.892585 32109 rpcz_store.cc:269] 0709 12:22:53.758962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.773296 (+ 14334us) service_pool.cc:224] Handling call
0709 12:22:54.891948 (+1118652us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400781754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.892106 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523778432}
I20260709 12:22:54.894435 31570 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:22:54.892956  2170 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.896692  2170 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.896942 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2468) took 1557 ms. Trace:
I20260709 12:22:54.897337 31570 rpcz_store.cc:276] 0709 12:22:53.339415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.880233 (+540818us) service_pool.cc:224] Handling call
0709 12:22:53.904244 (+ 24011us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:54.895121 (+990877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.896643 (+  1522us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400317254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:54.896888 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275568512}
I20260709 12:22:54.900249  2206 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:54.900802 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 567) took 1257 ms. Trace:
I20260709 12:22:54.901144 32105 rpcz_store.cc:276] 0709 12:22:53.643593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.812030 (+168437us) service_pool.cc:224] Handling call
0709 12:22:54.899302 (+1087272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.899699 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:54.899725 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.899783 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:54.899822 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.899893 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.900511 (+   618us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400781750. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.900634 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499755392}
I20260709 12:22:54.903103 31574 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:54.903717  1968 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:54.907570  2045 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.011s
I20260709 12:22:54.908109  2045 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:54.914113 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77467.8us
I20260709 12:22:54.916266  2093 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.920001  2169 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.921485  2045 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:54.923988  2137 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.924623  2137 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:54.926247 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:54.926544 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:54.942449 32106 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:54.942579 32111 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:54.944065 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:54.944228 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:54.944870 32105 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.947022 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:54.952765 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:54.955309 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:54.956612  2007 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.957338  2007 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.958961  2204 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.960381  2087 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:54.960744  1953 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.965672  2051 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:54.966578  2143 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:54.967110  2173 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.967718  1858 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:54.968453  2014 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:54.968899  2014 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:54.966864  2051 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:22:54.970003  2014 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.971175 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1480) took 2213 ms. Trace:
I20260709 12:22:54.971449  2051 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:54.972054  2051 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:54.971549  2014 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.972716  2075 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:54.973735  2075 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:54.970409 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:54.971587 31571 rpcz_store.cc:276] 0709 12:22:52.757178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.941404 (+184226us) service_pool.cc:224] Handling call
0709 12:22:53.611109 (+669705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.611286 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:53.882068 (+270782us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.791936 (+909868us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.792252 (+   316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.792318 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:54.792394 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.792481 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:54.970876 (+178395us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400318b50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:54.970986 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41363,"prepare.queue_time_us":518093,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":41832,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":4523,"spinlock_wait_cycles":1539597184,"thread_start_us":707229,"threads_started":2,"wal-append.queue_time_us":611734}
I20260709 12:22:54.977167  2112 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:54.977592  2112 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:22:54.978428 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 109411us
I20260709 12:22:54.970009  2173 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.978888  2112 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:54.979357  2051 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:54.980180 31463 leader_election.cc:336] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.142s (SENT)
I20260709 12:22:54.980772  2112 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.981199  2051 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:54.987396 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.925797  2137 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:54.968055  2162 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:54.992632 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:54.980182 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:54.998761 31463 leader_election.cc:336] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.249s (SENT)
I20260709 12:22:54.999301 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.000129  2007 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:55.014889  1643 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:55.016084  1643 consensus_queue.cc:1243] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:55.016755  1643 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:55.017141  1643 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:55.017700 31568 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:55.019671 31574 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:54.941447  2056 raft_consensus.cc:2764] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:55.021996 32105 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:55.025985 32108 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:22:55.031152  1921 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.036300 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.038236  1919 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.003405  2173 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:22:55.005576  1953 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.011834  2162 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.005761  2207 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.049083 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:55.018361  1643 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.048588 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.043202  1921 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.028883  2007 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.053098 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.061578 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.062505 31422 raft_consensus.cc:2410] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:22:55.063429 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.063704  1643 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.064260  1921 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.065622 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.057019 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:55.067819 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 87848.7us
I20260709 12:22:55.070832 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:55.072667 31574 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:22:55.066027 31321 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 5 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:55.079169 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 86700.1us
W20260709 12:22:55.077123  2071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.009s	sys 0.014s
I20260709 12:22:55.085402 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:55.090040 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55625us
I20260709 12:22:55.090907 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:55.091935 31322 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 299) took 19037 ms (client timeout 15000 ms). Trace:
I20260709 12:22:55.092623  2045 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.092018 31321 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 7, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.093176  2045 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:55.094693 31321 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.098383  2014 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:55.083297  2071 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:55.094717  2045 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.099699  2152 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:55.100222 31574 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:55.103127  2178 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:55.107156 31493 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:22:55.129221 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.109478 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.110206  2007 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.111420 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.112537 31415 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:55.112571  1982 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.115985 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:55.083957  2162 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:55.130087 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:55.092435 31322 rpcz_store.cc:269] 0709 12:22:36.063709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.068814 (+  5105us) service_pool.cc:224] Handling call
0709 12:22:38.012007 (+1943193us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:55.091647 (+17079640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:46.296864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:46.297487 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:46.297532 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:22:46.297557 (+    25us) tablet.cc:662] Decoding operations
0709 12:22:46.304345 (+  6788us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:46.304428 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:46.304460 (+    32us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:22:46.305774 (+  1314us) tablet.cc:701] Row locks acquired
0709 12:22:46.305822 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:22:46.305989 (+   167us) write_op.cc:270] Start()
0709 12:22:46.306137 (+   148us) write_op.cc:276] Timestamp: P: 1783599766305931 usec, L: 0
0709 12:22:46.306157 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:22:46.350895 (+ 44738us) log.cc:844] Serialized 6767 byte log entry
0709 12:22:46.527118 (+176223us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800442d20. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:22:46.649288 (+122170us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.790842 (+141554us) write_op.cc:301] APPLY: starting
0709 12:22:46.790957 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.791286 (+   329us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.791322 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.930078 (+138756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.930511 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:22:46.930567 (+    56us) write_op.cc:312] APPLY: finished
0709 12:22:47.001829 (+ 71262us) log.cc:844] Serialized 119 byte log entry
0709 12:22:47.006013 (+  4184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:47.006220 (+   207us) write_op.cc:454] Released schema lock
0709 12:22:47.006300 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:47.006830 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:47.006864 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20898,"reported_tablets":37,"spinlock_wait_cycles":1009320704,"child_traces":[["op",{"apply.queue_time_us":135532,"apply.run_cpu_time_us":8920,"apply.run_wall_time_us":215955,"num_ops":17,"prepare.queue_time_us":164968,"prepare.run_cpu_time_us":51191,"prepare.run_wall_time_us":180772,"raft.queue_time_us":101962,"raft.run_cpu_time_us":20213,"raft.run_wall_time_us":85948,"replication_time_us":342957,"spinlock_wait_cycles":4633472,"thread_start_us":335899,"threads_started":4,"wal-append.queue_time_us":141548,"wal-append.run_cpu_time_us":48913,"wal-append.run_wall_time_us":1562810}]]}
I20260709 12:22:55.139951 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:55.129163 31493 pending_rounds.cc:85] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 6
I20260709 12:22:55.136161 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:55.143256 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:55.147078 31496 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.123494 31321 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.142302  1982 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.151727  2098 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:55.151402 31321 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 4 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.152153  2098 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:55.153038  1982 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.153134 31321 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 4, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.154085  2000 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.140736 31493 pending_rounds.cc:107] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:22:55.155103 32105 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:55.155337 31493 raft_consensus.cc:2889] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.161653 31499 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.163002 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:55.163762 31495 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.167253 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:55.168052 31500 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:55.168807 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.169963 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.171864 31421 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:22:55.179876 31421 pending_rounds.cc:85] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 7
I20260709 12:22:55.181059 31421 pending_rounds.cc:107] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:22:55.181392 31421 raft_consensus.cc:2889] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.169924  1953 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:55.183365 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:22:55.193845 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.199905 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.186157 31321 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 5, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.223476 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.226814 32108 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:55.223835 31321 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.237170 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:55.201862  1953 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.239401 31321 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 5, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.240615  1953 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.233906  2137 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:22:55.249348 31493 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6.
I20260709 12:22:55.224466  2173 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.250770 31496 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:55.137066  2162 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.242811 31321 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:22:55.257644 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 132438us
I20260709 12:22:55.262754  2181 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.260876  2007 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:22:55.263432  2181 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.153223  2098 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.265866  2181 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:55.268481 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 159115us
W20260709 12:22:55.267086 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 155775us
I20260709 12:22:55.262974 31498 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:55.255671  2207 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.266921  2137 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.291759  2137 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.259094  1953 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.274371  1738 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:22:55.252224  2014 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:22:55.265880  2098 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.267567  2204 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:55.289064 31494 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:55.289613  2152 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:55.289901  2178 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:55.290992 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:55.261245  2000 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:55.297698 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 155009us
I20260709 12:22:55.293915 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:55.293905  2218 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.307199 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.309263 31321 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:55.296936  2219 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:22:55.311002 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142531us
W20260709 12:22:55.318789 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.311625 31495 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:55.294018  2137 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:55.313841 31537 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.266197  2071 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.324554 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:55.332451  2084 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.309469  2204 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:55.336647 31321 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 6, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 6 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:22:55.340678 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46821.5us
I20260709 12:22:55.340937 31463 leader_election.cc:400] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8.
I20260709 12:22:55.341346 31463 leader_election.cc:403] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.342358 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.343024 31421 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:55.343983  2137 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.352481 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:55.347688 31321 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 5 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.354281  2029 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.354729 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:55.355327 31321 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.356876 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:55.357044 31321 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:55.357843  1921 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:55.358183 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:55.294119  2075 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:22:55.316445  2093 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:22:55.360787 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:22:55.362920 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.363134 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49390.6us
W20260709 12:22:55.363617 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.358438 31321 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 5, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 5 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:22:55.367472  2216 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:22:55.324523  2206 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:55.358386  1921 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:55.343904  2034 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.373704  2181 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.379187  2179 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:55.379432 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:55.379822  2179 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.380381  2179 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:55.381634 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 83173.8us
I20260709 12:22:55.364023  2218 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:55.360505  1982 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:55.368743  2045 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:55.369843  2000 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8.
I20260709 12:22:55.388321  1738 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.388672  2044 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:22:55.389299  2220 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:22:55.339979  1953 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:22:55.397516 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:55.398609  1953 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:55.407356  1953 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:55.408303  1953 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.384968  2093 consensus_queue.cc:1243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:55.372572  2084 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:55.398958 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82372.9us
I20260709 12:22:55.372998  1921 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:55.402760 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.430845  2084 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.433732  2084 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.440356  2112 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.441138  2112 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.440527  2051 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:55.409584  1953 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:55.457736 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.393025  2045 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:55.391343  2056 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:55.461894 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 120478us
W20260709 12:22:55.462370 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 171642us
W20260709 12:22:55.466259 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.466707  2122 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:55.466823  2098 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.469821  2218 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:55.470422  2223 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260709 12:22:55.410539  1738 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.472590  2162 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.476315  2044 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.510495 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 113099us
I20260709 12:22:55.384734  2034 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.456965  2051 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:55.480057  2045 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.532075 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:55.480297  2056 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:55.528949 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:55.564184 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47646.1us
I20260709 12:22:55.460443  1982 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.542807  2173 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.588831 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:55.455799  2204 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.596100 31421 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:55.510335  2098 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.596580 31421 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:55.599934 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.538014  2122 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:55.591084 31498 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:55.599370 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.600625 31424 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:55.539474  2162 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.607862 31422 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:22:55.609056 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.598960 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:55.625847 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:55.626838 31492 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:55.628070  2019 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:55.634326 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:55.636289 31494 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:55.568608  2218 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.656184 31495 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:22:55.657130 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 128348us
I20260709 12:22:55.526515  2044 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.667064 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.667426 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:55.667955 31423 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:55.668406  2007 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:55.668853 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:55.669005  2007 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:55.670403 31423 pending_rounds.cc:85] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 5
I20260709 12:22:55.670101  2007 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.670774 31423 pending_rounds.cc:107] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 12:22:55.671193 31423 raft_consensus.cc:2917] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 12:22:55.671615 31423 raft_consensus.cc:2889] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.678436  2087 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.635313  2019 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:55.687986  2019 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.688628  2218 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:55.641026  2071 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:55.691260  2071 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:55.692459  2071 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.656560  2084 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.696939  2084 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.698655  2045 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.700903  2078 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.701579  2078 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.704080  2078 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.711607  1738 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:55.711874  2204 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.712536  2056 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.714253  2056 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.714919  2112 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.719100 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:55.656986  2093 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.727766  2229 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:22:55.728030  2093 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.730343  2093 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:55.739871 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.663345 31421 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.750718 31498 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:55.751099 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 259453us
I20260709 12:22:55.751869 31421 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.740031  2034 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.700906  2045 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:55.788487 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:55.793082  1968 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:55.793565 31492 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:55.793794  1968 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.794701 31415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:55.795459 31415 raft_consensus.cc:606] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:55.795770 31415 raft_consensus.cc:614] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:55.796029  1968 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:55.797412 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.797930  1982 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.799799  2098 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.801316  2044 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.801851  2122 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:55.722576  1921 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.808329 31498 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:22:55.810204 32080 leader_election.cc:400] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6.
I20260709 12:22:55.813140 32080 leader_election.cc:403] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:22:55.812637 31498 pending_rounds.cc:85] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 3
I20260709 12:22:55.816286 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:55.816929 31498 pending_rounds.cc:107] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:22:55.744699  2162 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.817425 31498 raft_consensus.cc:2889] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:55.818778 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:55.832259 31415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:55.833006 31415 raft_consensus.cc:606] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:55.803645  1858 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:55.748901  2051 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:55.822448  1982 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:55.793731  2034 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:55.835630 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:55.840510 31569 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:55.831370  2143 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6.
I20260709 12:22:55.847342  1982 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.861397 31495 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:55.878925  1982 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:55.882274 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.885783  1921 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:55.889583 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.872234  2232 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 12:22:55.877331 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:55.901770 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.938831 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:55.943957 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.951095 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.951776 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:55.952358 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:55.955901 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:55.889683  2084 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:55.936589  2051 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.983083 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:55.997256 31495 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:55.987262 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 146093us
W20260709 12:22:55.988059 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:55.946949  2179 consensus_meta.cc:287] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.004s
I20260709 12:22:56.002586 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:55.982234 31422 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:55.975013 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:55.987651 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 110455us
I20260709 12:22:56.006896 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.008558 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.009492 31497 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:56.010954 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.011300  2162 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.011982  2162 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:56.012372 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:56.013775 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:56.014935 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:56.015407 31500 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:22:56.016832 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.017534 31500 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:56.019481 31417 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.023028  2098 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:56.023602  2098 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:56.024505  2098 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.024531  2179 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.006944 32108 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:22:55.985814  1953 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.001s
I20260709 12:22:56.026986  2052 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:55.964860 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:56.028690 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.028767 31415 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:56.031491 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.032167 31494 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:55.964573 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:55.963948 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.965281  1643 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.977909  2087 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.975725 31491 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:56.034457 31416 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:56.010435 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.037310 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.038059 31500 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:56.036278 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.045639 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:56.045594 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.046489 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:22:56.053380 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 147477us
I20260709 12:22:55.959700  2093 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.959339 32110 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:22:56.058539 31493 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:22:56.060021 31418 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:56.066776 31493 pending_rounds.cc:85] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 3
I20260709 12:22:56.067129 31493 pending_rounds.cc:107] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:56.067417 31493 raft_consensus.cc:2889] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.059350 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:56.068316 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.068465 31494 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:22:56.069126 31571 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.072043 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.068897 31497 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:56.068933  2029 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:56.074826 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.075598 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.076308  1953 raft_consensus.cc:993] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:56.068899 31494 pending_rounds.cc:85] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 5
I20260709 12:22:56.076783  1953 raft_consensus.cc:1081] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:56.077021 31494 pending_rounds.cc:107] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:22:56.077288 31494 raft_consensus.cc:2889] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.078449 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.079007 31494 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:56.079931 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.080935 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.081478 31494 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:22:56.074282  1982 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.081429 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.075076  2029 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.083374 31415 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:56.027105  1858 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:22:56.034749  2204 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.084112 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.099166 31495 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:56.052140  2112 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:56.059468  2162 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:56.103098 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74408.2us
I20260709 12:22:56.067939 31421 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:56.102365 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.114346 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.108440 31565 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:56.112804 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.116464 31493 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:56.116676 31494 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:56.120820 32105 raft_consensus.cc:2368] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:22:56.137706 31570 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:56.140388 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:56.143749 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.145486 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.148099 31493 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:56.102289  2029 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.051693  1643 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.153291 31573 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:22:56.154983 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.115193  2045 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:56.108456  2112 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.118853  2162 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.154829 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.170908 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.164462  2078 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:22:56.175797 31565 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:56.160454 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:56.180315 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 109752us
I20260709 12:22:56.151341  2179 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.162312  2045 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.117944  2204 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.192070 31569 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:22:56.204792 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.192871 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:56.206372 31493 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:56.193656 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.190263 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.173668  2112 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.199865 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.209900 31417 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:56.166481  2093 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:56.146400  2173 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:22:56.176743  2162 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:56.212221 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46115.3us
I20260709 12:22:56.214133 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.214896 31416 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:56.215764 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.216367 31572 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:56.217691 31421 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.215330 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.220809 31418 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:56.223810 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:56.195477  2170 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.226200 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:56.203835  2045 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:56.208221  2195 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.235208 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:56.234786 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 180309us
I20260709 12:22:56.240185 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.242838 31500 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:56.252069 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.255970 31493 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:22:56.258539 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:56.267128 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 231243us
I20260709 12:22:56.271727 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:56.274405 32108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:22:56.221349  2093 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.237620  2195 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:56.245057  2084 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.278590 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.280939 31573 raft_consensus.cc:2410] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:56.275206 32108 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.293707 32111 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: Advancing to term 9
W20260709 12:22:56.294662 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.265105  2216 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:56.237440  2170 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:56.313045 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99976.4us
I20260709 12:22:56.318864 32107 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.319985 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:56.322546 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 153608us
I20260709 12:22:56.324360 31573 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:56.329983 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88214.2us
I20260709 12:22:56.332252 31572 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:22:56.335235 31565 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:56.302886  2179 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.318275 31492 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:56.329929  1982 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.300082  2084 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.347815 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.345614 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.356456 32109 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:56.357321 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:56.357581 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.345636 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.358098 31422 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:56.355628 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:56.345782 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.367188 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:56.367841 31573 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:22:56.384713 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.397296 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.397711 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:56.398089 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.403820 31492 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:56.394111  2257 raft_consensus.cc:993] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:56.343335  2179 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.344605  2261 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:22:56.420827 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.422499 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.404748  2098 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.427589 31569 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:22:56.428129 31569 pending_rounds.cc:85] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 6
I20260709 12:22:56.428400 31569 pending_rounds.cc:107] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:22:56.405409  1643 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.404871  2204 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.428764 31569 raft_consensus.cc:2889] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.406133 31573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:22:56.434857 31573 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.435338 31573 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.436015 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.436394  2273 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:56.437073 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:56.436915  2273 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.437317 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.437884 32107 raft_consensus.cc:2410] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:22:56.438083 32105 raft_consensus.cc:2410] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:56.432828 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.427328 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:56.419605  2257 raft_consensus.cc:1081] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:22:56.367460  2195 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.447275 32106 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:56.428460  2262 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.462844 32106 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:56.444834  2248 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:22:56.471405 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.464968 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:56.464625 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.483724 32108 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
W20260709 12:22:56.490211 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.478616  2204 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.479651  2093 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.488587  2264 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:22:56.479095  2266 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:22:56.463253  2216 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:22:56.506348 31499 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.499389 32111 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:22:56.429947  2098 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.470556  2262 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:56.500198  2241 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 12:22:56.502117  2254 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:22:56.535252  2252 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 12:22:56.535903  2112 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.536686 31465 leader_election.cc:400] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:56.545912 31465 leader_election.cc:403] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.488355  2170 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.543637 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:56.494220  2265 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 12:22:56.492861  2273 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:56.585382 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.585592 32112 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:22:56.586148 32112 pending_rounds.cc:85] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 7
I20260709 12:22:56.587247 32112 pending_rounds.cc:107] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:22:56.495719  2204 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.541283  2143 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:56.587509 32112 raft_consensus.cc:2889] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.588747  2179 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.511426  2268 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:22:56.590263  2262 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.591482  2274 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:56.592726 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 113058us
W20260709 12:22:56.594357 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50808.4us
W20260709 12:22:56.595155 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 58616.8us
I20260709 12:22:56.598472 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.596653  2257 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:56.594009  2143 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:56.598361  1919 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.607836 31569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:22:56.608417 31569 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.608734 31569 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.611462 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.623807  2279 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:22:56.625949  2253 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.280s	user 0.003s	sys 0.000s
I20260709 12:22:56.632332  2173 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:22:56.634385 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 289694us
I20260709 12:22:56.635349 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.637207 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.639607  1953 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:56.640717  1953 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.642925  2078 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:56.643177 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 258587us
I20260709 12:22:56.612545  2051 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.644389  2051 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.645521  2216 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:56.645880  2216 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:56.646056 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.646621  2216 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.647111 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2630) took 1067 ms. Trace:
I20260709 12:22:56.648502  2056 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.649044  2051 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.650347  2195 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.649245  2056 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:56.643369  2078 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.647997  2216 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:56.651058 31537 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.624s (SENT)
I20260709 12:22:56.647465 31423 rpcz_store.cc:276] 0709 12:22:55.580007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.669605 (+ 89598us) service_pool.cc:224] Handling call
0709 12:22:55.670171 (+   566us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.679156 (+  8985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.679189 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:55.679804 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.084682 (+404878us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:56.084716 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.084775 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.646897 (+562122us) raft_consensus.cc:1685] finished
0709 12:22:56.646922 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.647055 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6383,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":404523,"threads_started":1,"wal-append.queue_time_us":492765}
I20260709 12:22:56.663539 31491 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:56.667655  2098 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.600064  2262 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7.
I20260709 12:22:56.670814  2143 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.672732 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:56.673625 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.678062 31415 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:56.679342 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.680549 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.678953 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.683279 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:56.687107 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.613036  1919 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.602207  2274 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.690600  2084 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:56.697395  2245 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.558s	user 0.000s	sys 0.003s
W20260709 12:22:56.698542 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 100141us
I20260709 12:22:56.747745  2122 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:56.747978 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.748703  2056 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:56.749001 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.749258  2056 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.686852  2078 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.606436  2261 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:56.697383 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:56.746978 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66583.9us
I20260709 12:22:56.728510 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.695516  2112 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.696753  2268 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:22:56.682605  2253 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.003s
I20260709 12:22:56.696615  2204 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:56.735416  2029 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 12:22:56.703147 31422 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.750645 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:22:56.755151 31493 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:56.756582 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.742306 31569 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:56.757035 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 73835.9us
I20260709 12:22:56.755949 31565 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
W20260709 12:22:56.753014 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 101985us
W20260709 12:22:56.775704 31537 leader_election.cc:336] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.506s (SENT)
W20260709 12:22:56.755507 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 76675.3us
W20260709 12:22:56.763218 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 151821us
I20260709 12:22:56.772058  1982 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.781121  1982 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.781522  1982 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.781749 31569 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.755663  2273 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.782321  2273 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:56.752473  2056 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.770453 31493 pending_rounds.cc:85] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 3
I20260709 12:22:56.783584 31493 pending_rounds.cc:107] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:56.783890 31493 raft_consensus.cc:2889] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.784111 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.785559 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.682008  2007 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.755349  2261 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.753472  2122 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:56.756251  1919 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.758467  2271 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:56.750969  2272 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.786558 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.802091 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.799961 31387 leader_election.cc:400] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:22:56.815213 31387 leader_election.cc:403] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.794354 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:56.765221 31573 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:56.811331 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.819759 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.822696 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.824013 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:56.761662  2029 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.840453  2029 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.778865  2262 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:56.841269  2262 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:56.841686  2262 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:56.843966  2162 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.002s
I20260709 12:22:56.844648  2282 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:56.845121  2282 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.844506  2162 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.845547  2282 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.846170 31497 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:56.782701  2273 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.849117 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:56.851797 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57533.2us
W20260709 12:22:56.855685 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53826us
I20260709 12:22:56.761171  2143 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.787189  2071 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:56.786917  2087 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:56.795038  2152 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.872736 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.873298 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.872501 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.812054  2271 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.876674 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:56.868746 31565 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.877454 31569 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.789990  2261 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:56.786767  1953 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:56.862457 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:56.787959  2237 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:56.787695  2204 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:56.871150 31573 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.867506 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:56.890380 31422 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.794718  2173 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:22:56.849397  2272 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.868590 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:56.879019 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.786655  2007 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.713182  2045 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.857491  2056 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.855314  2268 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.883956 32105 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.794310  1921 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:22:56.875885 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:56.794521  2044 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:22:56.866982  2029 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:22:56.897358 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:56.811100  2179 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:22:56.874020  2170 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:56.869706  2071 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:56.940889  2071 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.942895  2291 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:56.879601  2280 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.944522  2291 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:56.903283 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.896641  1982 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.872483  2274 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.880504  2271 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.945113  2291 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:22:56.917603 31463 leader_election.cc:336] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.871s (SENT)
I20260709 12:22:56.946772  1982 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:56.946906 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.949450 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:56.894137  2204 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.880352  2122 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:22:56.936272 31569 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:56.928228  2029 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.939086  2283 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:22:56.940229  2007 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:56.874505  2087 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.969722 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 332179us
I20260709 12:22:56.927383 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:56.954571 32105 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:56.907509  2112 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.902690  2272 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:56.959337 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56134.1us
I20260709 12:22:56.904544  2257 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:22:56.884394  2084 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:22:56.923899  2268 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:56.879940  2152 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:56.958652  2204 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:22:56.975927 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48665.5us
I20260709 12:22:56.960597  2029 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:56.985245 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:56.978641 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 140692us
I20260709 12:22:56.986799 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:56.981810 31422 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:56.971983  2087 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.906728  2292 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:22:56.991504 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:56.971424  2274 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.992468 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:56.982893  2051 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.995675  2290 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 12:22:56.996300 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78729.8us
I20260709 12:22:56.970355  2261 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.006546 31416 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:56.975579  2280 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:56.971086  2170 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:56.974918  2044 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:56.994323 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:57.003568 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.009863 31494 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.010212 31500 raft_consensus.cc:2410] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:22:56.988822  2007 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.003895 32108 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:57.000587 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.011133 31421 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.003229 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:57.013688 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.014281 31420 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:22:57.015707  2007 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.016290 31499 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:56.979252  1919 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:22:57.018633 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.000622  1982 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.055451 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:57.056950 31491 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:57.058934 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.059698 31416 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.063450 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.064205 31418 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:57.070484 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 70813.8us
I20260709 12:22:57.013752  2257 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.070849  2300 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:57.070372  2303 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:22:56.946429  2291 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.000936  2179 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:22:57.095865 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 109129us
I20260709 12:22:57.015202  2044 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.070370 31463 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.079203 31421 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:57.038882  2112 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:57.055153  2280 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.009255  2274 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:57.085628 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107872us
I20260709 12:22:57.096635 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.076804  2264 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:57.095948  2170 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.098598 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.098658 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.116740 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.099346 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.100407  2179 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:57.102979  2267 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.103132  2285 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:57.104193  2287 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:22:57.082399  2279 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:22:57.104787  2044 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.098062 32110 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:57.108403 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:57.110189 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:22:57.111513 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.077235  2162 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:57.112840 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 120467us
I20260709 12:22:57.137570 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.116892 32114 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.113189  2264 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:57.124300 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.091018  2302 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.117340 32109 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:57.128636 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 125469us
I20260709 12:22:57.080564  1858 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:22:57.107484  2284 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:57.114411 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.102768  2112 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.117367  2290 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.142771 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.147656 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:22:57.157379 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.125272  2007 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.132328  2152 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.146802 32109 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:57.084146  2257 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.130893  2045 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.124004  2093 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.132838  2179 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:57.111944  2280 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.145963  2264 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.163442 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.176853 31416 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
W20260709 12:22:57.188817 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 46186.3us
I20260709 12:22:57.189924 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.150657  1919 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.142305  2098 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:22:57.161003  2112 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.129369  2271 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:57.172448  2293 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.002s
I20260709 12:22:57.202121 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.202814 31416 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 4.
I20260709 12:22:57.181915  2299 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.213490  1533 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.195114  1919 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.217002  1919 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.217046  2071 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.191967  2029 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.219280  2071 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:57.220242 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78228.7us
I20260709 12:22:57.132505  2267 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.185870  2007 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:22:57.183446  2303 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:22:57.203377  2093 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.225533 32109 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.256321 31416 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:57.172574  2294 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 12:22:57.140348  2285 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.261343 32109 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.222760  2029 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:22:57.263756 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 73927.8us
I20260709 12:22:57.265810 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.155633  2302 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.239045  2305 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.286194  2267 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.286051  2305 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.223096  2299 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.287699  2302 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.230718  2304 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:57.273795  2286 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.430s	user 0.002s	sys 0.000s
I20260709 12:22:57.288710  2299 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.277926  2272 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.292089  2272 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.280705  2262 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.282119  2257 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.282552  2179 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.295112  2271 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.295881  2274 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:57.296013  2262 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.238862  2307 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:22:57.293736  2087 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.301069 31572 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:57.304877  2264 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:57.284593  2216 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.003s
I20260709 12:22:57.306905  2280 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:57.340747  2195 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.003s
I20260709 12:22:57.341845 31417 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:22:57.342764 31418 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:22:57.343875 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78161.9us
I20260709 12:22:57.345412 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.348333  2267 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.348996  2267 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.285296  2056 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:22:57.233613  2308 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:57.352103  2308 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:57.353051  2308 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.355260  2291 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.320909  2071 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:57.324357  2285 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.266063  2294 consensus_queue.cc:1243] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:22:57.328104  2309 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:22:57.329733  2310 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:22:57.230263  2312 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:22:57.333420  2282 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.228225  2268 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.364704 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.308367  2087 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.367689 32107 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:57.395045 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.371308 31494 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:22:57.372789 32114 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
W20260709 12:22:57.223919 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 95884.1us
I20260709 12:22:57.300736  2112 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.376812 32109 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:57.398769 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.417768 31415 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:22:57.397383 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:22:57.418637 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 236073us
I20260709 12:22:57.421401 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.421782 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.422255 31417 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:22:57.384393 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 251005us
I20260709 12:22:57.426435  2300 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:57.432924 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.372840  2071 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:57.377769  2304 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:57.441896 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.396534  2162 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:22:57.442807 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 213416us
I20260709 12:22:57.444521 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.453842 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.414161  2051 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.400831  2266 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.468971  1919 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.474988  2266 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:57.477097  2266 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.477628  1919 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.378955  2271 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:22:57.454442 31418 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:57.445689 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.479717  2282 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:57.457146 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.457435 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.480621 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.459079  2071 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.481205  2112 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.481684 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.481914  2071 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.482966  2311 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:57.484555  2311 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.485144  2311 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.461305 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:22:57.439043  2078 consensus_meta.cc:287] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
I20260709 12:22:57.454914 31421 raft_consensus.cc:606] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:57.486163  2078 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.467352 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.482422  2292 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:57.488420  2078 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.434361  2272 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:57.489249  2292 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:57.489846  2272 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:57.467576  2093 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.467694  2317 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.452482 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.467981  2268 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:57.490798  2315 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:22:57.492416  2261 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.491844 31419 raft_consensus.cc:2410] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:22:57.468948 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.493680 31416 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.490975  2093 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.495342  2304 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.496483  2093 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.497032 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:57.293766  2273 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.419598  2019 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.414588  2173 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:57.479641 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.467018  2262 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.489058 31423 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:57.440311  2264 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.491678  2268 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.455767  2303 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:22:57.501480 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46321.4us
I20260709 12:22:57.524724 31494 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:57.501704 31416 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:22:57.461856  2204 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.499301 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.508545 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.535341 31418 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:57.511281 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.536456 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.537966 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.538545 31418 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.534641 32080 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.545339 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.544466 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.547556 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.548149 31497 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:57.549276 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:57.549994 31498 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.512636  2122 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:57.564049 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.547339 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.565197 31492 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:57.553951 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.566154 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.566782 31495 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:57.554522 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.568507 31419 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.569491 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.570657 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.505053  2173 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.455078  2300 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:22:57.513304  2305 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.567567 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:57.559845 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.562740 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.564054 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.573411 31418 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:57.580533 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.581259 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.583343 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.544158  2279 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:57.547924  1953 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.554435  2261 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:57.543912  2056 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.557201  2264 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:57.586030 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.587193 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:22:57.607661 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45020.9us
I20260709 12:22:57.505412  2170 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:22:57.582928  2173 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:57.556071  2051 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:22:57.589610 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:57.572209  2122 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.593011  2296 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:57.512329  2019 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.587859  2112 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.595403  2315 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:57.596055  2316 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.571415  2282 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.652835 31417 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:22:57.518079  2262 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.609002 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:57.575680  2271 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:57.583711  2317 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:57.556663  2257 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:57.577966  2303 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:57.627106 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:57.665668 31424 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:57.563623  2195 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:22:57.598901  2261 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.594672  2268 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:57.635421 32108 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.636643  2290 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:57.612133  2264 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.551046  2272 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:57.656184 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47328.5us
I20260709 12:22:57.657614 31419 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:57.666460  2170 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:57.628957  2122 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.666002 31424 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:57.673094  2204 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:57.603886  1953 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.604669  2279 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:57.675598 31497 pending_rounds.cc:85] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:22:57.611865  2056 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.647671  2292 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.678102 31493 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:22:57.664163 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.677328  2257 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:57.680451 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.663496  2300 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.686597 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.673813  2261 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.673410  2273 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:22:57.682739  2034 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:22:57.682559  2290 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:57.703426 31497 pending_rounds.cc:107] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:22:57.729635 31497 raft_consensus.cc:2889] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:57.665257  2317 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.686079  2170 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.671236  2282 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.681555  2264 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.663453  2316 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.712163 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.707254 31424 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.681025  2271 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:57.714277 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.663697  2315 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.729347  2266 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:22:57.735286 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 126876us
I20260709 12:22:57.712981  2294 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.713778  2321 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.742362 31417 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:57.744168 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.748699 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:57.749822 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.750813 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.751654 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.752862 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.732975  2317 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.683696  2303 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.738849  2170 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.753502 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:57.762429 31567 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:22:57.771006 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.761731 31568 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:22:57.743736  2195 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:57.766367 31417 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:57.767985 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 4.
I20260709 12:22:57.771808 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:57.803931 31416 raft_consensus.cc:2410] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:22:57.769438 31572 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:57.747845  2087 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.759356  2294 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.747565  2056 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.836791 31569 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:22:57.815433 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:57.713835  2292 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.831310 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.839188 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.841014 31416 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:57.845480 31573 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:57.846125 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:57.846645 31567 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:57.848587 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.857481 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:57.858333 31416 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 12:22:57.730441  2300 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:57.859892 31416 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: [2.2-6.3]
I20260709 12:22:57.858264 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:57.759040  2266 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.803164  2195 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:57.844395  2324 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.173s	user 0.000s	sys 0.014s
I20260709 12:22:57.842602  2093 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.840334  2294 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.872747 31572 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.769865  2279 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:57.877391  2325 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:22:57.879161  2329 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:22:57.879791  2327 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:22:57.924068  2093 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:22:57.880307  2328 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:22:57.865409  2337 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:22:57.758829  2290 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.904735  2112 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:57.928543 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:57.954332 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:57.871438  1953 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.911000  2271 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.845547  2304 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:57.912079  2330 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:57.958750  2304 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:22:57.887137  2262 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:57.912117  2179 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:57.965431  2179 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:57.965210  2304 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.958775  2336 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:57.966769  2336 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:57.966415  2179 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.914036 31568 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:57.935868 32113 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:57.864034  2087 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:57.839375  2257 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.887717  2195 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.964037  2112 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:57.959311  2014 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:22:57.978608 31568 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:57.978952  2014 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:22:58.043685 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.084493 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 317692us
I20260709 12:22:58.086987 31499 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:58.092018  2112 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.098290 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.100468 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
W20260709 12:22:58.111785 31498 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.005s
I20260709 12:22:58.112201 31498 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:22:58.019853  2179 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.089697  2285 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.967603  2336 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.127703  2019 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.127899  2336 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.092962  2034 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.149222 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.148344 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.157759 31416 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:58.149041 31494 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:58.171386 31568 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:58.183987 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.199504 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.207263 31568 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:22:58.195029  2112 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.208670  2112 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.210867  2314 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.997s	user 0.004s	sys 0.001s
I20260709 12:22:58.211362  2112 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.163998  2034 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.212770 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 500) took 1221 ms. Trace:
I20260709 12:22:58.213272 31415 rpcz_store.cc:276] 0709 12:22:56.991120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.991262 (+   142us) service_pool.cc:224] Handling call
0709 12:22:58.212496 (+1221234us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400351bd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:58.212666 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804915584}
I20260709 12:22:58.214366  2034 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.133725  2285 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.217648  2285 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.218096 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.201050  2282 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.174152  2300 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.218844 31496 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:58.218201 31424 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:58.225036  2315 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.225700 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 592) took 1234 ms. Trace:
I20260709 12:22:58.225926  2291 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:58.226440  2291 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:58.226094 32105 rpcz_store.cc:276] 0709 12:22:56.990855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.991108 (+   253us) service_pool.cc:224] Handling call
0709 12:22:57.005108 (+ 14000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:57.005457 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.005488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:57.013316 (+  7828us) log.cc:844] Serialized 52 byte log entry
0709 12:22:57.213163 (+199847us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:57.213203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.215019 (+  1816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.210255 (+995236us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:58.220706 (+ 10451us) raft_consensus.cc:1685] finished
0709 12:22:58.220742 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.225637 (+  4895us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":384,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5473,"spinlock_wait_cycles":30984448,"thread_start_us":132236,"threads_started":1,"wal-append.queue_time_us":151876}
I20260709 12:22:58.228919 31571 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:22:58.173416  2335 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:22:58.240212 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.241012 31571 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:22:58.199595  2339 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:58.247817 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:22:58.280705 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.231978  2071 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.750s	user 0.016s	sys 0.006s
W20260709 12:22:58.233527  2173 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.006s
I20260709 12:22:58.297667 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.299517 31418 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:22:58.227277  2284 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:58.231634  2292 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.301609 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:58.182917  2262 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:22:58.133978  2014 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.286870  2267 consensus_meta.cc:287] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.937s	user 0.016s	sys 0.006s
I20260709 12:22:58.288709  2308 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.328611 31571 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:58.305096  2311 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.820s	user 0.006s	sys 0.013s
I20260709 12:22:58.305949  2087 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.311134  2268 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:58.308877  2284 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.330569  2267 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:58.375886 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 213760us
I20260709 12:22:58.365372  2311 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:58.339109  2266 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.372635  2268 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.304675  2173 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.406216 31463 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.609s (SENT)
I20260709 12:22:58.411110 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:58.373562  2093 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.414084 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:58.379833  1533 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.341308  2308 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.425288 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.427448 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.430393 32108 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:58.409979  2268 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.437783 31422 raft_consensus.cc:606] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:22:58.445050 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.455444  2347 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:22:58.431602  2093 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.471547 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:22:58.478753 31415 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:58.480114 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.478431 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:58.430126  2352 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:58.487684 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:58.443301  2122 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.012s
I20260709 12:22:58.499732 31500 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:22:58.502424 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.503110 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.503705 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.507690 31421 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:22:58.507886 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.508939 31492 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:58.509490 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:58.504474 31567 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.004s
I20260709 12:22:58.510087 31421 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:58.510183 31567 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
W20260709 12:22:58.510854 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.511901 31416 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:22:58.513761 31496 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:58.514710 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.516893 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.522094 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.522881 31494 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:22:58.524760 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.525574 31497 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:58.526788 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:58.431092  1533 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.533389 31491 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:58.539233 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.540027 31496 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:22:58.543495 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.512210  2285 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:58.524453  2311 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.507362  2355 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:58.555581 32109 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:58.549088 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:22:58.511528  2122 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.560966 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.562482 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.562958 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.563532 31495 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.563886 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.564652 31497 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:58.565680 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.566874 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.567391 31500 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.571018 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.572194 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.573674  2358 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:58.574853  2344 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:58.575384  2344 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:58.575814  2344 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:58.579879 31496 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:22:58.566346 31497 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:22:58.587963 31495 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:58.558041 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:22:58.597930 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 172989us
I20260709 12:22:58.593747 31500 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:22:58.602851 31500 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:22:58.604550  1921 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:58.605331  1921 consensus_queue.cc:1243] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:58.622224 31491 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:58.547258  2071 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:22:58.623656 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.623579 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.625656 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:58.507846  2352 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.594875  2093 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:58.631712 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.635505 31424 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:22:58.557601  2292 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:22:58.557400  2300 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:22:58.583009  2282 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:22:58.636710 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1542) took 1126 ms. Trace:
W20260709 12:22:58.632594 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147111us
I20260709 12:22:58.615645  2285 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:58.646546 31568 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:22:58.648306  2363 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:22:58.646983 31424 rpcz_store.cc:276] 0709 12:22:57.509978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.604071 (+ 94093us) service_pool.cc:224] Handling call
0709 12:22:58.218041 (+613970us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5800875cd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196bf0aa 00007fc119741447 00007fc119759fe7 00007fc11975b7de 00007fc11976727c 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c
0709 12:22:58.636657 (+418616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888200960}
W20260709 12:22:58.656440  2317 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.884s	user 0.016s	sys 0.000s
I20260709 12:22:58.658249  1533 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.659422 31494 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:58.661119  2308 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.694142  2321 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:22:58.663239  2170 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.854s	user 0.020s	sys 0.000s
I20260709 12:22:58.697094  2321 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.697242  2170 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.699450  2321 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.699950  2170 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.690955  2285 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.665221  2261 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.935s	user 0.004s	sys 0.014s
I20260709 12:22:58.700879  2261 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.702026  2285 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.703393  2261 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.703914 31497 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:58.596204  2355 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.705729  2264 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.961s	user 0.014s	sys 0.006s
W20260709 12:22:58.720257 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51018.3us
I20260709 12:22:58.720973 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 728) took 1159 ms. Trace:
I20260709 12:22:58.667716  2122 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.668200  2316 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:58.669939  2352 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.597697  2349 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:22:58.635916 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 123146us
I20260709 12:22:58.670307 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.594959  2311 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.620784  2358 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:58.639550  2305 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:58.661963  2173 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.706722 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1483) took 1169 ms. Trace:
I20260709 12:22:58.707701  2355 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:22:58.666603  2195 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
W20260709 12:22:58.708235  2179 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
I20260709 12:22:58.709832  2284 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.713214  2268 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.712438  2344 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:58.718144  2341 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.479s	user 0.000s	sys 0.002s
I20260709 12:22:58.641341  2093 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.719653  2359 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:58.721402 32109 rpcz_store.cc:276] 0709 12:22:57.561630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.598449 (+ 36819us) service_pool.cc:224] Handling call
0709 12:22:57.623267 (+ 24818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.556213 (+932946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.720695 (+164482us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54003f8c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:58.720898 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143525760}
I20260709 12:22:58.670739  2087 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:58.769544  2087 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.770097  2087 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.761649  2195 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.743924 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 502) took 1727 ms. Trace:
I20260709 12:22:58.746608 31493 rpcz_store.cc:276] 0709 12:22:57.523652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.539577 (+ 15925us) service_pool.cc:224] Handling call
0709 12:22:58.692546 (+1152969us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b5400013954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:58.692692 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225933696}
W20260709 12:22:58.742508  2320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.000s	sys 0.017s
I20260709 12:22:58.764922 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:58.728530 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.776420 31423 rpcz_store.cc:276] 0709 12:22:56.999165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.999904 (+   739us) service_pool.cc:224] Handling call
0709 12:22:57.012050 (+ 12146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.517833 (+505783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.726067 (+1208234us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54003511d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:22:58.726278 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096456064}
I20260709 12:22:58.777213 31568 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:58.724193  2257 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:22:58.746227  2305 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:58.775583 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.720798  2317 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:58.785478 31573 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:58.724247  2264 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.785758 31390 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:58.769692  2359 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:58.773916  2294 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.855s	user 0.015s	sys 0.000s
W20260709 12:22:58.782747  2320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.000s	sys 0.018s
I20260709 12:22:58.825410  2317 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.823199 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.826505 32107 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:58.818784  2349 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:58.827459  2349 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:58.828321  2349 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.829540  2349 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.819229  2305 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.786751  2173 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:58.822436 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.783198  2179 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:22:58.823191 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.823372  2034 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:58.818801  2285 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.823483 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 265506us
W20260709 12:22:58.815994  2336 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.004s
I20260709 12:22:58.840709  2285 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.841197  2336 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:58.841866  2336 consensus_queue.cc:1243] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:22:58.843356  2285 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.843732  2344 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.844046 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.845198 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.845397  2268 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.845860 31571 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:58.846119  2358 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.756250  2371 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:22:58.822820  2170 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:22:58.847994  2170 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:58.846977 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.791628  2359 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:58.846582 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.849474 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.850114 31568 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:58.835899 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.839740 32109 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:22:58.846956  2303 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.857296 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.833851 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:58.858444 31568 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:22:58.822824  2014 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.864100 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.865538 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.837723  2352 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:58.868928 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.876012  2093 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.848937  2170 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.877012 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.877926 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.856702  2305 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.880802 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.882376  2381 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:58.888924 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:58.891294 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.892019 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.897413 31567 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:58.861680  2285 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:58.909437 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:58.913692 31497 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.911070 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.832168  2294 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:58.838590  2375 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:22:58.866488  2034 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:58.917222 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.921591 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.926911 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.894920  2344 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:58.888868  2386 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:22:58.928898  2264 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.881505  2352 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:58.856448  2179 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.939293 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.940841 31568 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:22:58.941491 31419 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:22:58.943845 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.944973 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.917768  2285 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.948987  2285 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.951953  2311 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.955253  2195 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.945923 31567 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 5: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:58.957470 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.898176  2291 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.947801  2294 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:58.948472  2179 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:58.880690  2014 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:58.919651  2308 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:58.964337 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1512) took 1210 ms. Trace:
I20260709 12:22:58.978852 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:58.980077 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:58.983121 31568 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:58.981655 31569 rpcz_store.cc:276] 0709 12:22:57.753873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.849931 (+ 96058us) service_pool.cc:224] Handling call
0709 12:22:57.926844 (+ 76913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.968443 (+ 41599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.968470 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.968508 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:57.968538 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.968589 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.964146 (+995557us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b5400058050. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:58.964273 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175432064}
I20260709 12:22:58.963616 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:58.936443  2381 consensus_queue.cc:1243] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:58.936992  2290 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.992794 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:22:58.995106 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.996035 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.960930  2296 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:22:59.008832 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65301.1us
I20260709 12:22:59.025607 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:58.972329  2284 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:59.011067 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:59.011696 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:22:58.984349  2308 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.072361 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:59.080117 31569 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:59.073561 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48066.4us
I20260709 12:22:59.078272 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:22:59.034097 31568 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:59.073803 32107 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:22:58.944133  2336 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:22:59.088322 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:59.092551 32105 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:59.095645 31567 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:59.090443 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:59.007068  2268 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.071738  2381 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:59.010385  2291 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.102821 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:58.963176  2352 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.024853  2296 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:59.077455  2122 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:59.118989  2014 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:59.079298  2316 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.119676  2316 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.121733  2316 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:59.085664  2308 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.123006 31568 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:59.118698  2087 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.072304  2385 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.111837 31569 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:22:59.107678  2351 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.674s	user 0.005s	sys 0.000s
I20260709 12:22:59.143930 31570 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:59.148056 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:22:59.148754 31569 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:59.145036 31570 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:59.109299  2379 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:59.110060  2284 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.154016 31566 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:22:59.099730  2290 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:22:59.135923  2264 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:59.158838 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 276637us
I20260709 12:22:59.154775 31570 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.164172 31570 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.164553 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:59.165357 31492 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:22:59.170145 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.172411 31494 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:22:59.175675 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:59.176442 31499 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.152930  2379 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.116882  2268 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.185523 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:59.187629 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:59.187759 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:59.188300 31494 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.195693  2359 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.197985  2359 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:59.187409  2093 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:59.203380  2392 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:59.204551  2296 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.211124 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:59.214139 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:59.218915 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:22:59.220347  2268 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:59.168078  2264 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:59.220788 31494 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:22:59.221644  2356 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.750s	user 0.001s	sys 0.002s
I20260709 12:22:59.221473  2264 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.222064 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:59.222643 31499 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:59.223194 31498 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:22:59.223191 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1518) took 1467 ms. Trace:
I20260709 12:22:59.225874 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:22:59.226459 31496 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.185364  2379 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.221683 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:59.232372 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142039us
I20260709 12:22:59.160312  2284 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.238485 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:59.251925 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:59.260780 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:59.186859  2285 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.227191  2044 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:22:59.632894 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.229565  2268 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.615310  2294 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.727813  2305 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.223800 31574 rpcz_store.cc:276] 0709 12:22:57.755427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.906327 (+150900us) service_pool.cc:224] Handling call
0709 12:22:58.010124 (+103797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:58.010600 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:58.010643 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:58.116536 (+105893us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.396464 (+279928us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:58.396508 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.396588 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.648997 (+252409us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b48001302d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:22:59.221129 (+572132us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:59.223003 (+  1874us) raft_consensus.cc:1685] finished
0709 12:22:59.223023 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.223131 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37969,"raft.queue_time_us":143,"raft.run_cpu_time_us":2923,"raft.run_wall_time_us":629707,"spinlock_wait_cycles":22551680,"thread_start_us":209983,"threads_started":1,"wal-append.queue_time_us":316746}
I20260709 12:22:59.728175  2294 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:22:59.743140 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2659) took 2234 ms. Trace:
I20260709 12:22:59.327224 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:22:59.743603 31419 rpcz_store.cc:276] 0709 12:22:57.508632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.686263 (+177631us) service_pool.cc:224] Handling call
0709 12:22:59.742372 (+2056109us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540010cf54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:59.743076 (+   704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820314368}
W20260709 12:22:59.699640 31497 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 12:22:59.750101 31497 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:22:59.383644 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41104 (request call id 13) took 1265 ms. Trace:
I20260709 12:22:59.752259 31497 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:59.729447 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 518389us
I20260709 12:22:59.322954 31496 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:22:59.742646 31417 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:59.420140 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:22:59.687672 31570 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:22:59.753635 31499 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8.
I20260709 12:22:59.753858 31570 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:22:59.398345  2303 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:22:59.350478 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.349310 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2494) took 1598 ms. Trace:
I20260709 12:22:59.404310  2320 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:59.730424 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 469725us
I20260709 12:22:59.730949 31571 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:22:59.397979  2393 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:59.289496  2290 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:22:59.752660 31492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.003s	sys 0.016s
I20260709 12:22:59.754225 31570 pending_rounds.cc:85] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
W20260709 12:22:59.786746 31492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.004s	sys 0.016s
I20260709 12:22:59.786832 31570 pending_rounds.cc:107] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:22:59.787202 31570 raft_consensus.cc:2889] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.758783 31565 rpcz_store.cc:276] 0709 12:22:57.750755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.751384 (+   629us) service_pool.cc:224] Handling call
0709 12:22:57.751722 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.752054 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.752081 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:57.752546 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:22:58.014913 (+262367us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:58.014949 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.015039 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:58.211219 (+196180us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:22:59.348835 (+1137616us) raft_consensus.cc:1685] finished
0709 12:22:59.348873 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:59.349218 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":642,"raft.queue_time_us":50735,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":27793,"spinlock_wait_cycles":9668224,"thread_start_us":261975,"threads_started":1,"wal-append.queue_time_us":333675,"wal-append.run_cpu_time_us":2336,"wal-append.run_wall_time_us":1127272}
W20260709 12:22:59.288084  2389 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:59.399937  2071 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:59.390764 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.790598 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.288828  2051 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:59.756757 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 429635us
I20260709 12:22:59.287282  2348 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.406179  2387 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:59.286916  2237 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.402628 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:22:59.807880 31491 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:22:59.433969  2306 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:59.751219 31422 rpcz_store.cc:276] 0709 12:22:58.085526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.085650 (+   124us) service_pool.cc:224] Handling call
0709 12:22:59.351108 (+1265458us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54002134d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11975d853 00007fc11e72b60a 00007fc117cb17d4 00007fc117cb1762 00007fc117cb1691 00007fc117cb160c 00007fc117cb08c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:59.351217 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774256512}
I20260709 12:22:59.436820  2087 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:59.287108  2370 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.262256  2359 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:22:59.760967 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:22:59.802973  2348 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:22:59.839251 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78352.9us
I20260709 12:22:59.790153  2071 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:59.263763  2336 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:59.283180  2122 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:59.615309  2273 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.433957  2093 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:22:59.765738 31497 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:22:59.789119  2303 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.766331 31571 pending_rounds.cc:85] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:22:59.767427 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:59.282716  2019 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:22:59.754956  2308 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 12:22:59.744071  2305 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.768869  2056 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:59.768930  2366 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:59.784631  2393 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.814121  2377 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.817301  2396 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:22:59.817749  2237 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.819212  2257 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:59.819933 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:22:59.820108  2282 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:22:59.823218  2284 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:22:59.824666  2285 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:59.825775 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1538) took 2316 ms. Trace:
I20260709 12:22:59.826475 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:22:59.831595  2296 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.831938  2294 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:22:59.795794  2344 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:59.803260  2387 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:22:59.913676 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:59.766233  2320 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:22:59.954931 31571 pending_rounds.cc:107] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:22:59.969514 31571 raft_consensus.cc:2889] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:59.954805 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 134941us
I20260709 12:22:59.878621 31420 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:59.954879 31417 rpcz_store.cc:276] 0709 12:22:57.509081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.833294 (+324213us) service_pool.cc:224] Handling call
0709 12:22:59.742478 (+1909184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.753127 (+ 10649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.825570 (+ 72443us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540010cf50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:22:59.825712 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4390013184}
I20260709 12:22:59.878016 31418 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:59.955770 31573 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.894954 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:59.877425 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:22:59.877030 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:22:59.957916 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 190547us
I20260709 12:22:59.845733 31565 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:22:59.971912 31421 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
I20260709 12:22:59.958279 31415 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:22:59.973368 31423 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:22:59.877323  2379 consensus_meta.cc:287] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.004s
I20260709 12:22:59.865080  2071 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.869906  2352 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.987020 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:22:59.812414  2306 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:59.956152  2279 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:00.013913 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.011682  2336 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:22:59.973259  2396 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.971748  2273 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.960410  2019 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.016711  2387 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.052915  2387 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.855607  2087 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.030963  2204 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.045152 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1530) took 1198 ms. Trace:
I20260709 12:23:00.051169 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.059911 31571 rpcz_store.cc:276] 0709 12:22:58.850862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.092449 (+241587us) service_pool.cc:224] Handling call
0709 12:22:59.115346 (+ 22897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.970071 (+854725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.044969 (+ 74898us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002503d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:00.045107 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399834496}
I20260709 12:22:59.842566  2290 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 12:23:00.029860 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:22:59.961548  2282 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.956239  2056 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:22:59.841446  2348 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.042917  2303 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:22:59.972868  2308 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:22:59.986261  2122 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:00.060403 31423 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.954348  2366 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.804807  2051 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.027313  2279 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.971869  2093 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.027899  2071 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.093950 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.168545 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.095680 31491 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:59.971580  2359 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.170403 31494 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:23:00.103652 31495 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:23:00.123767 31573 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:23:00.131121 31465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.505s (SENT) [suppressed 18 similar messages]
I20260709 12:23:00.043185  2316 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:00.141448  2385 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.135380  2294 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:00.136253  2044 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:59.848888  2370 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.141330 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:00.142822 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.197034 31424 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:00.197440 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:00.144889 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.198266 31497 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:00.144833  2306 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.145596  2019 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:00.146096  2056 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.148231 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:00.204535 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:00.204872 31500 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:22:59.960263  2377 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.033135  2369 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:23:00.164554 31422 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:00.132651  2204 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:00.021139  2379 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.133546  2337 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.147398  2366 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:00.181169 31321 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 274) took 19105 ms (client timeout 15000 ms). Trace:
I20260709 12:23:00.179445 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:00.204782  2344 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.189487 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.234807 32105 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:00.235203 32114 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:00.151170  2282 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.186542  2316 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:00.193835 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.163177  2279 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:00.194265 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.199918 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:00.201452 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.201609 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.187057  2348 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.201876 31424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:00.262913 31424 raft_consensus.cc:606] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:00.263404 31424 raft_consensus.cc:614] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:00.207675  2410 raft_consensus.cc:1064] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:23:00.212332 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.203724 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:00.151434  2291 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.218492 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.222412 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 573) took 1010 ms. Trace:
W20260709 12:23:00.224257 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 428870us
W20260709 12:23:00.187333 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 434142us
I20260709 12:23:00.233678  2306 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.236727  2034 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:00.237797 31416 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:00.124547  2320 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.241219 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1512) took 1065 ms. Trace:
I20260709 12:23:00.249879 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1510) took 1070 ms. Trace:
I20260709 12:23:00.254751 32108 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:23:00.261777 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 130683us
I20260709 12:23:00.215212  2056 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:00.265139 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 65319.2us
I20260709 12:23:00.269847 31496 rpcz_store.cc:276] 0709 12:22:59.212113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.753243 (+541130us) service_pool.cc:224] Handling call
0709 12:22:59.753535 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.753725 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:00.134701 (+380976us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.221940 (+ 87239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.222025 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:00.222098 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.222187 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.222335 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86859,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":101,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4615,"thread_start_us":436738,"threads_started":2}
I20260709 12:23:00.276162 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.309523 31415 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:23:00.135262 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 163951us
I20260709 12:23:00.226022  2406 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:00.194183  2385 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.238103  2315 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:00.232792  2204 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:00.345965 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.346699 31573 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:00.208539  2019 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.284072 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.290594 31494 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:00.197230  2336 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.237159  2396 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:00.307566 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.388792 31497 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:00.264420  2359 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.307947 31419 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:00.310634 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.392177 31572 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.311193 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.392943 31570 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.311921 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.394471 31568 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:00.395684 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.396739 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.268607  2237 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:00.227380 31321 rpcz_store.cc:269] 0709 12:22:41.137790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.186747 (+ 48957us) service_pool.cc:224] Handling call
0709 12:23:00.181064 (+18994317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:56.296636 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:56.464275 (+167639us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:56.475409 (+ 11134us) write_op.cc:435] Acquired schema lock
0709 12:22:56.479369 (+  3960us) tablet.cc:662] Decoding operations
0709 12:22:56.660543 (+181174us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:56.660682 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:56.660726 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:22:56.662560 (+  1834us) tablet.cc:701] Row locks acquired
0709 12:22:56.662622 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:22:56.769705 (+107083us) write_op.cc:270] Start()
0709 12:22:56.797854 (+ 28149us) write_op.cc:276] Timestamp: P: 1783599776682783 usec, L: 0
0709 12:22:56.797881 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:22:56.798617 (+   736us) log.cc:844] Serialized 6341 byte log entry
0709 12:22:57.591975 (+793358us) op_driver.cc:464] REPLICATION: finished
0709 12:22:57.713741 (+121766us) write_op.cc:301] APPLY: starting
0709 12:22:57.727732 (+ 13991us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:57.731556 (+  3824us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:57.731715 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:57.876577 (+144862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:57.877045 (+   468us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:22:57.877098 (+    53us) write_op.cc:312] APPLY: finished
0709 12:22:57.877515 (+   417us) log.cc:844] Serialized 113 byte log entry
0709 12:22:57.877741 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:57.877999 (+   258us) write_op.cc:454] Released schema lock
0709 12:22:57.878064 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:57.878542 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:57.878572 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3563258,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":92483,"apply.run_cpu_time_us":5903,"apply.run_wall_time_us":179409,"num_ops":16,"prepare.queue_time_us":484845,"prepare.run_cpu_time_us":39090,"prepare.run_wall_time_us":663665,"raft.queue_time_us":334405,"raft.run_cpu_time_us":25305,"raft.run_wall_time_us":58561,"replication_time_us":793914,"thread_start_us":767959,"threads_started":4,"wal-append.queue_time_us":186835,"wal-append.run_cpu_time_us":29076,"wal-append.run_wall_time_us":1898666}]]}
I20260709 12:23:00.302492 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.230847  2122 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.299486 31493 rpcz_store.cc:276] 0709 12:22:59.169255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.170778 (+  1523us) service_pool.cc:224] Handling call
0709 12:22:59.171148 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.171390 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:59.687305 (+515915us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.234487 (+547182us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.234660 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.234727 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:00.234774 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.234835 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.234987 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25964,"prepare.queue_time_us":683350,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":375971,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":160,"thread_start_us":1018857,"threads_started":3,"wal-append.queue_time_us":181578}
I20260709 12:23:00.344220 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.350858 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:00.335225  2320 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.298442  2419 raft_consensus.cc:993] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
W20260709 12:23:00.374609 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.381333 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.338146  2315 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:00.291711  2268 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:00.383113 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.454425 31571 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:00.233896  2337 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.254241  2282 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.296141  2034 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:00.463562  2034 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.464303  2282 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.464562  2034 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.397203 31568 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.330543 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.471172  2204 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.471791 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.351593 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.473776 31567 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:00.273187  2348 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.474653 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.475265 31567 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:00.476257  2348 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:00.428774 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.429280 31494 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:00.429299  2093 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.391575  2019 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.427138 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.479121 31493 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:00.479758  2019 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.480259  2379 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.436144 31565 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 2. (term mismatch)
I20260709 12:23:00.337880  2406 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.481068 31565 pending_rounds.cc:85] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 1
I20260709 12:23:00.481341 31565 pending_rounds.cc:107] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:00.481570 31565 raft_consensus.cc:2889] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:00.481854 31565 pending_rounds.cc:107] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:23:00.482075 31565 raft_consensus.cc:2889] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:00.279790  2291 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.482712  2406 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:00.483337  2417 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:00.484089  2291 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:00.435426 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 132991us
I20260709 12:23:00.338662  2305 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.381747 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.485654 31495 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:00.314668  2284 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.486457  2284 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.487056  2405 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.487133  2315 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.487875  2405 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.488232  2315 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.488530  2284 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.488315  2405 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.437150 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.340302  2393 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:00.430574  2411 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:23:00.451534 31570 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:00.490669  2337 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.458178 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:00.330014  2056 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.461514  2370 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.476352 31567 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:23:00.477074 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.347985  2403 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:00.460525  2273 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.522840 31572 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:23:00.528370 31569 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:00.492798 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:00.461175 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:00.533205 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 47971.1us
W20260709 12:23:00.512147 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.528442 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.534106 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:00.534140 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.526746 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:00.511425 31568 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:00.531042 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:00.535298 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:00.535843 32107 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.541139 31496 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:00.543344 32113 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:00.543684 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.453228  2308 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:00.546249 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.491045  2419 raft_consensus.cc:1081] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:00.553675 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.564157 31571 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:00.554124 32109 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:23:00.554713 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.555207 32110 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:00.555876 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.556161 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.556383 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:00.559566 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.568606 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:00.569398  2237 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:00.570087 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.528606  2311 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.352738  2316 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.490631  2405 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.573197 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.562299 32107 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:00.526612  2359 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:00.528055  2051 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.569969  2393 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:23:00.582980 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 576) took 1370 ms. Trace:
I20260709 12:23:00.583705 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:00.525110  2413 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:23:00.575474  2237 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.597563 31418 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:00.598040 31415 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
W20260709 12:23:00.587749 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.564064  2305 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.498914  2268 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.526315  2377 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:00.574213  2374 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.581048 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.584144  2311 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:00.596208 31424 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:00.620139 31424 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:00.596719 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.597563 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.621819 31417 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.587577 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.598661 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.624888 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:00.625010 31418 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:00.591956 31498 rpcz_store.cc:276] 0709 12:22:59.212775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.787572 (+574797us) service_pool.cc:224] Handling call
0709 12:22:59.805697 (+ 18125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.806011 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:00.248867 (+442856us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.582627 (+333760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.582704 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:00.582747 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.582814 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.582924 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27618,"prepare.queue_time_us":34747,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":149486,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":704661,"threads_started":3,"wal-append.queue_time_us":218369}
I20260709 12:23:00.600569 31420 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:00.601251 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.601837 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.626305 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.626838 31573 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:00.627161 31571 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:00.577466  2421 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:00.607191 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76241.4us
I20260709 12:23:00.630645  2408 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.610353  2051 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.631647  2051 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.632005  2051 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.632864  2268 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.603659  2237 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.649539 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:00.580261  2428 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.613677 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.614413 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.616899 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:00.582551 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 241001us
I20260709 12:23:00.590689  2316 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.603119 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.651055 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.726641 31416 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.651387 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:00.651528 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.652266  2385 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:00.652359 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.730159 31494 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:00.652570 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.305531 31492 rpcz_store.cc:276] 0709 12:22:59.167830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.167989 (+   159us) service_pool.cc:224] Handling call
0709 12:22:59.168346 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:59.168578 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:59.787232 (+618654us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.237565 (+450333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:00.237614 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:00.237654 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.237717 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.237812 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":624311,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":987,"raft.queue_time_us":1836,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":1051055,"threads_started":2,"wal-append.queue_time_us":510907}
W20260709 12:23:00.656637  2387 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.003s
I20260709 12:23:00.628831 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:00.731933 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 103200us
I20260709 12:23:00.732640 32080 leader_election.cc:400] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8.
I20260709 12:23:00.732911 32080 leader_election.cc:403] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:00.599781  2405 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:00.735438  2405 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.735918  2405 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.540226  2403 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:00.743295 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.747288  2387 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.748052  2387 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:00.749125  2387 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.679296 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:00.754158 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 73390.4us
I20260709 12:23:00.755393 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:00.756621 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:00.757611  2406 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.757997  2406 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:00.758368  2406 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.703788  2410 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.705354  2056 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.683838 31419 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:00.702399  2285 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.707127  2279 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.763582  2285 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:00.764938  2279 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:00.765508  2294 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.765800 32105 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:23:00.708006  2415 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:00.766577  2415 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:00.767082  2415 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.767751  2294 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:00.712085 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.768643 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.769097 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.651105  2424 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.769733  2385 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.770207  2424 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.770366  2385 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.774920  2291 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:00.775626  2291 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:00.776000 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96779.4us
I20260709 12:23:00.776616  2393 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:00.719620  2311 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.591631  2359 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.731062 31493 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:00.764515  2285 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.768193  2294 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.777129  2393 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:00.785010  2393 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.710640  2428 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.812192  2300 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.609804 31423 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:00.811540 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:00.816288 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 199462us
I20260709 12:23:00.812836  2385 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:00.824448 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:00.809904 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.810868 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.828074 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.828619 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:00.829209 31492 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:23:00.811378 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78869.8us
I20260709 12:23:00.817665 31417 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:23:00.808370 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 123493us
I20260709 12:23:00.831132 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:00.836057 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 574) took 1623 ms. Trace:
W20260709 12:23:00.836643 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.839067 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.839869 31494 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:00.821877 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:00.843299 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:00.825577 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:00.844506 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:00.836521 31499 rpcz_store.cc:276] 0709 12:22:59.212330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:59.754118 (+541788us) service_pool.cc:224] Handling call
0709 12:22:59.775788 (+ 21670us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:00.194661 (+418873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.195373 (+   712us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:00.199181 (+  3808us) log.cc:844] Serialized 52 byte log entry
0709 12:23:00.294335 (+ 95154us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:00.332244 (+ 37909us) log.cc:844] Serialized 14 byte log entry
0709 12:23:00.835755 (+503511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.835822 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:00.835864 (+    42us) raft_consensus.cc:1685] finished
0709 12:23:00.835877 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:00.836003 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84586,"prepare.queue_time_us":35250,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":557136,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":288,"thread_start_us":892691,"threads_started":3,"wal-append.queue_time_us":240772}
I20260709 12:23:00.677459  2071 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.849972  2402 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.864215 31416 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:00.866214 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:00.867106 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:00.818208  2352 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.777s	user 0.015s	sys 0.000s
I20260709 12:23:00.867694 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.812726  2300 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.873536 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:00.875422 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.817152  2044 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:00.823237  2279 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.881665 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.891139 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:00.883882 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:00.847661  2257 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.892432  2056 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.847074  2320 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:00.847856  2370 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.913609 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:00.913691  2370 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.913411 31318 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to <none>, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:00.891021  2087 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.008s
I20260709 12:23:00.861508  2284 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.862624  2273 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:00.862287  2413 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.914489 31499 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:00.847585  2419 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:00.888106 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43680.2us
I20260709 12:23:00.955436 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:00.918738 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.956604 31416 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:00.880959  2369 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.929762 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:00.957536  2369 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.958544 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:00.959781 31573 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:00.847458  2425 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:23:00.847321  2377 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:23:00.929994  2087 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.953276 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:00.953920 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61411.2us
I20260709 12:23:00.913441  2308 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.912163  2056 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:00.971832  2056 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.972512  2406 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:00.889250  2204 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:23:00.931937  2284 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:00.955377 31318 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.874150  2071 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:00.992147  2305 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.993590  2370 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.018517  2446 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:01.019739  2370 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:00.924371  2402 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:00.889461  2019 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:23:01.009646  2408 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.923715  2320 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:00.992206  2268 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:00.999733 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46542.8us
I20260709 12:23:01.034936 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:01.026978 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:00.975179  2419 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.020418  2305 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.954653  2413 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.916052  2257 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.045512  2413 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.050024  2359 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.033115 31417 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:00.991365  2296 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.018s	user 0.014s	sys 0.007s
I20260709 12:23:01.035779 31416 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.991189  2291 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.037487 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.128144 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:01.032822 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 166681us
I20260709 12:23:01.022702  2284 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.049810  2430 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:01.050647 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.130452 31419 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:01.051297  2403 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.138245 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:01.054523  2305 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.055052  2428 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:01.113574  2438 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.138s	user 0.008s	sys 0.000s
W20260709 12:23:01.055949  2306 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.764s	user 0.003s	sys 0.011s
I20260709 12:23:01.020203  2370 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:01.014617 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.026185  2273 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:01.102596 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:01.103838 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:01.026793  2424 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.048941  2320 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.029356 31573 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
W20260709 12:23:01.104009 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 202424us
I20260709 12:23:01.167299 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.026209  2402 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:01.130479 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.170254 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:01.134512 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 97097.1us
I20260709 12:23:01.172400 31465 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:01.173499 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:01.177626 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.135080 31416 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:01.042053  2419 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:01.138613 31574 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:01.038475  2433 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:01.143541  2443 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:23:01.144537 31419 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:01.147444 31418 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 2. (index mismatch)
I20260709 12:23:01.188956 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.148612 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.189532 31416 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:01.150810 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:01.156462 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.158413 31565 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:23:01.140867  2366 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.001s
I20260709 12:23:01.155622 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:01.160766 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 146255us
W20260709 12:23:01.153357  2051 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.008s
I20260709 12:23:01.208998 31567 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:01.141085  2430 consensus_queue.cc:1243] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:01.189558 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.181403 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:01.180544 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50227.4us
I20260709 12:23:01.215730 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:01.214576 31419 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:23:01.185827 31499 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:23:01.186954 31492 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:01.206548 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.162025  2300 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.190018 31421 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:01.218442 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.189594 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:01.208863 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.040086  2268 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.209766 31318 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:01.222522 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.223244 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.210462 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.190569 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.210955 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:01.205547 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.224802 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.225824 31416 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:01.225917 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44677.9us
I20260709 12:23:01.206600 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.211809 31568 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:01.226766 32107 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:01.227216 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.227774 31568 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:01.229550 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.230340 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:01.232229 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.234100 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.219355 31418 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:01.161682  2431 raft_consensus.cc:2764] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:01.242959 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
W20260709 12:23:01.252386 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.188223  2424 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:01.188383  2122 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.256659 31570 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.259552 31570 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.185341  2428 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:01.175858  2402 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.170338  2387 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.202354  2359 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:23:01.262864 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.266166 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.191056  2403 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:01.285607 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.303764 31318 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.257740  2308 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:01.223953  2051 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.362653 32112 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:01.264523  2348 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:01.348337 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 116177us
W20260709 12:23:01.347581 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 143038us
I20260709 12:23:01.367285  2051 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.367801  2406 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.212965  2366 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.227802  2409 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 12:23:01.232245  2433 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 12:23:01.264415  2019 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:01.270821  2071 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.378008 31570 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:01.418782 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 182014us
I20260709 12:23:01.361618  2424 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.419214 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:01.385129 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1523) took 1052 ms. Trace:
I20260709 12:23:01.377218  2387 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:23:01.419960 31491 rpcz_store.cc:276] 0709 12:23:00.332736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.333161 (+   425us) service_pool.cc:224] Handling call
0709 12:23:00.333484 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.456770 (+123286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.456800 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.674965 (+218165us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b2c0000e5c8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:23:00.675427 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:23:00.983479 (+308052us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:00.983541 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.983642 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.370017 (+386375us) raft_consensus.cc:1685] finished
0709 12:23:01.370039 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.385049 (+ 15010us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73411,"raft.queue_time_us":125182,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":13390080,"thread_start_us":357012,"threads_started":2,"wal-append.queue_time_us":334700}
I20260709 12:23:01.421572  2414 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:01.422011  2414 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:01.422353  2306 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:01.422505 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:01.422886  2306 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.423359  2306 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:01.423305  2348 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:01.425191  2300 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.423518  2426 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:23:01.425424 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.425902  2426 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:01.362008  2308 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.304795  2369 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.362985  2403 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.364101  2282 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:01.435094 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 207927us
I20260709 12:23:01.427875 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.435869 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.344576  2285 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.443064 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.373848 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:01.429553 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.443696 31496 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:01.431910 31570 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.437805 31491 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:23:01.437714 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.444916 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.445549 31496 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:01.387324  2435 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.452970 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.453642 31418 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:01.438951 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.439651 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.441267 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.442171 32108 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:01.368953  2428 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.438005 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.447378 31318 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 4, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:01.455169 31499 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:01.454648 31492 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:01.261420  2370 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.456833 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.457448 32109 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:23:01.455416 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:01.458392 32110 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:01.458598 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:01.459249 31492 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:01.459585 31495 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:01.460119 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.460975 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.281740  2122 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.450208 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.450884 31416 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:01.425351  2087 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:23:01.506634 31421 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:01.506552 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.507232 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.507688 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.503501 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.508308 32109 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:23:01.427202  2019 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.504441 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.452024 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:01.509891 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82088.3us
I20260709 12:23:01.510737 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.441800  2308 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.508844 32109 pending_rounds.cc:85] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 6
I20260709 12:23:01.507812  2087 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:01.464583  2447 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 12:23:01.555267 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50896.3us
I20260709 12:23:01.556160 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.514372 31418 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:01.514782 32109 pending_rounds.cc:107] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 6.7
W20260709 12:23:01.455933  2034 consensus_meta.cc:287] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.991s	user 0.015s	sys 0.007s
W20260709 12:23:01.508394  2441 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 12:23:01.557649 32109 raft_consensus.cc:2889] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:01.504029  2237 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.867s	user 0.014s	sys 0.006s
W20260709 12:23:01.561786 32106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.014s	sys 0.010s
I20260709 12:23:01.510845  2369 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:01.562878  2428 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.513113  2257 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.559949  2087 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.566365  2122 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.512903  2019 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:01.567209 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 131390us
I20260709 12:23:01.570991  2467 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:01.571234  2454 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:23:01.504876  2435 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.572098  2408 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.572394  2468 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:01.575282 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 201529us
I20260709 12:23:01.604076  2359 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:01.434478  2424 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.556238 31318 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 1 to 2, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:23:01.585870 32106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.014s	sys 0.010s
I20260709 12:23:01.638583 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 736) took 1112 ms. Trace:
I20260709 12:23:01.441344  2406 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:23:01.465147  2056 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.382957  2273 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.521941  2285 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.631192  2122 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:23:01.620909 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47421.2us
I20260709 12:23:01.514818  2430 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:01.586779  2348 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:01.584554  2370 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.588421  2369 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.580204  2461 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:01.585815  2445 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.521059  2300 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:01.669744  2405 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.933s	user 0.006s	sys 0.006s
W20260709 12:23:01.620433  2294 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.837s	user 0.013s	sys 0.000s
W20260709 12:23:01.670841  2456 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:23:01.670717  2294 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.672595  2087 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.674082  2294 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:01.632669 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 122041us
W20260709 12:23:01.674819  2455 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:23:01.634027 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.677059 31465 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:01.634996 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:01.679016 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44108.2us
I20260709 12:23:01.440701  2071 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:23:01.682126  2056 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.682348 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2523) took 1371 ms. Trace:
I20260709 12:23:01.682796  2056 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:01.682842 31574 rpcz_store.cc:276] 0709 12:23:00.310547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.310660 (+   113us) service_pool.cc:224] Handling call
0709 12:23:00.384059 (+ 73399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.187370 (+803311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.682105 (+494735us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400262fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:01.682282 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734555904}
W20260709 12:23:01.626617  2279 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.003s
I20260709 12:23:01.638773 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1546) took 1093 ms. Trace:
I20260709 12:23:01.656113  2369 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:01.638957 32106 rpcz_store.cc:276] 0709 12:23:00.526516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.526871 (+   355us) service_pool.cc:224] Handling call
0709 12:23:00.527187 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:00.527388 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:00.878827 (+351439us) log.cc:844] Serialized 14 byte log entry
0709 12:23:01.638268 (+759441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:01.638329 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:01.638370 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.638428 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.638529 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490236,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"thread_start_us":1098777,"threads_started":2}
I20260709 12:23:01.626575  2467 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.628995  2268 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.626202  2460 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.513046  2414 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.451653  2282 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.604099  2237 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.648641 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.625105  2034 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:23:01.646122  2452 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:23:01.660187 31423 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:01.573868  2426 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.650419  2430 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.648065  2122 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.669278  2300 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:01.684311 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.628499 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 199031us
I20260709 12:23:01.686333 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.718254 31569 rpcz_store.cc:276] 0709 12:23:00.545280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.565797 (+ 20517us) service_pool.cc:224] Handling call
0709 12:23:00.578241 (+ 12444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:00.578641 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:00.578727 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:00.579202 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:23:00.713867 (+134665us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b48001302d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:23:00.885454 (+171587us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:00.885517 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:00.885613 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:01.635047 (+749434us) raft_consensus.cc:1685] finished
0709 12:23:01.635067 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:01.638670 (+  3603us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1638,"raft.run_cpu_time_us":2636,"raft.run_wall_time_us":133784,"spinlock_wait_cycles":14227712,"thread_start_us":276152,"threads_started":1,"wal-append.queue_time_us":418940}
I20260709 12:23:01.639218 31417 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
W20260709 12:23:01.721539  2393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.007s
I20260709 12:23:01.655795  2461 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.732741  2426 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.732978  2430 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.744236 31420 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.733174  2122 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.737370 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.751559 31419 raft_consensus.cc:2376] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10. Re-sending same reply.
I20260709 12:23:01.752734 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.754076 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.670200  2405 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.730104 31422 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6.
I20260709 12:23:01.683341  2056 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:01.756771 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:01.757211 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.761039 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.717605  2403 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.757948 31419 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:01.758322 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 109813us
W20260709 12:23:01.757539 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 110940us
I20260709 12:23:01.765136 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.766360 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.741529  2306 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.760870  2034 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.761626 31418 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8. Re-sending same reply.
I20260709 12:23:01.641680  2468 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:01.738839  2393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.006s	sys 0.007s
I20260709 12:23:01.740607  2279 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8.
I20260709 12:23:01.727607  2282 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.725225  2268 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.722450  2366 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.722648  2428 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:01.775275 31415 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:01.763000  2359 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:01.776254  2476 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:23:01.740684  2410 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:23:01.739292  2461 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:01.776846  2453 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:23:01.777509  2478 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.724064  2467 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:01.845847  2413 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.800s	user 0.006s	sys 0.000s
I20260709 12:23:01.781347 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.864532 31419 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:01.729496  2237 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.786368 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:01.787927 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 411216us
I20260709 12:23:01.788403 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.723083  2470 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.762722  2056 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:01.759824  2087 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:23:01.803879 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:01.892257 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 103895us
I20260709 12:23:01.820359 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.892931 32110 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:01.758021  2296 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:23:01.789499  2352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.021s
W20260709 12:23:01.899876  2352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.009s	sys 0.021s
I20260709 12:23:01.824137 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:01.901734  2352 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:01.902135  2352 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:01.859782  2435 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.902869  2485 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:01.903658  2485 consensus_queue.cc:1243] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:01.904138  2352 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.904886  2430 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.905349  2352 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:01.895371  2470 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.907459  2405 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.908089  2056 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.908711  2470 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.910274  2056 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.891419  2413 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.913952  2308 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:01.851579  2305 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.695s	user 0.006s	sys 0.003s
W20260709 12:23:01.852305  2316 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.151s	user 0.009s	sys 0.007s
W20260709 12:23:01.852661  2415 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.085s	user 0.006s	sys 0.006s
W20260709 12:23:01.856077  2284 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.002s
W20260709 12:23:01.856659 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.856937  2424 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.857122  2478 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.778328  2460 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:01.939461 31567 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:01.936774 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:01.860600 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68859.5us
I20260709 12:23:01.837877  2428 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:01.828696  2282 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:01.873564  2257 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:01.895896 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.892400 31418 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:01.898941  2467 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.914804  2336 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:01.840381  2306 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:01.923908  2413 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:01.920295 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:01.999470 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 108351us
I20260709 12:23:02.000131 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:02.000483 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:01.991226  2282 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:02.001106 31418 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:02.001402 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:01.930370 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.003235 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.003912 31571 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.003643  2428 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.004608 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.005630 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:01.930605 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:01.891539 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 123029us
I20260709 12:23:02.006619  2485 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.009141  2485 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:02.009567  2485 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.010052  2369 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.936530 31421 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:01.946197 31568 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:23:01.976657 31567 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.980005 31570 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:01.934707  2122 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:01.983814  2402 consensus_meta.cc:287] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 12:23:01.984826  2316 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.985807  2019 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:01.986549  2460 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:01.934373  2415 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:01.987592 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:01.988380  2315 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.467s	user 0.010s	sys 0.005s
I20260709 12:23:01.835414  2268 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.037125  2268 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.037693 31572 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:01.988655  2468 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:01.979727  2478 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:01.993173 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.996769  2470 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:01.933058  2305 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.002032 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:01.975500  2385 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:02.011375 31574 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:02.006973  2458 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.936084 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.013465 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.017138 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:02.017858 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:02.022742 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:01.996430  2352 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:23:02.054435 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.088973 31569 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:02.044482 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:02.102308 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 79675.9us
I20260709 12:23:02.045323 32111 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:02.022940 31568 pending_rounds.cc:85] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 3
I20260709 12:23:02.024158 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.021945 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.104660 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.105275 31567 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.105553 31573 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:01.932433  2474 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.028582 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:02.032900 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45396.3us
I20260709 12:23:02.107096 31418 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:02.033349 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:02.033401 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:02.107904 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:02.034152 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:01.996232  2430 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.038851 31499 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:01.997145  2336 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:01.936774  2071 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:23:02.103721 31568 pending_rounds.cc:107] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:23:02.108078 31497 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.001441  2282 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:02.109277 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 85226.8us
I20260709 12:23:02.123469 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:02.121762 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:02.124891 32106 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:02.039125 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.111955 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:01.937340  2284 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.118069 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:02.045109  2419 consensus_meta.cc:287] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.000s
I20260709 12:23:02.118633 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:02.120695  2478 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.121763 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2675) took 1170 ms. Trace:
I20260709 12:23:02.136675 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.109814 31571 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:02.136909 31423 rpcz_store.cc:276] 0709 12:23:00.950896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.951096 (+   200us) service_pool.cc:224] Handling call
0709 12:23:00.993232 (+ 42136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.732149 (+738917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.121556 (+389407us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54003ee254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:02.121709 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525029120}
I20260709 12:23:02.138254 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.126372 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.138795 31423 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:02.139097 31423 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:02.139458 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:02.127734 31570 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:02.124986 32107 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:02.008134  2461 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.115653  2403 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.117599 31568 raft_consensus.cc:2889] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.111991  2316 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.116144  2337 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.134871  2415 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.038854  2296 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.127977 31567 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:02.136910 31498 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.141072 31573 pending_rounds.cc:85] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 4
I20260709 12:23:02.163251 31573 pending_rounds.cc:107] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:02.163560 31573 raft_consensus.cc:2889] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.141508 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.135939  2473 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:02.144788 31416 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:02.148300 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.152134 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:02.047855  2467 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.051858  2369 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.153487 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.177752 32107 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.153920 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.139796 31423 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.159557 31497 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:02.106523  2385 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:02.147240  2315 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:02.153632  2316 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.144114 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:02.188621 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44580.6us
I20260709 12:23:02.113649  2470 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:02.046396  2493 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:23:02.144398  2122 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.031008  2402 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.185994 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.187247 31494 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:02.162243  2463 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:02.152974  2410 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:02.192448 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.194284 31498 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:02.198982 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.200208 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.160539  2460 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:02.148185  2419 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.162340  2478 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:02.230273 31567 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:02.205933  2296 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:02.230718 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:02.182911  2315 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.132763  2474 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.191187  2316 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.250387 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.244645 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.225896  2473 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:02.226104  2468 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:02.231653  2306 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.248104 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.255870 31424 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:02.229630  2463 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:02.182978  2415 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:02.256829 32079 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:02.258927 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.256887 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.259680 31417 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:02.263736 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.240268  2296 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.252599  2315 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.252564  2445 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:02.273803 31566 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:02.274946 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.272332 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.255275  2122 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:02.233325  2424 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:23:02.258247  2352 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.258251  2463 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.277909 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.278167 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.285923 32107 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.286089 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.288115 31568 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:02.287961 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.275921 31417 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:02.291602 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.292035 32107 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.291862 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:02.292295 32110 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.226068  2336 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.270869  2237 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.276768  2359 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:02.299459 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.301760 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:02.282850  2257 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.302089 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.312887 31568 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.260499  2468 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.272751  2019 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.277616  2122 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:02.273332  2296 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.282773  2264 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:23:02.293880  2445 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:02.260355  2385 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.290405  2425 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:23:02.313076  2284 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.315073  2305 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.260813  2473 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.403700  2461 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:02.428604  2500 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:23:02.429373  2497 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:23:02.320629  2257 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.398626  2204 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.311879  2495 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:02.519572  2406 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.519654  2237 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.520669  2402 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.314029  2486 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:02.521468  2419 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:02.524268  2426 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.782s	user 0.002s	sys 0.016s
I20260709 12:23:02.568908 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 779) took 1466 ms. Trace:
I20260709 12:23:02.569643 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 541) took 1106 ms. Trace:
I20260709 12:23:02.283279  2421 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:23:02.525233  2316 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.528775  2282 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.530447 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.596463 32109 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:02.532187 32113 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:02.320472 31387 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.350867 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:02.598526 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 278123us
I20260709 12:23:02.600157 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.600852 31417 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:02.601852 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.562158  2495 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:02.534897  2311 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.607741 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 610) took 1402 ms. Trace:
I20260709 12:23:02.561137 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.608811 31418 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:02.563931 31571 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:02.569437 31572 rpcz_store.cc:276] 0709 12:23:01.102492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.137999 (+ 35507us) service_pool.cc:224] Handling call
0709 12:23:02.568698 (+1430699us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54001ce654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:02.568838 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066908544}
I20260709 12:23:02.610435 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.611016 31572 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:02.570154 31421 rpcz_store.cc:276] 0709 12:23:01.463052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.507460 (+ 44408us) service_pool.cc:224] Handling call
0709 12:23:02.569377 (+1061917us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540010d954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:02.569571 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984515456}
W20260709 12:23:02.573742 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51756.6us
I20260709 12:23:02.602843 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.608193 32112 rpcz_store.cc:276] 0709 12:23:01.205118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.205268 (+   150us) service_pool.cc:224] Handling call
0709 12:23:02.607545 (+1402277us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400781754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:02.607677 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315695872}
I20260709 12:23:02.604553 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.542456 31568 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:02.615433 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.570216  2385 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.616765 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.564486  2470 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:02.600857  2506 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:23:02.632016  2282 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.564774  2122 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.607528  2257 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.616040 31421 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
W20260709 12:23:02.639236  2485 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.007s
I20260709 12:23:02.639822 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.639667  2485 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.622547 31565 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:02.640878  2308 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.564152  2204 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.641723  2485 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:02.622637 31572 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:02.569926  2237 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.604240  2419 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.643939 31417 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:02.644155  2306 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:02.644580  2306 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.644788  2237 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.645437 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:02.647976  2296 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.649704  2051 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.650055  2296 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.629534 31423 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.623397  2445 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.630003  2468 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:02.630293 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1567) took 2032 ms. Trace:
I20260709 12:23:02.631098 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:02.662743 31417 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:02.662289 31415 rpcz_store.cc:276] 0709 12:23:00.597792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.598880 (+  1088us) service_pool.cc:224] Handling call
0709 12:23:00.599196 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.864395 (+1265199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.630114 (+765719us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002120d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:02.630234 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704389376}
I20260709 12:23:02.664134 31415 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:23:02.664395 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.664830 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.665511 31574 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:02.665339 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 48658.8us
I20260709 12:23:02.666109 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.666610 31568 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.667141 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.669152 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.669497 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.670445 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.671137 32111 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:02.671939 31418 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:02.568130  2406 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.624502 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:02.673803 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:02.682237 31569 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:02.617456  2421 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.686924 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.674500 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.688355 31574 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.689951 31423 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:02.692718 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.694746 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:02.687016 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:02.672479  2461 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.650506  2051 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.617321  2311 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.695678  2480 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.704077 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 542) took 1240 ms. Trace:
I20260709 12:23:02.704989  2316 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.705827  2448 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:02.707700 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.712623 31416 rpcz_store.cc:276] 0709 12:23:01.463405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.508093 (+ 44688us) service_pool.cc:224] Handling call
0709 12:23:01.508378 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.175996 (+667618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.703841 (+527845us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54002125d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:02.704026 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462972288}
I20260709 12:23:02.696807  2071 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:02.728289  2504 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.738096 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:02.744072 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:02.744741 32114 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:02.738161  2504 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.747107 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.748654 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.751616 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:02.732440  2348 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:02.752601 31568 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:02.733700  2473 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:02.755018 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 60362.7us
I20260709 12:23:02.756927 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.755559 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2678) took 1644 ms. Trace:
I20260709 12:23:02.764562 31572 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:23:02.764978 31572 pending_rounds.cc:85] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 3
I20260709 12:23:02.765287 31572 pending_rounds.cc:107] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:23:02.765571 31572 raft_consensus.cc:2889] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.762988 31420 rpcz_store.cc:276] 0709 12:23:01.111491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.114781 (+  3290us) service_pool.cc:224] Handling call
0709 12:23:01.151913 (+ 37132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.744618 (+592705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.755280 (+1010662us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54003edd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:02.755492 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361784192}
I20260709 12:23:02.761233 32111 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:02.743306  2204 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:02.815047 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58187.6us
W20260709 12:23:02.818260 31422 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1559) took 2175 ms (client timeout 2088 ms). Trace:
I20260709 12:23:02.818372 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:02.750746  2257 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.750408  2430 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.728580  2463 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.691256  2495 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:02.769625 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 577209us
W20260709 12:23:02.770061 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 584142us
W20260709 12:23:02.818813 31422 rpcz_store.cc:269] 0709 12:23:00.594966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.595100 (+   134us) service_pool.cc:224] Handling call
0709 12:23:02.769920 (+2174820us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540024fc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:02.770087 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537663232}
I20260709 12:23:02.762355  2504 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:02.824304 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:02.836875 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.757772  2348 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.756881  2296 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:02.837240 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:02.837494 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68498.5us
I20260709 12:23:02.733038  2448 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:02.744361  2315 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.762449  2425 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.728966  2480 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:02.762375  2468 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.766731  2337 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:02.939702 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:02.964669 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.865118  2316 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:02.818434  2410 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.756394  2512 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.219s
I20260709 12:23:02.824975  2087 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:02.977917 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 140760us
I20260709 12:23:02.968357 31422 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:02.968092 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:02.992892 31420 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:02.994063 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:02.831410  2430 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:02.821254  2473 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:02.839303  2486 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:02.968672  2294 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.984906  2428 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:02.879251  2352 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 12:23:02.984277  2504 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.996959 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:03.004459 31422 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:02.980149  2495 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:03.088867 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 91995.7us
W20260709 12:23:02.983640 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44025us
I20260709 12:23:03.003712  2473 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.099440  2473 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.100062 31567 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:02.985797  2468 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.103926  2468 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.019182  2485 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:03.104913 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 537) took 1652 ms. Trace:
I20260709 12:23:02.985541  2460 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:03.019768  2403 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:03.019869  2428 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.020871  2294 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.020646  2486 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:03.082546  2465 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.989140  2433 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:03.086469  2463 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:03.086699  2515 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 12:23:03.086966  2051 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.087293  2352 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:03.003782  2385 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 12:23:03.087822  2517 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:23:03.087762  2071 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.084045  2469 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:03.005652 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.978842  2273 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:03.003700  2430 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.135121  2071 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.137447  2071 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.092200  2393 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:03.138103  2393 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:03.138969  2393 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.140656  2273 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:03.141037  2273 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:03.094048 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:02.979678  2337 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.094264  2448 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:03.095561  2518 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:23:03.097067  2311 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.018957  2366 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.161550  2469 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.986433  2316 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.162245  2316 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.105297 31424 rpcz_store.cc:276] 0709 12:23:01.452908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.453033 (+   125us) service_pool.cc:224] Handling call
0709 12:23:01.453264 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.256266 (+803002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.104701 (+848435us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54004493d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:03.104841 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845430656}
I20260709 12:23:03.016261  2204 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:03.158537  2273 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.035940  2406 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:03.110987  2520 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:23:03.167505  2204 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.194813  2204 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.190748  2273 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.225140  2485 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:03.231745  2524 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.149s	user 0.001s	sys 0.003s
W20260709 12:23:03.114933 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.086159  2528 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.026336  2410 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:23:03.112187  2403 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.121850  2352 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:03.119273  2433 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:03.130267 31573 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:03.122822  2463 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.131213  2480 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.120719  2465 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.135176 31421 raft_consensus.cc:2410] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:03.113785  2460 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.091681 31574 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:03.142181  2445 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:23:03.158190  2337 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:03.168095 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74119.6us
I20260709 12:23:03.168951 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:03.019340  2087 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.236192 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.262228 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2539) took 1064 ms. Trace:
I20260709 12:23:03.261932  2403 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.268430  2433 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.266222  2352 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.228767  2473 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:03.327404 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 765) took 2495 ms (client timeout 1604 ms). Trace:
W20260709 12:23:03.327816 31566 rpcz_store.cc:269] 0709 12:23:00.831892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.832889 (+   997us) service_pool.cc:224] Handling call
0709 12:23:03.327195 (+2494306us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001a5754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:03.327306 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3228359936}
I20260709 12:23:03.340487  2480 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:03.340938  2480 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:03.341748  2521 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
I20260709 12:23:03.343803  2316 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.344671  2460 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.344820  2414 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.346356 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 548) took 1303 ms. Trace:
I20260709 12:23:03.346913 31415 rpcz_store.cc:276] 0709 12:23:02.042928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.673025 (+630097us) service_pool.cc:224] Handling call
0709 12:23:02.673295 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.696340 (+ 23045us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:02.710661 (+ 14321us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.979912 (+269251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.985730 (+  5818us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.985911 (+   181us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:02.985957 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.986045 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.346109 (+360064us) raft_consensus.cc:1685] finished
0709 12:23:03.346136 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.346287 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13924,"prepare.queue_time_us":5478,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":15815,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4886,"thread_start_us":268013,"threads_started":1,"wal-append.queue_time_us":563631}
I20260709 12:23:03.349222  2315 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.349965 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.314996 31423 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:03.315783 31424 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
W20260709 12:23:03.318378 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 78403.1us
I20260709 12:23:03.315826 31570 rpcz_store.cc:276] 0709 12:23:02.197997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.198148 (+   151us) service_pool.cc:224] Handling call
0709 12:23:02.231030 (+ 32882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.232986 (+  1956us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:02.551732 (+318746us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.753945 (+202213us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.754311 (+   366us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.754464 (+   153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.766754 (+ 12290us) log.cc:844] Serialized 572 byte log entry
0709 12:23:02.766887 (+   133us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:02.766920 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.234042 (+467122us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b54001cdc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:03.261909 (+ 27867us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.261973 (+    64us) raft_consensus.cc:1685] finished
0709 12:23:03.261991 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.262148 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372234,"prepare.queue_time_us":220495,"prepare.run_cpu_time_us":8895,"prepare.run_wall_time_us":145477,"raft.queue_time_us":5963,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":27312,"spinlock_wait_cycles":14642304,"thread_start_us":363030,"threads_started":2,"wal-append.queue_time_us":183428}
I20260709 12:23:03.264525  2428 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.274143  2294 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:03.357168 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.358500 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.358435 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.358639 31387 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:03.370092 31387 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:03.374401 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.375684 31424 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:03.376756 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.377565 31415 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:03.297138  2463 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.401744 31424 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:23:03.404567 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.367851  2493 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.375164  2424 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:03.407313 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2696) took 1238 ms. Trace:
I20260709 12:23:03.319459  2415 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:23:03.410771  2465 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.395663  2495 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.455020  2495 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.457439  2495 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:03.378983  2294 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.399394  2431 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:23:03.459020  2431 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:03.459455  2431 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:03.460600  2431 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.462201  2431 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.413141 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1574) took 1726 ms. Trace:
I20260709 12:23:03.416765  2467 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.463223  2467 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.463011 31421 rpcz_store.cc:276] 0709 12:23:01.686994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.639555 (+952561us) service_pool.cc:224] Handling call
0709 12:23:03.412902 (+773347us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003eb554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:03.413076 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137310592}
I20260709 12:23:03.465407  2467 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.417104  2463 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.395928  2352 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.417709 32109 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:03.418262 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.452360 31418 rpcz_store.cc:276] 0709 12:23:02.168538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.704387 (+535849us) service_pool.cc:224] Handling call
0709 12:23:02.704715 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:02.709439 (+  4724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.709467 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:02.709994 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 12:23:02.776235 (+ 66241us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:02.839573 (+ 63338us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.839859 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.839962 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.231191 (+391229us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:03.403758 (+172567us) raft_consensus.cc:1685] finished
0709 12:23:03.407097 (+  3339us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.407238 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4350,"prepare.queue_time_us":48407,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":31473,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":22082,"spinlock_wait_cycles":2740992,"thread_start_us":65844,"threads_started":1,"wal-append.queue_time_us":293899}
W20260709 12:23:03.414141  2306 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.002s
I20260709 12:23:03.418948 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.473986 32108 raft_consensus.cc:2410] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:03.427305  2348 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.428133 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 616) took 2192 ms. Trace:
I20260709 12:23:03.422210  2404 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:03.479486  2471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.027s
W20260709 12:23:03.444036 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 462673us
I20260709 12:23:03.439363  2296 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:03.431015 31464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.038s	sys 0.104s
W20260709 12:23:03.504887 31464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.039s	sys 0.104s
W20260709 12:23:03.502276 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 497503us
I20260709 12:23:03.507341 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.508051 31491 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.508320 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.509271 31499 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:03.510324 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.511264 31493 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:03.498075  2404 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.473383  2428 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:23:03.449060  2430 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.470953  2493 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.491494  2316 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.481376  2473 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.487579  2403 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.476568 32105 rpcz_store.cc:276] 0709 12:23:01.235514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.235786 (+   272us) service_pool.cc:224] Handling call
0709 12:23:01.259501 (+ 23715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:01.389175 (+129674us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:01.430030 (+ 40855us) log.cc:844] Serialized 14 byte log entry
0709 12:23:01.764742 (+334712us) log.cc:844] Serialized 14 byte log entry
0709 12:23:01.764977 (+   235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:01.765961 (+   984us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:01.765998 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:01.853746 (+ 87748us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003a3d80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc11d63758f 00007fc116676571 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd
0709 12:23:02.701437 (+847691us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b18003a3d80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:23:02.705104 (+  3667us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b18003a3d80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:03.427871 (+722767us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400610154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:03.427916 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.428050 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107288,"prepare.queue_time_us":45179,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":5811,"raft.queue_time_us":10211,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":15003,"spinlock_wait_cycles":326034304,"thread_start_us":333592,"threads_started":1,"wal-append.queue_time_us":427286,"wal-append.run_cpu_time_us":7468,"wal-append.run_wall_time_us":1012565}
I20260709 12:23:03.530591 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.484928  2474 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.500221 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:03.485050  2337 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.496995  2306 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:03.501322  2471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.034s
I20260709 12:23:03.514606 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.512791  2415 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.534709 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.552757 31499 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:03.534884 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.531771 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:03.539537 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:03.553310 31497 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.554777 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:03.542857  2056 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.543336  2403 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.534063 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.556753 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.556957 31492 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.557554 31496 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:03.546069 31498 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:03.555516 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.559085 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.560261 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.561411 31500 raft_consensus.cc:2410] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:03.519162  2425 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:23:03.531985  2463 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:23:03.570737 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.061s
I20260709 12:23:03.517040  2296 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:03.552186  2268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.012s	sys 0.022s
I20260709 12:23:03.565677 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:03.565940 31417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.020s	sys 0.016s
W20260709 12:23:03.603457 31417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.020s	sys 0.016s
I20260709 12:23:03.603657 31498 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:03.563416  2410 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:03.574575 31497 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:03.594923 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.554662  2415 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.565924 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:03.610591 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44796.5us
I20260709 12:23:03.611833 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:03.583451  2294 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.563011  2402 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:03.621309 31492 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:03.563778  2486 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:03.571731 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.061s
W20260709 12:23:03.603448  2268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.012s	sys 0.023s
I20260709 12:23:03.604367  2424 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.631619 31496 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:03.631850 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:03.626802 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 660536us
W20260709 12:23:03.630131 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.618996  2465 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:03.640317  2403 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.645501  2403 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.648092  2403 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:03.650202  2415 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.620219  2410 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:03.639122 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:03.626232  2087 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:03.656136 31416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.011s	sys 0.037s
W20260709 12:23:03.657596 31416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.037s
I20260709 12:23:03.659263  2493 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.626041  2402 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.705883 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.706631 32105 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:03.660255 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.666128 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.668484 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.672974 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.674136 31423 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:03.674425  2465 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:03.656294  2533 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.716142 31415 raft_consensus.cc:2410] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:03.678706 31495 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:23:03.678875 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.681497 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:03.717152 31572 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:03.681715 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:03.684861 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:03.666412 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.685827 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.718652 31499 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.719736 31500 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:03.719646 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:03.705370 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.642447  2463 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.721963 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.716291 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.723085 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:03.713476 31492 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:03.712627 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:03.654764  2306 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.714116 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.677105  2284 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.721949 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:03.754895 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.725100 31423 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:03.705178  2403 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.763746 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.762941 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.764421 31495 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:03.766571 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:03.708664  2404 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.627094  2486 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.769810 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:03.774207 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52335.7us
I20260709 12:23:03.724558  2264 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.721274  2493 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.804270 31499 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:03.790474 31423 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:03.805588 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.814028 31572 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:03.814298 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:03.815032 31568 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:03.779665 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.816141 31572 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:03.779317 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.760358  2463 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.823808  2463 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:03.764755  2284 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.778990 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.836433 31491 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:03.825771 31497 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:03.826063 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.782186 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:03.838665 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:03.827270 31423 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:03.839295 31574 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.839468 31568 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:03.826325 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.827210 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.829101 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:03.835227 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.835032 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:03.841773 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:03.668533  2480 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.843492 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.855041 31500 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:03.842506 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.844503 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.856065 32109 raft_consensus.cc:2410] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:23:03.849702 31574 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:03.859809 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:03.861545 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.851089 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:03.778383  2415 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.854270 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:03.863605 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:03.803105  2473 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:03.781800  2474 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:03.863817 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.721058  2465 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.863832 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:03.899235 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:03.851729 31492 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:03.772882  2316 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:03.805536  2462 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.160s
W20260709 12:23:03.962599 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 111586us
I20260709 12:23:03.808908  2306 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:03.890909 31498 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:03.991041 31571 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:03.990885 31418 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:03.825464  2264 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.777293  2291 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:23:03.825558  2533 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:03.825373  2535 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:04.079306 32108 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:03.996973 31415 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:03.804855  2315 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 12:23:03.771601  2403 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.900328  2490 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:03.835326  2493 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:03.962288  2508 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.962077  2296 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:03.995002  2473 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.035779 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.092954 31492 raft_consensus.cc:2410] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:04.036425 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.036795 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.094310 31500 raft_consensus.cc:2410] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:03.771847  2410 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:03.864048  2445 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:23:03.993556  2359 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:03.993286  2087 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.003856  2462 consensus_queue.cc:1243] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:04.001080  2316 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:04.026121  2306 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:04.347980 32107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.012s
I20260709 12:23:04.089552  2490 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:04.001194  2534 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 12:23:04.082594  2532 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.417s	user 0.000s	sys 0.009s
I20260709 12:23:04.088369  2535 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.110471 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:03.996639  2415 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.114884 31496 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:04.148898 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.098483  2473 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:04.219368 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.037s
W20260709 12:23:04.300228  2542 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:23:04.173890  2402 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.097554  2508 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.174080  2359 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:04.080893  2471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.011s	sys 0.006s
W20260709 12:23:04.339051 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.333478 31492 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:23:04.342777 31421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.019s	sys 0.036s
I20260709 12:23:04.095914 31491 raft_consensus.cc:2410] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:23:04.405799 31421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.019s	sys 0.036s
W20260709 12:23:04.349639 32107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.002s	sys 0.013s
W20260709 12:23:04.351715 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.011s
W20260709 12:23:04.406442 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.003s	sys 0.011s
I20260709 12:23:04.339663  2122 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:04.304256  2408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.022s
W20260709 12:23:04.354240 31416 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.009s
I20260709 12:23:04.351426  2306 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:04.415987 31416 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.014s
W20260709 12:23:04.385557 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.015s	sys 0.006s
W20260709 12:23:04.416487 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.015s	sys 0.007s
W20260709 12:23:04.416764 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 718676us
I20260709 12:23:04.417358 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:04.387614 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.000s	sys 0.038s
I20260709 12:23:04.082435  2533 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:04.388511 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.005s	sys 0.024s
W20260709 12:23:04.425191 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.005s	sys 0.024s
W20260709 12:23:04.425518 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 746787us
W20260709 12:23:04.337908  2536 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.297s	user 0.000s	sys 0.018s
W20260709 12:23:04.395982 31566 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.031s
W20260709 12:23:04.428473 31566 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.032s
W20260709 12:23:04.428709 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.013s	sys 0.020s
W20260709 12:23:04.401608 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.014s	sys 0.020s
W20260709 12:23:04.428990 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.020s
W20260709 12:23:04.429160 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.015s	sys 0.020s
I20260709 12:23:04.348058  2316 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:04.346760  2433 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.007s
W20260709 12:23:04.408551 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.419036  2408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.012s	sys 0.027s
I20260709 12:23:04.408622 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.438890 31500 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:04.439757  2493 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.439944 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:04.408535  2486 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.441493 31500 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:23:04.412506 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:04.409494  2471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.011s	sys 0.015s
I20260709 12:23:04.430240 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:04.429322 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 583608us
W20260709 12:23:04.272143  2469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.019s	sys 0.045s
I20260709 12:23:04.434049 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2697) took 2265 ms. Trace:
I20260709 12:23:04.427577  2056 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.437801 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.442493 31491 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:04.457008 31420 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:04.441857 31500 pending_rounds.cc:85] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 2
I20260709 12:23:04.424703  2273 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.463261 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.463471 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:04.464028 31491 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:04.445016 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:04.436602 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:04.464859 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:04.441793 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 440053us
I20260709 12:23:04.451784 31416 rpcz_store.cc:276] 0709 12:23:02.168824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.730279 (+561455us) service_pool.cc:224] Handling call
0709 12:23:02.738737 (+  8458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:02.748072 (+  9335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.748106 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:02.768384 (+ 20278us) log.cc:844] Serialized 52 byte log entry
0709 12:23:03.680088 (+911704us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:04.422589 (+742501us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.422801 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.422887 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.433841 (+ 10954us) raft_consensus.cc:1685] finished
0709 12:23:04.433864 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.433993 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1743,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":4896,"thread_start_us":1418173,"threads_started":2,"wal-append.queue_time_us":1124614}
I20260709 12:23:04.454210 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:04.466007 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43828.7us
I20260709 12:23:04.457880 31500 pending_rounds.cc:107] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:23:04.442874 31418 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:04.474076 31500 raft_consensus.cc:2889] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.457901 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.426169  2495 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.455586  2486 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.462502 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1596) took 1224 ms. Trace:
W20260709 12:23:04.455303  2469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.019s	sys 0.046s
I20260709 12:23:04.470208 31491 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:04.476017 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:04.480454 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:04.464990  2352 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.999s	user 0.009s	sys 0.004s
I20260709 12:23:04.483978 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:04.485111 31419 rpcz_store.cc:276] 0709 12:23:03.238190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.379643 (+141453us) service_pool.cc:224] Handling call
0709 12:23:03.380021 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.385436 (+  5415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.385480 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.386135 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.695722 (+309587us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:03.695785 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.695876 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.462271 (+766395us) raft_consensus.cc:1685] finished
0709 12:23:04.462289 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.462427 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4991,"raft.queue_time_us":5964,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9554,"thread_start_us":263547,"threads_started":1,"wal-append.queue_time_us":594238}
I20260709 12:23:04.427213  2490 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.445967  2549 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:23:04.507540 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.520068 31491 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:04.511270 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:04.441512  2433 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.528172 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.509550 31500 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:04.529153 31492 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:04.468953  2465 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.471771  2402 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.483950  2403 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.503630  2264 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.497931  2474 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:04.511714  2352 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:04.515408  2552 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:04.468086  2273 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.505354  2547 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.515571  2415 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.513650  2560 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:04.561617  2087 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:04.569896 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 139712us
I20260709 12:23:04.662693 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.649955  2552 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.663398  2552 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:04.664099  2544 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:23:04.664199  2410 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:04.664816 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.665036  2445 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.665228 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.665365 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1497) took 1128 ms. Trace:
I20260709 12:23:04.665547  2445 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:04.667779  2546 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 12:23:04.668452  2445 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.668876 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1494) took 1141 ms. Trace:
I20260709 12:23:04.669019 32106 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:23:04.669147  2406 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:04.669891  2548 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:23:04.669807  2406 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.670629 32113 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:23:04.671088 32113 pending_rounds.cc:85] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 7
I20260709 12:23:04.671314 32113 pending_rounds.cc:107] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:04.671543 32113 raft_consensus.cc:2889] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.672016  2406 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.672511  2406 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:04.672856 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:04.672943  2406 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.674628 32114 pending_rounds.cc:85] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 8
I20260709 12:23:04.649703  2352 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.674984 32114 pending_rounds.cc:107] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:04.675068  2352 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:04.675239  2550 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:23:04.675302 31416 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:04.675299 32114 raft_consensus.cc:2889] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:04.676306  2410 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.578462  2477 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:04.595995  2424 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:04.669019  2445 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:04.678382  2424 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:04.678901  2445 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.662285  2547 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.679574  2424 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.681813 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.682644 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.683382 31423 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:04.683873 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:04.684132 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:04.601191  2541 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.601s	user 0.004s	sys 0.000s
I20260709 12:23:04.684736  2560 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:04.684790 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:04.604274  2539 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.608s	user 0.001s	sys 0.000s
W20260709 12:23:04.624152  2543 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:23:04.644505  2296 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.634398  2348 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.568140  2403 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:04.567188  2402 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.516552  2359 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:04.657178 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 194959us
I20260709 12:23:04.683023 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:04.683064 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:04.723861 31419 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.518604  2486 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.678952 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2704) took 1006 ms. Trace:
I20260709 12:23:04.725705 31421 rpcz_store.cc:276] 0709 12:23:03.672497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.672620 (+   123us) service_pool.cc:224] Handling call
0709 12:23:03.672945 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.674879 (+  1934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.674921 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.675484 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.406392 (+730908us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:04.406450 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.406549 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.678741 (+272192us) raft_consensus.cc:1685] finished
0709 12:23:04.678771 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.678899 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39997,"raft.run_cpu_time_us":604,"raft.run_wall_time_us":47442,"thread_start_us":730385,"threads_started":1,"wal-append.queue_time_us":754636}
I20260709 12:23:04.599789  2430 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.685545 32108 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:04.684813 31423 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:04.684939 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.669250 31493 rpcz_store.cc:276] 0709 12:23:03.527453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.527622 (+   169us) service_pool.cc:224] Handling call
0709 12:23:03.528042 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.528418 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.528472 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.529028 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.078994 (+549966us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:04.079056 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.079152 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.668672 (+589520us) raft_consensus.cc:1685] finished
0709 12:23:04.668692 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.668824 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2036,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":18407,"thread_start_us":487770,"threads_started":1,"wal-append.queue_time_us":832382}
I20260709 12:23:04.687139  2413 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.661857  2414 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.317s	user 0.010s	sys 0.019s
I20260709 12:23:04.721844 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.607376  2529 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:04.744180  2257 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.744712  2257 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.665760 31494 rpcz_store.cc:276] 0709 12:23:03.537266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.537378 (+   112us) service_pool.cc:224] Handling call
0709 12:23:03.537687 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.538086 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.538126 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.543374 (+  5248us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.989420 (+446046us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:03.989475 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.989565 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.646289 (+656724us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4800231e58. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:23:04.665111 (+ 18822us) raft_consensus.cc:1685] finished
0709 12:23:04.665133 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.665311 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2175,"raft.run_cpu_time_us":4925,"raft.run_wall_time_us":1106252,"spinlock_wait_cycles":14791040,"thread_start_us":445466,"threads_started":1,"wal-append.queue_time_us":852792}
I20260709 12:23:04.746097  2408 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:04.746477  2408 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:04.747259  2408 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.2, Last appended by leader: 2, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.748385 32111 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:04.749188  2406 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.739099 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:04.517920  2320 consensus_queue.cc:1175] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" responder_term: 9 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.9-8.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:04.742771  2413 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.750851  2535 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.751055  2551 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:04.751957  2413 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.752233  2551 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:04.752645  2551 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:04.753680 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:04.753484  2551 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.754945 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1601) took 1515 ms. Trace:
I20260709 12:23:04.755354  2533 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.755748  2406 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:04.756320  2294 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:04.756791 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 544) took 2985 ms. Trace:
I20260709 12:23:04.730594  2348 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.755290 31424 rpcz_store.cc:276] 0709 12:23:03.239698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.402843 (+163145us) service_pool.cc:224] Handling call
0709 12:23:03.403217 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.456456 (+ 53239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.456487 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.456951 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.803634 (+346683us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:03.803880 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.597545 (+793665us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b540010de54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:04.597612 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.623435 (+ 25823us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:04.754743 (+131308us) raft_consensus.cc:1685] finished
0709 12:23:04.754762 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.754881 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":126800640,"thread_start_us":346155,"threads_started":1,"wal-append.queue_time_us":919045}
I20260709 12:23:04.757613  2348 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:04.758272  2557 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:23:04.758613 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:04.759359 31424 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:04.760833  2348 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.743422  2402 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.756515  2406 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:04.762316  2406 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:04.757211 31417 rpcz_store.cc:276] 0709 12:23:01.771489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.675276 (+903787us) service_pool.cc:224] Handling call
0709 12:23:02.675516 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.686905 (+ 11389us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:02.686934 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.696099 (+  9165us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.603972 (+907873us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:03.604015 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.604077 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.603601 (+999524us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:04.756504 (+152903us) raft_consensus.cc:1685] finished
0709 12:23:04.756524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.756735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18613,"raft.queue_time_us":16256,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":3343,"spinlock_wait_cycles":14492416,"thread_start_us":900755,"threads_started":1,"wal-append.queue_time_us":1072796}
I20260709 12:23:04.757078  2294 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:04.764225  2294 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.765614 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:04.769165  2551 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:04.723091  2475 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:04.715540  2393 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:23:04.715822  2285 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:23:04.771267  2352 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.755441 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:04.784695 31419 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:04.798178 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:04.685384  2560 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:04.802416 31390 connection.cc:256] RPC call timeout handler was delayed by -1.0332905870000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 12:23:04.775010  2433 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.781872  2273 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.807826  2285 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.813905  2560 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.725133  2403 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.779163  2508 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.820875 31494 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:04.783445  2475 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:04.800122  2495 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:04.772900  2486 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.810050  2480 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:04.828662 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 319703us
I20260709 12:23:04.832634 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:04.782644  2473 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.852221 31572 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:23:04.739908  2474 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.823848  2495 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.857002 31567 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:04.776201  2087 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.864856 31568 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:23:04.859784 31574 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:04.878882 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.861693 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1581) took 1181 ms. Trace:
W20260709 12:23:04.869968 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 396119us
I20260709 12:23:04.928702 31566 rpcz_store.cc:276] 0709 12:23:03.680710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.680858 (+   148us) service_pool.cc:224] Handling call
0709 12:23:03.691222 (+ 10364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:03.691445 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:04.428837 (+737392us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.861412 (+432575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:04.861464 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:04.861501 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.861555 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.861642 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6534,"prepare.queue_time_us":389293,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":92364,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":31621,"thread_start_us":1140349,"threads_started":3,"wal-append.queue_time_us":403166}
I20260709 12:23:04.884029 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.931609 31496 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:04.908196 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:04.914126 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:04.863281 31565 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:04.914485 31570 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:04.930827 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:04.937734 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:04.837329  2486 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:04.940224 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.940001 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:04.828631  2285 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 12:23:04.944120 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 318063us
W20260709 12:23:04.854799  2531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.018s	sys 0.006s
I20260709 12:23:04.875275  2458 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:04.949353 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:04.909425  2568 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.956924  2560 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:04.957527  2560 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.959996  2560 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.916493  2495 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.966415 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2545) took 1152 ms. Trace:
I20260709 12:23:04.967242 31570 rpcz_store.cc:276] 0709 12:23:03.813711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.813822 (+   111us) service_pool.cc:224] Handling call
0709 12:23:03.825924 (+ 12102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.933767 (+1107843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.966181 (+ 32414us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400318154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:04.966350 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503061760}
W20260709 12:23:04.950927  2531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.020s	sys 0.008s
I20260709 12:23:04.965358 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:04.945727  2508 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.962659 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 830) took 1140 ms. Trace:
I20260709 12:23:04.970819 32111 rpcz_store.cc:276] 0709 12:23:03.822693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.826864 (+  4171us) service_pool.cc:224] Handling call
0709 12:23:04.962436 (+1135572us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b540052ec54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:04.962581 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086412032}
I20260709 12:23:04.971985 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:04.951406  2458 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:04.978205  2458 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.979279  2458 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:04.979440  2564 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:04.980993  2406 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.973279  2570 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.948203  2056 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:04.983672  2570 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.984747  2056 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.985755  2570 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:04.985924  2122 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.002s
I20260709 12:23:04.966713  2560 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.965570  2547 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.973753  2533 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:04.986358  2296 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.986470  2560 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.986970  2533 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:04.987680  2403 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:04.987941  2533 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.988472  2473 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:04.988726  2560 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.989027  2533 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:04.966228  2552 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.990875  2406 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:04.937657  2475 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:04.974574  2508 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:04.973129  2413 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:04.994756  2316 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 12:23:04.995074  2490 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.964702  2471 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:23:04.995405  2486 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:04.997740  2475 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.967172  2568 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:04.855186 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 418618us
I20260709 12:23:04.936225 31494 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:05.009163  2352 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:05.073212  2284 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.051923 31388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.006s
W20260709 12:23:05.074576 31388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.010s	sys 0.006s
I20260709 12:23:05.054473 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:05.077230 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 105150us
I20260709 12:23:05.079411  2348 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.080291  2348 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:05.079582  2316 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.080960  2348 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.996680  2296 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.056341 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 483787us
I20260709 12:23:05.057657 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1562) took 1204 ms. Trace:
I20260709 12:23:05.087206 31499 rpcz_store.cc:276] 0709 12:23:03.853200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.394608 (+541408us) service_pool.cc:224] Handling call
0709 12:23:04.396979 (+  2371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.397210 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.397242 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.397753 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.649234 (+251481us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:04.649274 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.649351 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.056798 (+407447us) raft_consensus.cc:1685] finished
0709 12:23:05.056907 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.057308 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":222896,"threads_started":1,"wal-append.queue_time_us":424828}
I20260709 12:23:05.092338 31419 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:05.061028 31416 raft_consensus.cc:2368] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
W20260709 12:23:05.064131 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.093075  2279 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:05.093694 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.095264 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.095579 31424 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:05.095454 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.096829 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.097833  2352 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:05.098416  2352 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:05.100710  2352 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.067344 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:05.102280 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.102978 31570 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:05.071102  2122 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.104733 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.104676  2122 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.105628 31417 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:05.106379 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.106658 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:05.108054 31494 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:05.109006 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.107833 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:05.107650 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.108613 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.109587  2393 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.109828  2471 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:05.141947 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.143330 31495 raft_consensus.cc:2410] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:05.147430 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.148367 31494 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.018851  2552 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.151432  2531 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:05.152796  2531 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.067390 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:05.154935 31498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1552) took 1469 ms (client timeout 1658 ms). Trace:
W20260709 12:23:05.155613 31498 rpcz_store.cc:269] 0709 12:23:03.685099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.685237 (+   138us) service_pool.cc:224] Handling call
0709 12:23:05.154443 (+1469206us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400360e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:05.154706 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245026176}
I20260709 12:23:05.156270  2352 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.022235  2495 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.165350  2257 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.020565  2508 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.110348  2480 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:23:05.020532  2568 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.170518  2122 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.010816  2486 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.171612 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64182.1us
I20260709 12:23:05.173700 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.174692 32114 raft_consensus.cc:2410] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:23:05.071727  2337 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.140429  2471 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.180614  2264 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:05.176774 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.181278  2264 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:05.181937  2264 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.183516 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.183790 32114 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:05.072088  2285 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:23:05.185410 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.187373 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:05.187772 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.187916 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 121075us
I20260709 12:23:05.188349 32111 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:05.188529  2430 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.189333  2430 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.189764  2471 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:05.191152 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 52234us
I20260709 12:23:05.193722  2559 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:05.189713  2474 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.197081  2508 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:05.198261 31419 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:05.188023  2316 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.197916  2508 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.189323 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.162289  2495 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.253937 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.258529 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.276651 31494 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:05.279255  2552 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.279366 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.279663  2531 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.280325 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:05.280392  2533 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:23:05.281044  2291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.005s	sys 0.034s
W20260709 12:23:05.281451  2291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.005s	sys 0.034s
W20260709 12:23:05.282011 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92965.6us
I20260709 12:23:05.282222  2291 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.291213  2533 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:05.291993  2533 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:05.293630  2533 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.297015 32079 leader_election.cc:336] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.604s (SENT)
I20260709 12:23:05.299011 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.299988 31424 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:05.300175  2425 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.297595 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 760) took 1474 ms. Trace:
W20260709 12:23:05.294468  2306 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.011s
I20260709 12:23:05.300736 32112 rpcz_store.cc:276] 0709 12:23:03.823290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.826243 (+  2953us) service_pool.cc:224] Handling call
0709 12:23:03.826509 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.826897 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:04.648489 (+821592us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b1800250c00. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc11d15b3c7 00007fc11976d9a7 00007fc11977d0bf 00007fc11977d038
0709 12:23:04.915739 (+267250us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.280621 (+364882us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.288222 (+  7601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:05.289082 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.289321 (+   239us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:05.289371 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.289505 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.297169 (+  7664us) raft_consensus.cc:1685] finished
0709 12:23:05.297190 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.297377 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181952,"prepare.queue_time_us":610077,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":81,"raft.queue_time_us":157578,"raft.run_cpu_time_us":516,"raft.run_wall_time_us":133655,"spinlock_wait_cycles":3190528,"thread_start_us":427290,"threads_started":2,"wal-append.queue_time_us":176309}
I20260709 12:23:05.258373  2559 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:23:05.302594  2306 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.304134 31571 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8.
I20260709 12:23:05.305517  2531 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:05.306658  2535 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:05.307037  2430 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.307075  2535 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:05.308208  2573 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:05.308984  2573 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.308771  2535 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.311663  2549 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:05.312397  2535 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.312638  2122 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.313030  2573 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:05.311240 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 202901us
I20260709 12:23:05.316244  2425 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.320068 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.322031 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.323845 32108 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:05.324596 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.325477 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.309664 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.337000 31417 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:23:05.338718 32108 pending_rounds.cc:85] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 4
I20260709 12:23:05.340651  2559 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:05.346024 31499 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:05.348980 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.351377  2359 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.352564 31570 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:05.352674  2359 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.354861 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.355294  2122 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:05.358736 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 171131us
I20260709 12:23:05.360857 31390 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.360962  2374 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:05.362773 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:05.363987  2458 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.364671 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:05.365628  2458 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:05.366212  2458 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:05.367918  2458 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:05.370347 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.368136 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:05.371611 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:05.374548  2403 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:05.375115  2403 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:05.376267  2403 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.381261  2433 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 3 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:05.385067  2393 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:05.385562  2393 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.385978  2393 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.388244  2056 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:05.388720  2056 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.389113  2056 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.389844  2467 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:05.390564  2467 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.391232 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.391861 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.393023  2348 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.394790 32111 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:05.398083  2495 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:05.398258 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.399328  2285 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:05.399772  2285 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:05.399827  2567 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.400002  2306 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.401325 32109 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:05.401911  2537 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.633s	user 0.003s	sys 0.002s
I20260709 12:23:05.401475  2285 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.343758  2559 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:05.355854 31573 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:05.403744  2559 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.405835  2533 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.408500 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 551) took 3204 ms. Trace:
I20260709 12:23:05.411456 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.413782  2315 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:05.414302 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.415274  2279 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.415699  2279 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.416050  2279 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.431330 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:05.438170 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.439833  2573 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.440351  2573 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.440833  2573 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.343011 32108 pending_rounds.cc:107] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 12:23:05.444676 32108 raft_consensus.cc:2917] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 12:23:05.445191 32108 raft_consensus.cc:2889] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.447345  2348 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:05.448442  2122 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:05.414309  2315 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:05.452380  2315 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.454210  2315 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.461149  2285 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:05.458318  2408 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.464205 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.469887 31494 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:23:05.470264 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.472692  2559 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.481186  2359 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.466993 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.467811  2485 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:05.482756  2485 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:05.484043  2485 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.485148  2485 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.485455 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.486416 31571 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:05.489806  2445 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:05.491581 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 107557us
I20260709 12:23:05.495622 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.496753  2359 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:05.497218  2359 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.497565  2359 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:05.497946 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.498659 31498 raft_consensus.cc:2376] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10. Re-sending same reply.
I20260709 12:23:05.499984 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.426767 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:05.546481 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.551077 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.551788 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.552538 31495 raft_consensus.cc:2376] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8. Re-sending same reply.
I20260709 12:23:05.556005 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.556859 31495 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:05.556893 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.555181 31319 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 5 to 6, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.559244 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.560514  2430 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:05.560803 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162705us
I20260709 12:23:05.561128  2430 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.562006  2490 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:05.562609  2490 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:05.563133  2406 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.563937  2475 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.563688  2406 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.564456  2475 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.564967 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.565754 31571 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:05.565867  2406 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.562033 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 275598us
I20260709 12:23:05.563694  2490 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.567351  2430 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.569535 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.572070  2430 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:05.572757  2430 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.574898  2508 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.575760  2430 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.576454 31319 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 7 to 8, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 8 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:05.580477  2467 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.566959 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.408972 31422 rpcz_store.cc:276] 0709 12:23:02.203972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.086026 (+882054us) service_pool.cc:224] Handling call
0709 12:23:03.086400 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:03.089484 (+  3084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.089513 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:03.089964 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.505230 (+415266us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:03.505286 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.505376 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.358593 (+1853217us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:05.407985 (+ 49392us) raft_consensus.cc:1685] finished
0709 12:23:05.408014 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.408300 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2682,"raft.queue_time_us":3712,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":17239,"spinlock_wait_cycles":517649152,"thread_start_us":414909,"threads_started":1,"wal-append.queue_time_us":586826}
W20260709 12:23:05.581341 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135128us
I20260709 12:23:05.551831 31498 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:23:05.560642 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.586663 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.591451 31494 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:05.578559 31319 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.600914 31319 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 1 to 6, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 6 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:23:05.603262 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.604528  2410 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.604631 31319 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.605615 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.610562 31498 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:05.612162  2306 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.613222 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.614235 31571 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:05.614665  2413 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:05.615382 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.615268  2413 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.616900 32108 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:05.617353  2572 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.617532  2413 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.618928 32108 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:05.619419  2296 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.620995  2599 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:05.621634 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.622560 32111 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:05.590411  2348 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.623245  2348 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.623654  2348 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.624419 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.625034 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:05.626250 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.635573 32108 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEARNER]: Advancing to term 9
I20260709 12:23:05.627218 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.617962  2572 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.650415 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80997.3us
I20260709 12:23:05.651566 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:05.653301 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:05.659430 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.660143 32107 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.671617 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.672382 32111 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.679430 32113 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:05.659500  2296 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:05.680851  2296 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:05.681219  2296 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.682554 32107 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:05.690107 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:05.689195 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.712121 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.694883 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:05.693970 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.674614  2599 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.693296 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.747853 32106 raft_consensus.cc:2410] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:05.749511 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:05.747300  2279 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.682607  2573 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.675906  2393 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.764523  2294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.048s
W20260709 12:23:05.796661  2294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.017s	sys 0.048s
I20260709 12:23:05.764741  2348 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.765909 32111 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:05.770527  2285 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:05.770879 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80974.2us
I20260709 12:23:05.771355  2485 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:05.771880 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.777683  2572 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.777310  2359 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.748175  2056 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.779312  2475 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:05.758163  2534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.045s
I20260709 12:23:05.758440  2122 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:05.783473 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:05.782769  2408 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:23:05.778509  2264 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.596s	user 0.000s	sys 0.015s
W20260709 12:23:05.795797 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.804855 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.806340 31493 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:05.809157 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.811385 31319 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 5 to 6, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.819097 32113 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:05.812280  2348 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.810212  2534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.017s	sys 0.045s
W20260709 12:23:05.809312  2471 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.009s
I20260709 12:23:05.799485  2284 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.823729 32109 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:05.824808  2406 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:05.827231 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44276.8us
I20260709 12:23:05.814421  2294 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.832273 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:05.839886 31570 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.830816 31319 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 6, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.829767 32111 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:05.841821 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:05.846745 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.847566 31318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 298) took 31737 ms (client timeout 15000 ms). Trace:
I20260709 12:23:05.848892  2552 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.849489  2552 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.849669  2284 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.850939  2406 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.851713  2552 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.852408 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.852629 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:05.853344  2406 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.853996  2406 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.853817 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:05.854735  2495 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:05.855338  2572 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:05.855741  2572 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:05.855513  2495 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.856720 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:05.859320  2535 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 12:23:05.832986  2485 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.860359  2552 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.862010  2485 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:05.848110 31318 rpcz_store.cc:269] 0709 12:22:34.110460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.110817 (+   357us) service_pool.cc:224] Handling call
0709 12:23:05.847255 (+31736438us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:02.035523 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:02.036120 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:02.036159 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:23:02.036179 (+    20us) tablet.cc:662] Decoding operations
0709 12:23:02.036960 (+   781us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:02.037039 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:02.037071 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:02.037610 (+   539us) tablet.cc:701] Row locks acquired
0709 12:23:02.037629 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:02.037775 (+   146us) write_op.cc:270] Start()
0709 12:23:02.037890 (+   115us) write_op.cc:276] Timestamp: P: 1783599782037726 usec, L: 0
0709 12:23:02.037914 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:02.135060 (+ 97146us) log.cc:844] Serialized 2515 byte log entry
0709 12:23:02.812534 (+677474us) op_driver.cc:464] REPLICATION: finished
0709 12:23:03.231445 (+418911us) write_op.cc:301] APPLY: starting
0709 12:23:03.231548 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:03.231730 (+   182us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:03.231849 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:03.310739 (+ 78890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:03.384892 (+ 74153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:23:03.400653 (+ 15761us) write_op.cc:312] APPLY: finished
0709 12:23:03.418562 (+ 17909us) log.cc:844] Serialized 53 byte log entry
0709 12:23:03.431334 (+ 12772us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:03.442472 (+ 11138us) write_op.cc:454] Released schema lock
0709 12:23:03.445282 (+  2810us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:03.473584 (+ 28302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:03.481882 (+  8298us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20309,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":418624,"apply.run_cpu_time_us":3870,"apply.run_wall_time_us":221531,"num_ops":6,"prepare.queue_time_us":259056,"prepare.run_cpu_time_us":13135,"prepare.run_wall_time_us":490747,"raft.queue_time_us":185742,"raft.run_cpu_time_us":23298,"raft.run_wall_time_us":153901,"replication_time_us":774443,"thread_start_us":738435,"threads_started":4,"wal-append.queue_time_us":424160,"wal-append.run_cpu_time_us":17363,"wal-append.run_wall_time_us":1887022}]]}
I20260709 12:23:05.862847  2285 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:05.865242 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.865028  2294 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.866964  2475 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.867291 31499 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:05.867404  2475 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:05.867947  2475 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.868378 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:05.869763 31466 leader_election.cc:400] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:05.870010 31466 leader_election.cc:403] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:05.831677  2471 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:05.870795 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.871598 31420 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:05.871924  2573 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:05.876262 32113 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:05.878574 32114 raft_consensus.cc:2368] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:05.883561 32108 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:05.884876  2552 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.885578 31422 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:05.885986 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54208.8us
I20260709 12:23:05.866595 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.899372 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:05.899999 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:05.902753 32112 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:23:05.903939 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:05.904716 32106 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:05.851727  2284 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:05.823037  2264 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.920058 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.902559 31319 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:05.898054  2485 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:05.921217 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.925312 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:05.921057 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.924366 31416 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:05.885426  2465 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:23:05.885538  2552 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:05.921491 32080 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 1.648s (SENT) [suppressed 20 similar messages]
I20260709 12:23:05.914602  2535 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:05.944970 31498 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:05.930747 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.936602 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:05.937487 32107 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:05.938454 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.947052 31417 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:05.936125 31319 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 5, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:05.910351  2410 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:23:05.919606  2406 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:23:05.961783 31319 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 6 to 7, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:05.943740  2535 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.856737  2572 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:23:05.968111 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79169us
I20260709 12:23:05.950172  2284 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.970456 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.975178 31418 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:05.980464 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:05.981242 31417 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:05.974400  2284 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:05.992482 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:05.971769  2535 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.993481 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:05.978879 31492 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 5.
W20260709 12:23:05.984639  2486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.047s
I20260709 12:23:05.990412 31319 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 5, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.018206 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:05.990208  2284 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.020888 31417 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.031508  2306 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:23:06.034512  2296 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.035795  2264 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:06.003141  2547 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.036686  2547 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.037135  2547 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.037329  2296 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:06.014051  2460 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:05.997004  2056 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:06.018337  2486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.018s	sys 0.048s
W20260709 12:23:06.039278 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.013953  2403 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:06.022619 31418 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:06.018996  2315 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:06.044363 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:06.051782  2604 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:23:06.034561  2306 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:06.060171 31424 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:05.975945  2508 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:23:06.049835  2403 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:06.079457  2603 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:23:06.080902  2508 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:06.081337  2508 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:06.082312  2508 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.083573  2508 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:06.087559 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.087805 31423 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:23:06.072398 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.058246  2460 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:06.061506  2306 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:06.104542 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.107461 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.105319 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:06.092154  2403 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.118295 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.121841 31497 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:23:06.122298  2495 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.123821  2471 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:06.123306  2306 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.124950  2306 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:06.125059 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.127175  2285 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.128559  2552 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.131912  2393 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.131835  2495 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:06.132848  2495 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:06.133163  2495 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:06.133240 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:06.134085  2610 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:23:06.134829 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.135350 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:06.135881 32114 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.137967  2573 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.138543  2573 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.141045  2573 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.134292  2495 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.142983  2495 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:06.111977  2606 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:23:06.120056 31319 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.134194 32112 raft_consensus.cc:2410] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:06.153102 31416 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:06.155164 31417 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:06.120121  2122 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.106278  2315 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:23:06.176643 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.180876 32106 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:06.196213 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.179250  2122 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.163457 31319 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 5, leader changed from <none> to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 5 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:06.199347 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 265105us
W20260709 12:23:06.220000 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.220595 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.220525 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:06.204414 31419 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:06.221937  2408 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.222493  2408 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.224807  2408 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.213356 31319 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:23:06.232112  2460 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.205552  2122 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.235942 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.236608 31417 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:06.214208  2294 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.239825  2284 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.241982  2284 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.242894 31420 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:06.167449  2475 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.245361  2348 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.251520  2348 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.252759  2475 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.253479 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:06.257164 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 195084us
I20260709 12:23:06.257706 32114 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:06.276119 31570 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:06.279987 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.197631  2573 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:23:06.273279  2602 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:06.281893 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:06.289110 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:06.294643 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.288534 31492 raft_consensus.cc:2376] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7. Re-sending same reply.
I20260709 12:23:06.300581 31417 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:06.302170 31415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
W20260709 12:23:06.299681 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 378201us
I20260709 12:23:06.304773 31415 raft_consensus.cc:606] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.305157 31415 raft_consensus.cc:614] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:06.302554  2279 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.285586  2352 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:06.312893 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:06.315629 31417 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:06.320274  2352 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:06.321308  2352 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.318243  2599 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.323259  2599 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:06.323783  2599 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.330374  2559 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.331174  2559 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.334002  2559 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:06.340677 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.346985 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.352926 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:06.316473  2486 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:06.317731  2359 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:06.364998 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 265401us
I20260709 12:23:06.347014  2284 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:06.371563 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73889.5us
I20260709 12:23:06.358206  2559 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:06.379093 31491 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:06.373968 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.382068 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.386387  2359 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.386761 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.387615  2359 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.387032 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:06.372777  2471 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:06.424713 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:06.449012 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 75145.2us
I20260709 12:23:06.377823  2559 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.393193  2359 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.464937 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.455627  2475 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:06.489001 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102378us
I20260709 12:23:06.379843  2486 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.483091 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:06.491221 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.491784 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67640.2us
W20260709 12:23:06.493892 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 43575.6us
I20260709 12:23:06.468613  2508 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:06.472894  2471 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.500454 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.459933  2348 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.394508  2279 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:06.462846  2495 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:23:06.494868 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:06.506011 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.511168 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.493189  2475 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.455186  2535 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.508013 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.493378  2559 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.524044 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:06.525350 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.393563  2284 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.526894  2529 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.526980 31499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:23:06.527390  2529 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.527815  2529 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.529142  2535 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.529779  2535 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:06.530628  2475 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.526310 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:06.526907 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.534400 31500 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:06.535208  2616 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.535313 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:06.536032  2616 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.536721 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:06.537518 31500 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:06.541836 31495 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:06.543144  2573 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:06.543545  2573 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:06.543660  2619 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:06.544442  2573 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:06.550295  2607 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.358s	user 0.001s	sys 0.003s
I20260709 12:23:06.519213  2508 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:06.552680  2471 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.542491 31493 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:23:06.554252 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.565752 31500 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:06.464391  2465 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:23:06.494086  2294 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:06.554343  2433 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:06.594751 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.597460 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:06.598295 32110 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:06.598990  2315 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:06.599601  2508 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:06.603024 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112316us
I20260709 12:23:06.604594 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:06.605860  2574 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:06.606247  2574 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:06.606415  2616 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.607126  2574 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.607685  2348 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:06.608206  2348 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:06.608469  2547 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.006s
I20260709 12:23:06.609086  2552 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:06.608961  2547 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.609513  2552 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:06.610212 31492 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:06.610292  2471 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.610387  2552 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.604748 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 615) took 1054 ms. Trace:
I20260709 12:23:06.611032  2471 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:06.512809  2306 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.612461 31497 rpcz_store.cc:276] 0709 12:23:05.550202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.550329 (+   127us) service_pool.cc:224] Handling call
0709 12:23:05.550964 (+   635us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:06.122263 (+571299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.604443 (+482180us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400024ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:06.604668 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264551680}
W20260709 12:23:06.633487 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.602509  2284 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.647255 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:06.647862 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.644848 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 129630us
I20260709 12:23:06.633180  2433 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:06.650264  2613 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:23:06.650484  2549 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.651139  2549 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.650612  2433 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.651490  2549 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.654874  2552 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.655017  2555 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:06.655633  2555 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:06.656699  2555 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.658056  2555 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.660543  2573 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.661943  2622 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.665434  2599 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:06.671573 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.584523  2495 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:06.676440 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:06.687794 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.568905  2122 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.634287  2296 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.631134  2279 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:06.694614 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.699638 31422 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:06.705871 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172323us
W20260709 12:23:06.705897 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101375us
I20260709 12:23:06.710489 31570 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:06.709335 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:06.712849 31572 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:06.713323 32114 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:06.713313 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 185594us
I20260709 12:23:06.707306 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.609113  2348 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.697122  2531 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.725723 32105 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:06.690068  2622 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.685268  2559 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:06.714769  2620 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:23:06.675297  2306 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.718374 31573 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:06.714493  2408 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.679227  2294 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.726274 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:06.702629  2495 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.738164  2572 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.738814 31568 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:06.738735  2490 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:06.835786  2490 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:06.836314  2641 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:06.837320  2486 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:06.837988 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.743330  2630 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.838747  2630 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.841641  2630 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.729557  2531 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.843835  2531 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.744765  2529 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.844300  2495 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.846060  2529 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.745730  2628 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:06.846994  2628 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:06.848119  2628 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.746068  2122 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.846239 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.746660 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:06.747493 32108 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:06.748207  2547 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.749142  2306 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:06.751441 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.776826  2622 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:06.712333  2296 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.785962  2408 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.730075  2629 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.749712  2475 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.755008  2359 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.865239  2359 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.800868  2549 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.865388  2629 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.866582  2574 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.867463  2549 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.867851  2629 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.860383 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.868783 31423 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.804354  2559 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:06.805984 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85034.3us
I20260709 12:23:06.872401  2408 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.872875  2296 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.808967  2279 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.816247 31572 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:06.730949 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:06.817269 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 111960us
W20260709 12:23:06.818941 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.825315 32110 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:23:06.816989 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62368.6us
W20260709 12:23:06.752774  2623 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:23:06.831341 31422 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:06.833534 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.740285  2599 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.836874  2490 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.738449  2284 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:23:06.852523 32114 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:06.853135 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.847008 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 132752us
I20260709 12:23:06.850878 31424 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:06.856981 31491 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:06.888972 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:06.858356 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.890283 31499 raft_consensus.cc:606] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.890712 31499 raft_consensus.cc:614] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:06.835353  2403 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.003s
I20260709 12:23:06.860839 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:06.874936 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.892015 31418 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:06.875118 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.893054 31570 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:23:06.877300 31574 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:06.894093  2535 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.894510  2535 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:06.894905  2535 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.895752 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.897336 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.897486 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2732) took 1028 ms. Trace:
I20260709 12:23:06.898864  2616 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:06.882493 31573 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:23:06.900184  2403 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:06.901690 31496 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:06.902351  2403 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.891980 32108 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:06.880052 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.912039 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:06.898000 31421 rpcz_store.cc:276] 0709 12:23:05.868483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.868784 (+   301us) service_pool.cc:224] Handling call
0709 12:23:05.869141 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.869478 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.869509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.168741 (+299232us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b2c00000c88. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:23:06.179007 (+ 10266us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.391094 (+212087us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:06.391137 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.391205 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:06.752242 (+361037us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:06.897170 (+144928us) raft_consensus.cc:1685] finished
0709 12:23:06.897191 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.897321 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":358,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":15931904,"thread_start_us":171161,"threads_started":1,"wal-append.queue_time_us":347317}
I20260709 12:23:06.865268  2475 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:06.914088 31573 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:06.913426 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:06.882611 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.915202 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.904841  2535 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.890225  2552 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:06.881575 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.906425 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.906623 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.916415 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:06.919173 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:06.922712  2616 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:06.923285  2616 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:06.924201  2465 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.924672  2465 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:06.924852  2629 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:06.924412  2616 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.925238  2465 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.925416  2629 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:06.926662 31568 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:06.897543 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:06.927134 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.927563 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.927695 31424 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.927908 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.928162 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.928503 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:06.929337 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.917153  2359 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:06.915161  2547 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.930574  2547 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.918329 31571 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:06.932575 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.921901 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.933813 31573 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:06.930402 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:06.936525 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.936789 31565 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:06.941768 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.951508 31574 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:06.955058 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.958966 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:06.959061 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 80263.3us
I20260709 12:23:06.915411  2508 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.961483 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:06.967267 31417 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:06.961956 31496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:23:06.963555  2547 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:06.964063  2552 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:06.926396  2629 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:06.971958  2637 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:06.972425  2637 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:06.972811  2637 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:06.973007 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:06.973624 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:06.966118 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.968348 31496 raft_consensus.cc:606] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:06.975034 31496 raft_consensus.cc:614] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:06.975297 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:06.915773  2348 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:06.971352 31571 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:06.975486 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.950969  2475 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:06.980342 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:06.983987 31574 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:06.977854  2638 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.986150 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:06.985008 31565 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:23:06.959692  2495 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:07.013144 31499 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:23:07.013829 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.014127 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.024685 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:07.013568 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.034009 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.034848 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.035336  2471 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:07.035744 31572 raft_consensus.cc:2410] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:07.034849 31566 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
W20260709 12:23:07.038199 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.050940 31424 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:07.051488 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98076.4us
I20260709 12:23:06.988106  2638 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.984370  2475 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.063246  2403 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.063875  2403 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.064498 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.065104 31568 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:07.065909 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.069087  2403 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:07.070729 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:07.073220  2490 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.093977 31567 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.024451  2572 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:07.077033 31574 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:07.066431 31568 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:06.978299  2508 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.081734 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.098981 31565 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:07.099426 31566 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:07.083600 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.100911 31569 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.084148 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:07.102212 31572 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.084594 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.092706 31417 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:07.074999 31573 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:06.977835  2348 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:06.998813  2359 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:23:07.052384  2559 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:07.060242  2638 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.055681  2471 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:07.081975  2475 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.107748 31571 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 5.
I20260709 12:23:07.043812  2264 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:23:07.117103 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:07.058048  2393 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:07.120853 31574 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:07.121419 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.107116  2348 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.125253 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.100783  2294 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:07.244246 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:07.244505 31572 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:07.245119 31420 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:07.113279  2572 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.144050 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:07.112797  2559 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.120003  2552 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:23:07.147117 31566 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:07.148685  2654 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.151285 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.155807 31423 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:07.147688  2637 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:07.236349 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.178313 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 78315.6us
I20260709 12:23:07.158969 31569 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:07.244375 31499 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:07.143147  2471 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:07.247480 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:07.248855 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 96725.2us
W20260709 12:23:07.250160 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.260416 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:07.251222 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.251508 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 107524us
I20260709 12:23:07.266037 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:07.266649 31572 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:07.267452 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.266651 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:07.256417  2649 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:23:07.250561  2559 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:07.273279 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.277297 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.268255 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:07.278787 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.279428 31571 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:07.283363  2547 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:07.283910  2547 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:07.284160 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:07.285059  2549 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:07.284817  2547 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.285573  2549 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:07.286397  2549 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.292035  2535 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:07.301077  2652 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:07.301662  2652 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:07.312374  2559 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:07.314373 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47339us
I20260709 12:23:07.315620 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:07.318902  2637 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:07.263478  2654 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:07.322355  2654 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:07.323326 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.324466 31418 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:07.325462 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.326347 31423 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:07.327059 31566 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:07.327649 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.327898 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.328352 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:07.330986 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.331276 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:07.331585 31569 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:07.331869 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:07.332374 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:07.333122 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:07.333843 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:07.332384 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.334723 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.335095  2306 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.335392 31493 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:07.335389 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.336014 31566 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:07.335666  2306 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:07.336460 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.337209 31500 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:23:07.338009 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.338145  2641 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:07.338455  2306 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:07.330986 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:07.339520 31492 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:07.340606 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:07.341969 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:07.252698  2632 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:07.342901 31418 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 5: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:07.343046  2632 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:07.256646  2403 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:07.345680  2403 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:07.347244 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.349731  2572 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:07.346889  2403 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.351145  2508 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:07.344309  2559 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:07.353498  2573 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:07.354799  2637 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:07.355275  2637 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:07.338294  2465 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:07.355834  2637 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:07.356207  2573 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.358712 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:07.359931 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:07.369220 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:07.367221 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:07.361613  2495 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:07.369227 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:07.370891 31492 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:23:07.369685 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101503us
I20260709 12:23:07.364216  2652 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:07.617673 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.005s	sys 0.009s
I20260709 12:23:07.382880  2654 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:08.172467 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.005s	sys 0.046s
I20260709 12:23:07.994699  2618 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.173794 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:07.715971  2264 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:23:07.679176 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.174716  2264 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:07.491133 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:07.533809 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.176285  2264 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.177168  2495 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:08.181568  2495 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:07.891326 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.493234  2475 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.187209  2652 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.190872 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:07.380019 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.192076 31423 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:07.522414 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 276453us
I20260709 12:23:08.177882  2264 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.178357  2641 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.168615 31572 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.000s
I20260709 12:23:07.408742  2393 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:07.497707  2638 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.194505 31572 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:08.195645  2393 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.193615  2641 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:07.480789 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:07.492894 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:07.633545  2574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.007s	sys 0.008s
I20260709 12:23:07.802843  2296 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.497850 31418 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
W20260709 12:23:07.772006 31419 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.000s	sys 0.018s
I20260709 12:23:07.489467 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.187495 31491 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:07.493921 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:08.016140  2645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.019s
I20260709 12:23:07.500965 31422 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:23:08.196224 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.615607  2628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.009s
W20260709 12:23:07.617787 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.001s	sys 0.013s
I20260709 12:23:07.726125  2508 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.380211 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:07.620023  2348 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.173669  2618 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:07.715917  2465 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:08.241317 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.010s	sys 0.026s
W20260709 12:23:08.241534 31419 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.007s	sys 0.032s
I20260709 12:23:08.201524 31415 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:08.226298 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50632.8us
W20260709 12:23:08.231941 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 862768us
I20260709 12:23:08.226011  2673 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:08.250826  2673 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:08.251201  2673 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:08.251029 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.251397 31565 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:23:08.251914 31565 pending_rounds.cc:85] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:08.252158 31565 pending_rounds.cc:107] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:08.252374 31565 raft_consensus.cc:2889] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:08.248896 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54708.9us
W20260709 12:23:07.755820  2658 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:23:08.252846 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:07.992691  2471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.004s	sys 0.008s
I20260709 12:23:08.253558 31498 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:08.257324 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.253510 31499 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:08.022576  2403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.007s	sys 0.005s
W20260709 12:23:08.252856 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.257197 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.201483  2574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.025s	sys 0.026s
I20260709 12:23:08.259559 31569 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:07.986344  2555 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.799041  2559 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.222944  2662 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.241891  2628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.009s	sys 0.025s
W20260709 12:23:08.248435  2645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.002s	sys 0.026s
W20260709 12:23:08.260373  2403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.010s	sys 0.008s
I20260709 12:23:08.257308  2465 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.231295  2663 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:08.259233  2471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.004s	sys 0.009s
W20260709 12:23:08.287750 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 114038us
I20260709 12:23:07.727707  2637 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.289414 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1597) took 1299 ms. Trace:
I20260709 12:23:08.253341  2296 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.271166  2559 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.307536  2296 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.308614  2559 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.254421  2508 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.268437  2555 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.309765 31421 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:08.310348  2393 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.310477  2508 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:08.310590  2555 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.294833 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:08.311446 31422 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.313185  2618 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.295338 31495 raft_consensus.cc:2368] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:08.295498  2535 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:08.295849 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1600) took 1180 ms. Trace:
I20260709 12:23:08.297053  2671 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.296916 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.301582  2641 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.302256  2433 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:08.305676  2348 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.293754 31491 rpcz_store.cc:276] 0709 12:23:06.989826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.989958 (+   132us) service_pool.cc:224] Handling call
0709 12:23:08.289235 (+1299277us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002e6b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:08.289360 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664801152}
I20260709 12:23:08.318271 31422 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:08.318264 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:08.322273 31415 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:08.290594  2663 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.319550 31496 rpcz_store.cc:276] 0709 12:23:07.115109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.115324 (+   215us) service_pool.cc:224] Handling call
0709 12:23:07.125799 (+ 10475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:07.151959 (+ 26160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.151989 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:07.152519 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:23:07.258978 (+106459us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:07.275322 (+ 16344us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.358397 (+ 83075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.358493 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.702639 (+344146us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:08.295581 (+592942us) raft_consensus.cc:1685] finished
0709 12:23:08.295671 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.295791 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82993,"prepare.queue_time_us":16182,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":83507,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":23709,"spinlock_wait_cycles":87138048,"thread_start_us":106111,"threads_started":1,"wal-append.queue_time_us":339938}
I20260709 12:23:08.330334 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:08.294481  2403 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:08.292302  2465 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.287498  2662 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.337874 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.328979  2663 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.346566 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:08.348088 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.350302 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.351003 31421 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:08.354353 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.325062  2671 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.329959  2535 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.355145 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.333060  2433 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.357793 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.356884 32105 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:08.344837  2508 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:08.360880 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:08.361387  2508 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.334487  2403 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.364184  2475 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.364897  2632 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.376715  2671 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.378643 31569 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:08.384783  2673 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.386143  2535 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.370371  2433 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.387467  2403 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.387758  2637 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:08.389995 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.387168  2673 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.366173  2508 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.405292 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.408030 32114 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
W20260709 12:23:08.410465 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 159691us
I20260709 12:23:08.414112 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:08.372365  2638 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.441843 31387 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:08.442310 31387 leader_election.cc:403] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:23:08.447865 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.445137 31540 connection.cc:256] RPC call timeout handler was delayed by -2.27910776500039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:23:08.455029 31540 connection.cc:256] RPC call timeout handler was delayed by -2.1455783979999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:23:08.449275  2393 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:08.491780 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:08.496310 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.415721  2673 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.497711 31540 connection.cc:256] RPC call timeout handler was delayed by -2.1176783979999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:23:08.498147 31540 connection.cc:256] RPC call timeout handler was delayed by -1.9385783980001179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:23:08.498517 31540 connection.cc:256] RPC call timeout handler was delayed by -1.9124783980000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:23:08.498879 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6856783980001637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:23:08.499203 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1640077649999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2965s for a response
W20260709 12:23:08.499557 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1044856000003165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 12:23:08.500702 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.501523 31569 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:08.503149 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.503674 31569 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:08.506386 31574 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:08.447757  2679 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.510185 31569 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:08.511109 31422 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:08.450172  2465 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:08.514075 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68083.2us
I20260709 12:23:08.495711  2638 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:08.525342  2671 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:08.525475  2638 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.527074 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2758) took 1552 ms. Trace:
I20260709 12:23:08.527485 31419 rpcz_store.cc:276] 0709 12:23:06.967261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.970854 (+  3593us) service_pool.cc:224] Handling call
0709 12:23:06.984682 (+ 13828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.984860 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:08.249490 (+1264630us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.519266 (+269776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:08.519316 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:08.519371 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.519432 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.519566 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26729,"prepare.queue_time_us":144190,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":35237,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":1469000,"threads_started":2}
I20260709 12:23:08.447592  2495 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.519887 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:08.530530  2495 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.531180  2495 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.531922  2555 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.531738  2495 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.532454  2555 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.533973  2495 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:08.515707 31465 leader_election.cc:336] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.601s (SENT)
I20260709 12:23:08.510306  2433 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:08.520833 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:08.515760 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.523300 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.515090  2632 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:23:08.538233 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.517954 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.557614 31569 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:08.558715 31574 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:08.539134 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.559903 31567 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.537848 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.516743 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.528486  2638 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:08.563524 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.517397 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:08.506800  2652 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.565016 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.565017 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.526013  2671 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.570057 31569 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:08.507050  2678 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:08.573716 32114 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:08.519791  2677 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.575863 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.609301 31571 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:08.641124 31574 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:23:08.576062 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:08.641844 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.643055 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.574882 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 80147us
I20260709 12:23:08.512339  2682 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.642181 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.633646 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.609807 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:08.647723 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.562904  2433 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:08.648645 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.649348 31495 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:08.647572 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.649412 32105 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:08.611647 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95958.1us
I20260709 12:23:08.575152 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.650038 32110 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.520568  2628 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:23:08.648869 32113 raft_consensus.cc:2368] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
W20260709 12:23:08.612187 31463 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.524s (SENT)
I20260709 12:23:08.650203 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.633704 31569 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:08.611286 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:08.576201 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58913us
W20260709 12:23:08.584673 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.652011 31566 raft_consensus.cc:2410] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:23:08.643769 31568 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.652191 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:08.511876  2663 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.652525 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.661232 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.661916 32109 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.663053 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.663331 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.534612  2555 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.665833 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.666360 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.665537 32112 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.667327 31415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:08.667901 31415 raft_consensus.cc:606] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:08.667984 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55849.9us
I20260709 12:23:08.668273 31415 raft_consensus.cc:614] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:23:08.668884 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.671202 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.671769 31498 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:08.569386  2348 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:08.670563 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:08.678802 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:08.679380 31492 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:08.673323 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.681043 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
W20260709 12:23:08.653254 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 121898us
I20260709 12:23:08.674052  2641 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.675424 31494 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:08.675365 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.669965 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.640650  2683 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:08.663069  2645 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:08.645936  2675 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.514874  2673 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.684266 32110 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:08.703338 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.684458 32114 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.685575 31569 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:08.645087  2475 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:08.710259  2475 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.707382  2673 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.711551 31500 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.663563  2495 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:23:08.573798  2652 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.691051 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.653084  2433 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.692090 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.692198  2348 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:08.635686  2662 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.697197 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:08.665532  2403 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.635524  2638 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:23:08.707376  2663 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.709684 31422 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:08.712579 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.748720 32112 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.712690 32109 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:08.712729 31495 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:08.670341  2535 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:08.714126 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2768) took 1349 ms. Trace:
I20260709 12:23:08.719740 31568 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:08.721233 31420 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:08.714531 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:08.743194 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.743194 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.757091 32110 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:08.748005 31419 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:08.753014 31417 rpcz_store.cc:276] 0709 12:23:07.364703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.364872 (+   169us) service_pool.cc:224] Handling call
0709 12:23:08.168721 (+803849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.262626 (+ 93905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.262655 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.293506 (+ 30851us) log.cc:844] Serialized 26 byte log entry
0709 12:23:08.447876 (+154370us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:08.447925 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.701653 (+253728us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b54004484d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:08.701717 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:08.701778 (+    61us) raft_consensus.cc:1685] finished
0709 12:23:08.701798 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.714033 (+ 12235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48419,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":215247744,"thread_start_us":111036,"threads_started":1,"wal-append.queue_time_us":123114}
I20260709 12:23:08.750041 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.703635  2683 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:08.757126 32111 raft_consensus.cc:2368] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:08.645442  2678 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.763337 31565 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:08.772609 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58196.9us
I20260709 12:23:08.773051 32106 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:08.761554 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.696455  2408 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:23:08.692881  2641 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.771862 32114 raft_consensus.cc:2410] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:08.775051 31568 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:08.775840 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 202819us
I20260709 12:23:08.780341 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.781365 32110 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.653867  2677 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:08.785621 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.786623 31568 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:08.792310 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.778898  2465 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:08.794387 32110 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:08.797330 32110 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:08.797492 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.798844 31568 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:08.782706  2618 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.750871  2403 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:08.785193  2471 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.798175 31421 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:08.760460  2535 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.720621  2675 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.804121 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.811722 31565 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:08.798213  2465 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.808624 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:08.813875  2574 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:08.814239 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.776782  2691 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:23:08.798913 32110 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.880470 32110 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:08.857281 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.877597 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.880744 31491 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:08.802047  2549 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.887499 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112376us
I20260709 12:23:08.938999 32108 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:08.939510  2535 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.939970 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.805819  2618 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.940673 32106 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.811388  2652 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.938817 32110 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:23:08.932935 31570 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.952325 32110 pending_rounds.cc:85] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 8
I20260709 12:23:08.952608 31568 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:08.943689 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:08.947137 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:08.945168 31567 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:08.943002 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.952801 32110 pending_rounds.cc:107] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:08.812907  2671 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:08.958876 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 154445us
I20260709 12:23:08.956475 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.960668 32114 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:08.953747 31569 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:08.954151 32110 raft_consensus.cc:2889] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.875763  2632 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:08.886839  2465 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:08.954092 31565 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:08.966563 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:08.957734 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 149149us
I20260709 12:23:08.967497 31571 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:08.964749 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:08.965794 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:08.968722 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:08.969059 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.972468  2393 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:08.972609  2678 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.972970  2393 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.973636 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:08.974226 31419 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:08.811491  2471 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.974982 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.976559 31565 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:23:08.978230  2535 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:08.801046  2348 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:08.978960  2618 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:08.979081  2641 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:08.981946 32112 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.986351 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.989670 32110 raft_consensus.cc:2410] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 11 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:08.981084 31565 pending_rounds.cc:85] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 4
I20260709 12:23:08.990869 31565 pending_rounds.cc:107] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:23:08.991128 31565 raft_consensus.cc:2889] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:08.953585  2699 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:08.987272  2671 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:08.988046 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:08.994607 32111 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:08.963884  2652 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:08.964190  2632 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:08.980122  2508 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.998834 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:08.981562  2535 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:08.952368  2549 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.021015 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.034232 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:08.996655  2652 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.996148  2671 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.037621 31565 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:08.956648  2683 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.041139  2671 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.063534  2403 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.065528  2471 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.068223 31500 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:09.069110  2682 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:09.001744  2508 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.069869  2632 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.038640  2652 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.147380 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:09.131268 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.112068 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.159093 32110 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:09.159382 31572 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:09.137737 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.053736  2677 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.163079 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.136691 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:09.163669 31491 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.163901 31565 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:09.166615  2555 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.167321  2555 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.168817 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.169366 31493 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.044494  2708 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.171816  2708 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.172289  2708 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:09.177568 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 176662us
I20260709 12:23:09.178835 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:09.183609  2573 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.184914 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.188287 31493 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:09.188195  2708 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.189428 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.191464 31491 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:09.193102 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.194608 31493 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.209115 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.194850 31565 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:09.211848 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.216353 31496 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:09.226025 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.226969 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.227401 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.227825 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:09.228636 31570 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:09.229570 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.229753 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.230163 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.230600 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
I20260709 12:23:09.231189 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.231978 32109 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:09.231874 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:09.232335 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.232770 31573 raft_consensus.cc:2376] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8. Re-sending same reply.
I20260709 12:23:09.233319 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.228667 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.234503 31568 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:09.235083 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.235635 32109 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9. Re-sending same reply.
I20260709 12:23:09.236920 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.238073 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.231767  2662 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.238602  2662 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:09.239528 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.240067 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.240206 32113 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:09.237116 32109 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.241394 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.239485  2662 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.241945 32107 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:09.242576 31498 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 6: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:09.243837 31567 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:23:09.244082 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.245012 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:09.245538 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60691.6us
I20260709 12:23:09.246718 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.247709 31565 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:09.238245 32114 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:09.249007 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:09.245568 31498 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:09.251616 32106 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:09.252362 31493 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:09.254122 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:09.255885 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.256162 32111 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:09.256601 31491 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:09.259475 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.266378 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.269135 31572 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11. Re-sending same reply.
I20260709 12:23:09.269949 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.270571 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.266726 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.266005 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.211768  2573 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.277688 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.271129 31496 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:09.271934 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.275516 31565 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.276180 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:09.280431 31569 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.272820 32112 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:09.274771 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.282513 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.285318 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.282694 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.286526 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.286809 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.287632 31498 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:09.288877 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.289033 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:09.289179 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.289463 31491 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.290833 32113 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:09.289666 31419 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:09.290146 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.293115 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.293907 31572 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:09.257423  2708 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.266614  2403 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:09.276855  2264 consensus_meta.cc:287] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.077s	user 0.006s	sys 0.006s
I20260709 12:23:09.321946 31491 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:23:09.309746 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.243551  2555 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.299784 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.322234 31498 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:09.328645 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.270792  2706 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:09.329890  2706 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.330368  2706 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.323062 31493 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:09.326812  2684 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.336827  2573 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:09.337507  2707 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:23:09.338201  2549 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.346300 32110 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:09.348802 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.348692  2684 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:09.350310  2684 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:09.351512  2684 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.352144  2684 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:09.352484  2684 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:09.353394  2684 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.355093  2684 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.363099 31572 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:09.364252 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.364871 31573 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:09.366694 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.367280 31571 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:23:09.374815  2700 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 12:23:09.378798  2508 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:09.379582  2508 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.382870 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:09.383692 31422 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.296227  2687 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:09.273864  2711 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:09.389096 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:09.390846 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.350487 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:09.393671 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:09.397779 32112 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 6: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:09.336436  2403 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:09.414539 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64123.9us
I20260709 12:23:09.424178 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.419927 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:09.416297 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.422080 31422 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:09.430891  2393 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.434523 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:09.435190  2684 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:09.435659  2684 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.435890 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.436133  2684 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.436988 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.380112  2508 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.439026  2690 raft_consensus.cc:2764] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:09.435719  2547 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.440511  2508 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.440814  2547 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:09.441092  2508 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.441421  2547 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.442588  2471 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:09.386818  2687 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:09.443601  2687 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.446146 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.414927  2549 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:09.447038  2549 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:09.447446  2549 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.448508  2652 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.450965  2708 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:09.451403  2708 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.451768  2708 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:09.453074 31424 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.461037 31569 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:09.461680 31565 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:09.457825 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.487989 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:09.488888 31496 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:09.412379  2264 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:09.425688  2403 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.488571 31497 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:09.451424  2714 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.500988  2264 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:09.520557 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 253038us
W20260709 12:23:09.507287 31537 leader_election.cc:336] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.795s (SENT)
W20260709 12:23:09.524143 31537 leader_election.cc:336] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.800s (SENT)
I20260709 12:23:09.496282  2652 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.495278  2690 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.453991  2465 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:09.502913  2699 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.007s
I20260709 12:23:09.493983  2547 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:09.541807  2692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.007s
I20260709 12:23:09.502523  2714 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:09.546799 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 239415us
W20260709 12:23:09.556223  2433 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.804s	user 0.019s	sys 0.000s
I20260709 12:23:09.557004 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.564805 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.545674  2393 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:09.561733 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 163576us
W20260709 12:23:09.562628 31418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.014s	sys 0.031s
I20260709 12:23:09.567099 31416 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:09.562435  2692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.012s	sys 0.007s
W20260709 12:23:09.570468 31418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.015s	sys 0.031s
I20260709 12:23:09.559989 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:09.557201  2706 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.556274  2675 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.591475 32079 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:09.562578  2699 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:09.600315 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 152722us
I20260709 12:23:09.565478  2714 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.602543  2718 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.598208  2508 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:23:09.545209  2264 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.604044  2675 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.616573  2675 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.616956  2675 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.618848 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.618571  2699 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.623471 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.589573  2721 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:09.567857  2433 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:09.651594 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 58485.6us
I20260709 12:23:09.653602  2508 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:09.654670 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:09.608295  2718 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.655416 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
W20260709 12:23:09.669175 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.672976 31499 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:09.683069 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.610975  2628 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 12:23:09.684638 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119945us
I20260709 12:23:09.682312  2721 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.670446  2718 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:09.691008 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 95107.7us
W20260709 12:23:09.696491 31465 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.875s (SENT)
I20260709 12:23:09.688014  2721 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:09.697273 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.696553 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.702899  2739 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:09.703466  2739 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.672998  2723 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:23:09.714547  2739 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.719558  2433 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.722455  2714 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.725575  2687 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.732331 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 843) took 1098 ms. Trace:
W20260709 12:23:09.737754 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2776) took 1234 ms (client timeout 1517 ms). Trace:
W20260709 12:23:09.760035 31421 rpcz_store.cc:269] 0709 12:23:08.497828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.498133 (+   305us) service_pool.cc:224] Handling call
0709 12:23:09.731892 (+1233759us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003ca354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:09.731996 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551098624}
I20260709 12:23:09.738206  2465 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.738827  2740 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.722265  2549 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.780476  2549 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.700058  2547 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.732622  2403 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.782871 31498 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:09.731210  2721 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.743060  2741 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:23:09.746831 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.783607  2734 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.759143 32108 rpcz_store.cc:276] 0709 12:23:08.633584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.645211 (+ 11627us) service_pool.cc:224] Handling call
0709 12:23:08.665953 (+ 20742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.939451 (+273498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.732120 (+792669us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400112954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:09.732274 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627513216}
I20260709 12:23:09.726383  2708 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:09.808789 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112329us
I20260709 12:23:09.790925  2699 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.799715  2738 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:23:09.813421 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:09.815609 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:09.812934 31465 leader_election.cc:336] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.149s (SENT)
I20260709 12:23:09.816836 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:09.788473 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.820981 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 214523us
I20260709 12:23:09.817068 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.817060  2687 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.824451 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:09.824553 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 128069us
I20260709 12:23:09.791462  2403 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:09.791513  2671 consensus_meta.cc:287] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 12:23:09.826363 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.826427  2671 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.827176  2714 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.827340  2740 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.827867  2736 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:09.828461 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.816298  2706 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.829977 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.832437 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2780) took 1315 ms. Trace:
I20260709 12:23:09.831590 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.833485  2687 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:09.834777  2733 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.834559  2738 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:09.830400  2736 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:09.837303  2736 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.807654  2662 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.834039 31420 rpcz_store.cc:276] 0709 12:23:08.516564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.516754 (+   190us) service_pool.cc:224] Handling call
0709 12:23:09.832269 (+1315515us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003ece54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:09.832377 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347120384}
I20260709 12:23:09.821753  2721 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.840397 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.824254  2264 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:09.791635  2741 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:09.829520  2699 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:09.844105 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.846891 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.847733 31495 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:09.849339 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.850018  2264 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:09.850368 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.850972  2264 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.852034  2718 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.854176 31569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:33962
I20260709 12:23:09.854736 31569 raft_consensus.cc:606] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 12:23:09.855036 31569 raft_consensus.cc:614] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:09.855578  2708 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.856034 31566 raft_consensus.cc:2368] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:09.856694 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.856874  2741 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.843158  2687 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:09.857889  2741 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.847093  2714 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.858858  2740 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.846956  2675 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.861619  2675 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:09.862349 32114 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:09.795718  2684 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:09.864984  2684 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.842868  2730 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:09.866343  2632 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.868705  2718 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.870028  2734 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.871747 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1544) took 1219 ms. Trace:
I20260709 12:23:09.871846 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.872347 31500 rpcz_store.cc:276] 0709 12:23:08.652125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.652228 (+   103us) service_pool.cc:224] Handling call
0709 12:23:09.871544 (+1219316us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54003bae54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:09.871672 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75646720}
I20260709 12:23:09.878592  2711 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:09.882273  2718 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:09.883710  2475 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.886646  2711 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:09.886801  2671 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:09.880885 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.897450 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.898029 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1550) took 1176 ms. Trace:
I20260709 12:23:09.898649 31499 rpcz_store.cc:276] 0709 12:23:08.721782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.723060 (+  1278us) service_pool.cc:224] Handling call
0709 12:23:08.723298 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:09.682226 (+958928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.858569 (+176343us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54003bcc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:09.897951 (+ 39382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2183676672}
I20260709 12:23:09.853746  2535 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:09.928048 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98142.5us
I20260709 12:23:09.930562 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:09.937032 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:09.937994 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.938859 31499 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.942845 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:09.885339  2723 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:09.948760 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:09.958119 31492 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:09.960124 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.960965 31495 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:23:09.962218 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.963307 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.964855 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:09.965809 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:09.969028 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.969660 32111 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.971783 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.972532 32114 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:09.974905 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 77507us
I20260709 12:23:09.921975  2508 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.978713 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.967026 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.980221 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.982345 31492 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:09.989377 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:09.990211 31418 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.992296 31498 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:09.992986 31415 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:09.993389 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:09.993978 32107 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.000944 31499 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.002737 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.004082 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:10.004375 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 1.32195e+06us
I20260709 12:23:10.002154 31318 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.011090 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.011736 32105 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.014194 32107 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.015327 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:10.017575 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:09.979540  2573 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:09.956523  2744 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.020087 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:09.957723  2723 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:10.020592 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.019191 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:09.979333  2535 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.023253 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:10.010985 31318 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 6, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.023612 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:09.986855  2559 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:09.987013  2641 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:10.030946 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.031464 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.032122 31499 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:10.027079 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.030232 31424 raft_consensus.cc:2368] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:10.019331  2654 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:10.031801 31318 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 5 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.034406  2696 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:10.043689 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.044003  2696 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:10.044445 31574 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.044956  2696 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.044566 31318 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 9, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 9 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.035269  2654 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.046764  2654 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.035056  2723 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.047214 31318 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.051623 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.054517 32111 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.033861 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:10.053582 31389 connection.cc:256] RPC call timeout handler was delayed by -1.2587725039998077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:23:10.016721  2731 raft_consensus.cc:2764] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:10.063144 31498 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.055989 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.066191 31416 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.060498  2723 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.061772  2495 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:10.076287 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53128.1us
W20260709 12:23:10.074798 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55695.4us
I20260709 12:23:10.080790 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:10.009053  2408 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:23:10.081786 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:10.082211 31500 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:10.071399 31318 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 6, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 6 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.029613  2738 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:10.021293  2348 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:23:10.074581 32114 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.086444 31492 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:10.087438 31571 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:23:10.089272 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.083289 31569 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:10.031154  2641 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.091117 31498 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.087224  2559 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:10.095386 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.116665 32111 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:10.091755 31318 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 8, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 8 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.109587 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.118240 31500 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:10.118429 31492 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:10.119422 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.077780  2573 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:10.081007  2744 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.112445 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.134438 31491 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:10.087930  2495 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:10.105738 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:10.122551 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.136219 31424 raft_consensus.cc:2368] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11.
I20260709 12:23:10.123332 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.123719 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.137159 31421 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:10.137269 31420 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.125010 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.081734  2663 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:10.096585  2555 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.145368 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.145733 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.028697  2730 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:23:10.128921 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:10.099853  2736 raft_consensus.cc:670] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:10.153228 31466 leader_election.cc:400] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:10.153612 31466 leader_election.cc:403] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:23:10.131511 31418 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:10.138362 31422 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:10.131886 31500 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:10.155997  2746 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:10.140612 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3496189679999588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 12:23:10.146425 31494 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
W20260709 12:23:10.158023 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3370189679999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:23:10.147305 31497 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:10.147610 32111 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:23:10.158401 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3199189679999108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 12:23:10.148149 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.097342  2738 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:10.162894 31498 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:10.163003 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.149655 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:10.146523 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:10.134485 31318 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 11, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.166124 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:10.151196 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.141683  2663 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.150401 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.152972 31415 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:10.118721  2641 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:10.158772 31540 connection.cc:256] RPC call timeout handler was delayed by -1.2614189679998162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:23:10.161010 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.150646  2508 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:10.142107  2714 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:10.167418 31417 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:23:10.168208 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.165254 31318 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.164218 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.192989 31424 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:10.169350 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.193488 31318 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 8, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 8 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.194151 31421 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:10.166603  2741 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.140846 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:10.229559 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 88825.2us
I20260709 12:23:10.231673 31424 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
W20260709 12:23:10.170629 31370 auto_rebalancer.cc:893] Removing replace marker failed: Replica 8553a13b444649b9a19e5488aabaf1c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.173952 31423 raft_consensus.cc:2368] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
W20260709 12:23:10.233649 31370 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:23:10.161686 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:10.234388 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.174252 31540 connection.cc:256] RPC call timeout handler was delayed by -1.170518968000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 12:23:10.147600  2711 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:10.187654 31319 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 187) took 21759 ms (client timeout 15000 ms). Trace:
I20260709 12:23:10.189502 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:10.240191 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1570189680001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:23:10.236052 31466 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:10.165052  2738 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.189878 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.251497 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:10.165584  2687 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.181051 32105 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:23:10.190959 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.190208  2721 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:10.254932 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.195490  2573 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:10.196251  2495 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.179107  2663 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.197917  2559 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.199466 31574 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:10.214838  2714 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:10.150022  2699 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:23:10.144819  2733 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:23:10.217581 31416 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:10.251415  2628 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:10.153316  2408 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:23:10.227697 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.228277 31420 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:10.228528 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:10.286816 31422 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:10.287286 31492 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.241109 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:10.242903 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.245937 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.240593 31540 connection.cc:256] RPC call timeout handler was delayed by -1.1066189680000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:23:10.288604 31540 connection.cc:256] RPC call timeout handler was delayed by -1.040018967999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 12:23:10.289054 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0292189679998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 12:23:10.152657  2555 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.294016 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.288085 31421 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:10.294993 31573 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:10.252169 31424 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:10.240373 31319 rpcz_store.cc:269] 0709 12:22:48.545158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.555233 (+ 10075us) service_pool.cc:224] Handling call
0709 12:23:10.187561 (+21632328us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:06.640295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:06.652964 (+ 12669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:06.653015 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:23:06.653032 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:06.654369 (+  1337us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:06.654448 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:06.654479 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:23:06.805309 (+150830us) tablet.cc:701] Row locks acquired
0709 12:23:06.805359 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:23:06.805545 (+   186us) write_op.cc:270] Start()
0709 12:23:06.805720 (+   175us) write_op.cc:276] Timestamp: P: 1783599786805477 usec, L: 0
0709 12:23:06.805742 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:06.861511 (+ 55769us) log.cc:844] Serialized 5750 byte log entry
0709 12:23:06.962057 (+100546us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11975ee28 00007fc11d199581 00007fc11d198d58 00007fc11d19d9f1 00007fc11d19d9a9 00007fc11d19d939 00007fc11d19d901 00007fc11d19cb2d 0000000000388634 0000000000388479
0709 12:23:08.187636 (+1225579us) op_driver.cc:464] REPLICATION: finished
0709 12:23:08.227778 (+ 40142us) write_op.cc:301] APPLY: starting
0709 12:23:08.227890 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:08.228219 (+   329us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:08.228261 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:08.372077 (+143816us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:08.538747 (+166670us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:23:08.538803 (+    56us) write_op.cc:312] APPLY: finished
0709 12:23:08.539226 (+   423us) log.cc:844] Serialized 101 byte log entry
0709 12:23:08.565805 (+ 26579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.576258 (+ 10453us) write_op.cc:454] Released schema lock
0709 12:23:08.645272 (+ 69014us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:08.706410 (+ 61138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:08.706443 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":10546,"mutex_wait_us":3643092,"reported_tablets":35,"spinlock_wait_cycles":711040,"child_traces":[["op",{"apply.queue_time_us":39766,"apply.run_cpu_time_us":8322,"apply.run_wall_time_us":457544,"num_ops":14,"prepare.queue_time_us":246567,"prepare.run_cpu_time_us":16731,"prepare.run_wall_time_us":369851,"raft.queue_time_us":926918,"raft.run_cpu_time_us":5916,"raft.run_wall_time_us":67757,"replication_time_us":1381716,"spinlock_wait_cycles":67471232,"thread_start_us":1174733,"threads_started":4,"wal-append.queue_time_us":115314,"wal-append.run_cpu_time_us":34342,"wal-append.run_wall_time_us":2747926}]]}
I20260709 12:23:10.296697 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.297525 31568 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:10.240317 31318 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.252221 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:10.300020 31423 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
W20260709 12:23:10.212198  2745 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:10.164752  2264 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:23:10.239478 31370 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:23:10.260005 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.279641  2721 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:10.268280 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:10.270462  2753 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:23:10.146974  2744 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.227234  2693 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:10.282604 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:10.252305  2652 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:10.284801 31416 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:23:10.530175 31419 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.530609 31416 pending_rounds.cc:85] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 7
I20260709 12:23:10.530928 31416 pending_rounds.cc:107] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:23:10.531239 31416 raft_consensus.cc:2889] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.290298 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.253126  2403 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:10.530252 31500 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:10.340262 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.316502 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.534832 31573 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.436437 31424 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:10.367085 31318 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 1 to 6, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.265102  2711 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:10.211162  2750 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 12:23:10.368702 31570 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:10.546700 31424 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:10.436316 31565 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:10.447110 31422 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:10.454746 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:10.455318 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.462756 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.206067  2641 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:23:10.465112 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.551919 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:10.254094  2741 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:10.557758 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.477388 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:10.473855  2718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.017s	sys 0.030s
I20260709 12:23:10.306228  2740 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.523212 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:10.305810  2471 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:10.465915  2662 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.010s
I20260709 12:23:10.544764 31500 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:10.548043 31318 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 6, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 6 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.549898 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:10.564673 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.558398 31570 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:10.598610 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.599238 31572 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:10.573979 31495 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.593976 31499 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:10.562897  2718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.033s
I20260709 12:23:10.603710 31318 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 3 to 6, term changed from 7 to 8, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to <none>, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.596487 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.605312 31565 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:10.605325 31318 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.611133 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.556670  2403 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:10.614032 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.614723 31568 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:10.533918  2705 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:23:10.617338 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.616631 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:10.618664 31417 raft_consensus.cc:606] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:10.619012 31417 raft_consensus.cc:614] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:10.619184 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.619858 31568 raft_consensus.cc:2368] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:10.620596 31574 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.621683 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:10.606891 31318 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.594419  2475 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:10.626394 31318 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.625048 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.628026 31565 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:10.629321 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.630110 31570 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:10.631150 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.639705 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:10.650113 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.653483 31417 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:10.654613 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.655371 31570 raft_consensus.cc:2376] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12. Re-sending same reply.
I20260709 12:23:10.602730  2471 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.659252 31318 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:10.566890  2693 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.530865  2714 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.679468 32111 pending_rounds.cc:85] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 7
I20260709 12:23:10.679800 32111 pending_rounds.cc:107] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:10.666282 31574 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:10.673331 31318 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 10, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:10.658349  2654 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.001s
I20260709 12:23:10.677711 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:10.678297 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:10.685009 32114 raft_consensus.cc:2368] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:10.685065 32105 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:10.679853 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.680157 32111 raft_consensus.cc:2889] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.679991 31568 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:10.680104 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:10.673928 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52330.5us
I20260709 12:23:10.687158 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:10.688302 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.689150 32110 raft_consensus.cc:2368] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:10.689637 32080 leader_election.cc:400] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11.
I20260709 12:23:10.686548 32111 pending_rounds.cc:107] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:10.690995 32111 raft_consensus.cc:2889] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.691314 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:10.681123 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.682410 31318 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 2 to 7, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 7 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.686551 31572 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:10.692664 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:10.693961 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:10.694365 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 217055us
I20260709 12:23:10.658155  2475 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:10.671582  2740 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.704028 31565 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:10.704174 32105 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 12:23:10.759280 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.760072 32109 raft_consensus.cc:2368] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:10.693152 31318 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:10.703205 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:10.758819 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:10.761843 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74750.3us
I20260709 12:23:10.706161 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:10.704722 31415 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:10.761461 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.594826  2721 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.762529 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:10.762903 31568 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.763984 31570 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:10.764397 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.764989 31574 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:10.765440 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:10.766232 31318 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:23:10.775269  2535 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.724s	user 0.016s	sys 0.009s
I20260709 12:23:10.762169  2714 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.784538  2628 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:10.764065  2408 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:10.777240  2762 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:23:10.838619 31565 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:10.839457 31565 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:10.656745  2711 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.806165 31573 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:10.789717 31570 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.775379  2555 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:10.832599  2760 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:23:10.770769  2662 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:10.823303 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60838.7us
I20260709 12:23:10.816877 31568 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:10.826151 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 169277us
W20260709 12:23:10.782501  2632 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.915s	user 0.006s	sys 0.006s
I20260709 12:23:10.847410  2769 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:10.841571  2408 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:10.763782  2403 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:10.847470 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.914062  2693 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:10.847483  2475 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:10.851591  2748 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.764s	user 0.003s	sys 0.000s
I20260709 12:23:10.886550  2768 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.852017  2744 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:10.776942  2508 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.697224  2654 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:10.833389  2628 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:10.861193 31492 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 12:23:10.929607 31492 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:10.840375 31565 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:10.836725 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:10.931392 31572 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:23:10.934755 31417 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:23:10.935186 31417 pending_rounds.cc:85] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 10
I20260709 12:23:10.935458 31417 pending_rounds.cc:107] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:23:10.935724 31417 raft_consensus.cc:2889] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:10.937482 31417 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:23:10.950093 31465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.511s (SENT) [suppressed 58 similar messages]
I20260709 12:23:10.958391  2679 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:10.958977  2679 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:10.964366 31465 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.525s (SENT)
I20260709 12:23:10.971550 31421 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:10.973346 31421 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:10.831269  2708 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.978910  2708 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:10.980832  2764 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:23:10.981279  2708 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:10.838660  2736 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:10.839452  2682 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.778592  2750 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:10.860668  2761 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:23:10.866837 31574 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:10.894125 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:10.895174  2687 consensus_meta.cc:287] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.002s
I20260709 12:23:10.984082  2687 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
W20260709 12:23:10.984228 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90216.4us
I20260709 12:23:10.886832  2555 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:23:10.890245  2641 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:10.907385 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:10.848883  2766 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:23:10.920485 31495 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:10.923175 31419 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:10.927814 31570 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:23:10.981346  2765 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 12:23:10.862134 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 800) took 1037 ms. Trace:
W20260709 12:23:10.990641 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.903721  2699 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.899425  2741 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:11.013689  2723 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.000s
W20260709 12:23:11.015358 31465 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.537s (SENT)
I20260709 12:23:11.015794 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:11.016054 31493 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:11.014348  2750 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.011865 32106 rpcz_store.cc:276] 0709 12:23:09.815330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.816848 (+  1518us) service_pool.cc:224] Handling call
0709 12:23:09.833316 (+ 16468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.928774 (+ 95458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.928899 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:09.937552 (+  8653us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.237258 (+299706us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:10.237327 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.237433 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:10.852451 (+615018us) raft_consensus.cc:1685] finished
0709 12:23:10.852479 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:10.852856 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":900,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":60,"thread_start_us":314482,"threads_started":2,"wal-append.queue_time_us":303890}
W20260709 12:23:11.014662  2747 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:23:10.999820  2693 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:11.023959  2471 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:11.043169 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135866us
W20260709 12:23:11.052274 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.039750 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 345826us
I20260709 12:23:11.019690  2641 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.061841 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:11.062582 31419 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.060856 32080 leader_election.cc:400] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
I20260709 12:23:11.071079 32080 leader_election.cc:403] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:11.035645  2408 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.088637 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:11.094893 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 861) took 1118 ms. Trace:
I20260709 12:23:11.095342 31566 rpcz_store.cc:276] 0709 12:23:09.970319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.970472 (+   153us) service_pool.cc:224] Handling call
0709 12:23:10.009451 (+ 38979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.192724 (+183273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.192755 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.228903 (+ 36148us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.529661 (+300758us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:10.529720 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.529804 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.088834 (+559030us) raft_consensus.cc:1685] finished
0709 12:23:11.088859 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.089034 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11411,"raft.queue_time_us":78731,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":3382,"thread_start_us":416001,"threads_started":2,"wal-append.queue_time_us":348751}
I20260709 12:23:11.104598 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:11.109045 31463 leader_election.cc:400] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:11.109892  2736 raft_consensus.cc:2764] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:23:11.110778 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66682.3us
I20260709 12:23:11.111020 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.111558 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.112778 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.113933 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.087888  2471 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7.
I20260709 12:23:11.118734 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:11.119479 31496 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:23:11.088476  2652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.020s
I20260709 12:23:11.019783  2699 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:11.061383  2735 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.131474 31495 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:11.133005 31491 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:11.140509 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.145778 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.155509 31463 leader_election.cc:400] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:11.155876 31463 leader_election.cc:403] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:23:11.153581 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:11.156584 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.036101  2679 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.151109 31419 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:11.158929 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:11.159175 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.159686 31463 leader_election.cc:400] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:11.163457 31567 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:11.195076 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:11.195984 31566 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
W20260709 12:23:11.168926 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 408579us
I20260709 12:23:11.126073  2628 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.169768 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:11.208046 31565 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.144620  2652 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:11.243474  2652 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.152457  2471 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:11.149247  2741 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.149744  2264 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.220863 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:11.198805  2740 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.151744  2641 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:11.151907  2723 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.222500 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:11.226554 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:11.231403 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.249977 31565 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:23:11.266531 31565 pending_rounds.cc:85] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 4
I20260709 12:23:11.199371  2714 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.266839 31565 pending_rounds.cc:107] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:23:11.273972 31565 raft_consensus.cc:2889] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:11.232685 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92294.5us
I20260709 12:23:11.171172  2691 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:11.234637 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.170998  2690 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.283324 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.235659  2679 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.297159 31540 leader_election.cc:400] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:11.204530  2743 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 12:23:11.290177  2758 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:11.255851  2471 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:11.288854  2741 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.216563  2759 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:23:11.287384  2637 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:11.287547  2408 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.233784  2733 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:23:11.205452  2735 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.325394 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.326962 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.328722 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.330251 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.320366  2495 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:11.353016  2495 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:11.353645  2495 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:11.337694  2699 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.259091  2264 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:11.355185 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 127737us
I20260709 12:23:11.356978  2264 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:11.314190  2740 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:11.319013  2637 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:11.383699 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 398083us
W20260709 12:23:11.347105 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.384845 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.348874 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 587) took 1223 ms. Trace:
I20260709 12:23:11.389444 31420 rpcz_store.cc:276] 0709 12:23:10.125716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.286240 (+160524us) service_pool.cc:224] Handling call
0709 12:23:10.286604 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.438230 (+151626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.438273 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.479372 (+ 41099us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.873747 (+394375us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:11.346317 (+472570us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.348581 (+  2264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.348652 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.348689 (+    37us) raft_consensus.cc:1685] finished
0709 12:23:11.348700 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.348820 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233341,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":19742,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":734510,"threads_started":2,"wal-append.queue_time_us":573944}
W20260709 12:23:11.349404 32077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.002s	sys 0.022s
I20260709 12:23:11.350492  2785 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:11.345944  2559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.013s	sys 0.012s
W20260709 12:23:11.392556 32077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.002s	sys 0.022s
I20260709 12:23:11.343977  2693 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:11.321861  2741 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.424770 31389 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
W20260709 12:23:11.396260  2559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.013s	sys 0.013s
I20260709 12:23:11.340552  2671 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 12:23:11.395958  2696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.301s	user 0.010s	sys 0.015s
W20260709 12:23:11.476202 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51575us
I20260709 12:23:11.394745  2637 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:11.323403  2408 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:11.479458 31572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.021s
I20260709 12:23:11.400134  2759 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:11.415688  2705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.009s	sys 0.012s
I20260709 12:23:11.502924 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.417872  2744 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:11.518654 31572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.021s
W20260709 12:23:11.517805 31318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.021s	sys 0.021s
W20260709 12:23:11.537398 31318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.023s
I20260709 12:23:11.418352  2740 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:11.424602  2654 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.421917  2693 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:11.544876 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.393508  2778 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.175s
W20260709 12:23:11.548053 31424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.008s	sys 0.014s
W20260709 12:23:11.551375 31424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.014s
I20260709 12:23:11.552143 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2810) took 1319 ms. Trace:
W20260709 12:23:11.537714  2705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.009s	sys 0.015s
W20260709 12:23:11.553982 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 223817us
W20260709 12:23:11.513078  2696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.010s	sys 0.015s
W20260709 12:23:11.571480 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 291807us
W20260709 12:23:11.573385 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.536638  2759 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:11.537004  2744 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:11.584474 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:11.552536 31424 rpcz_store.cc:276] 0709 12:23:10.233079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.552124 (+319045us) service_pool.cc:224] Handling call
0709 12:23:10.552380 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.552595 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:10.894717 (+342122us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.551768 (+657051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:11.551822 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:11.551875 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.551952 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.552088 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":508888,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":6900,"raft.queue_time_us":145215,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11560,"thread_start_us":946809,"threads_started":2}
I20260709 12:23:11.419682  2495 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:11.649266 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64836.6us
I20260709 12:23:11.501844  2471 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:11.654614 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 393413us
I20260709 12:23:11.581763  2573 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.652218 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:11.653384 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 108586us
I20260709 12:23:11.581990  2769 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:11.557400  2740 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:11.650552 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 416012us
I20260709 12:23:11.656215 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1632) took 1516 ms. Trace:
I20260709 12:23:11.582119  2641 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:11.661198 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:11.647805 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d385c04853e749af8fb00afe40a4a255 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e166c1cb41f04d55a85e6c0d7966e32e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:11.682355 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:11.683014 31574 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.677094 31423 rpcz_store.cc:276] 0709 12:23:10.140210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.300702 (+160492us) service_pool.cc:224] Handling call
0709 12:23:10.789563 (+488861us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:23:10.789766 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.831672 (+ 41906us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:11.290802 (+459130us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.651140 (+360338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:11.654317 (+  3177us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:11.655646 (+  1329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.655824 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.656101 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275245,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"spinlock_wait_cycles":335785216,"thread_start_us":781340,"threads_started":2}
W20260709 12:23:11.708683 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.718847 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.729105 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67955.5us
I20260709 12:23:11.746773 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:11.740190 31304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 189219us
I20260709 12:23:11.677366 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.675387  2696 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.681061  2721 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:11.752728 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75543.7us
I20260709 12:23:11.753388 31574 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:11.666579  2769 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:11.684808  2663 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.414s	user 0.009s	sys 0.004s
I20260709 12:23:11.676631  2403 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:11.753672 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:11.760622 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.765895  2794 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:23:11.766001  2671 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:11.766438  2789 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:11.766866  2792 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.678202  2573 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:11.768781  2774 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
W20260709 12:23:11.769644  2786 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:23:11.769901  2788 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.833246  2788 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.835620  2788 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.727077  2705 raft_consensus.cc:2764] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:23:11.836148  2555 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:11.779739 31574 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:11.838162  2408 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.839322 31494 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:11.789908  2403 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:11.841007 31499 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:11.841881  2403 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:11.755291  2805 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:11.768442  2783 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:23:11.790192  2652 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:23:11.772850  2769 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.790983  2671 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:11.821369  2791 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:23:11.818928  2775 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.760128  2696 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.796303  2789 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:11.824183  2784 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:23:11.824349  2802 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:11.750504  2744 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.850271  2805 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:11.828460  2821 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:11.828651 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 879) took 1144 ms. Trace:
I20260709 12:23:11.778942  2731 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.875504  2671 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.836570  2555 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:11.842249 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:11.917398 31497 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.843031 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:11.844406 31496 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:11.845152 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:11.918742 31492 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:11.846056 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:11.920017 31491 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.790279  2750 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.852449 31499 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:23:11.852753 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 100691us
W20260709 12:23:11.858840 31416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.009s
W20260709 12:23:11.923142 31416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.010s
I20260709 12:23:11.923717 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:11.924000 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2807) took 1692 ms. Trace:
I20260709 12:23:11.862025  2654 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:23:11.867746 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2809) took 1635 ms. Trace:
I20260709 12:23:11.867594  2348 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:23:11.875491 32111 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:11.821818  2741 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:11.730553  2641 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.949048 32107 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:23:11.906596  2735 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:11.900111 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:11.826444  2818 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.785421  2663 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.908183 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:11.908480 32108 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:11.912494 32112 rpcz_store.cc:276] 0709 12:23:10.683893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.684025 (+   132us) service_pool.cc:224] Handling call
0709 12:23:10.760448 (+ 76423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.053762 (+293314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.053809 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.062100 (+  8291us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.480271 (+418171us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:11.480322 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.480412 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.828439 (+348027us) raft_consensus.cc:1685] finished
0709 12:23:11.828464 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.828597 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123373,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7159,"thread_start_us":708446,"threads_started":2,"wal-append.queue_time_us":764733}
I20260709 12:23:11.832315  2813 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:11.682650  2740 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:11.965783  2740 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:11.902081  2789 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:11.926297 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:11.927418 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107031us
I20260709 12:23:11.932065 32109 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:11.934015 31422 rpcz_store.cc:276] 0709 12:23:10.232720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.552906 (+320186us) service_pool.cc:224] Handling call
0709 12:23:10.553207 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.553412 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:10.553435 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.563211 (+  9776us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.881497 (+318286us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:10.881533 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.881610 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.867523 (+985913us) raft_consensus.cc:1685] finished
0709 12:23:11.867542 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.867687 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":256109,"threads_started":1,"wal-append.queue_time_us":486449}
I20260709 12:23:11.924425 31416 rpcz_store.cc:276] 0709 12:23:10.232023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.553195 (+321172us) service_pool.cc:224] Handling call
0709 12:23:10.553425 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:10.553583 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:10.878590 (+325007us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.923547 (+1044957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:11.923620 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:11.923703 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.923788 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.923923 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42261,"prepare.queue_time_us":548329,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":236692,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11736,"thread_start_us":1312144,"threads_started":3,"wal-append.queue_time_us":703586}
I20260709 12:23:11.936301 31491 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:11.937911  2797 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:11.915603  2821 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:11.850581  2690 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.953275  2785 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:11.979462 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 53252.2us
I20260709 12:23:11.925249  2731 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.099509 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:23:12.099896  2822 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:23:12.100169  2799 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
I20260709 12:23:12.100281  2693 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:11.971745  2508 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:11.974668  2797 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.140985 32105 raft_consensus.cc:2368] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:12.143713 31493 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:12.105345  2821 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.963078  2818 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.111395  2730 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:12.146399 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:12.119939  2780 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.161s	user 0.000s	sys 0.009s
W20260709 12:23:12.148252  2738 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.877s	user 0.014s	sys 0.000s
W20260709 12:23:12.165614 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 485639us
I20260709 12:23:12.148619  2797 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.183799 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.143118  2775 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:12.193567 31497 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:12.105432  2690 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.142794  2471 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:12.163861  2403 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.159687  2408 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:12.258036 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68427.6us
I20260709 12:23:12.155685  2693 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:12.282300 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.291231 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:12.292804 31389 leader_election.cc:336] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.587s (SENT)
I20260709 12:23:12.168977  2813 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:12.175513 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:12.284168  2798 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:23:12.285125 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.286579 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:12.287992 31423 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:12.307796 31418 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:12.288515 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.306340 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.308744 31424 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:12.190383  2776 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:23:12.289033  2403 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.290020 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.300428 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:12.300173 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 348017us
W20260709 12:23:12.302194 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162475us
I20260709 12:23:12.160311  2805 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:12.302914 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 127491us
W20260709 12:23:12.305245 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 333484us
I20260709 12:23:12.313848 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.167764  2662 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 12:23:12.278112  2740 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:12.290659  2637 consensus_meta.cc:287] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.000s
W20260709 12:23:12.335785 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.378348 31465 leader_election.cc:336] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.517s (SENT)
I20260709 12:23:12.179144  2815 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 12:23:12.162396  2810 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.172s
I20260709 12:23:12.279111  2723 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:23:12.398550 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 118686us
W20260709 12:23:12.380339 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 87574.9us
I20260709 12:23:12.194880  2738 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:12.381610 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.340207 31540 leader_election.cc:400] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:12.438335 31540 leader_election.cc:403] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:12.380649 31465 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.655s (SENT)
I20260709 12:23:12.359617 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:12.439630 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81280.8us
I20260709 12:23:12.442420 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:12.380082 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44592.9us
I20260709 12:23:12.444363 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.441314 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:12.378615 31421 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:12.302322  2813 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:12.452608  2813 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.319144  2348 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.382879 31418 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:12.443084 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:12.447808 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:12.303478  2408 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.470520 31497 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:23:12.470515 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:12.472246 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:12.473114 31492 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:12.374583  2768 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:12.433887  2730 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:12.476825  2768 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.477326 31494 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:12.476765  2730 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.477911  2663 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.363693  2403 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:12.478739 31500 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:12.341276  2741 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.407172  2495 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:12.475723 31495 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:12.477334  2768 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:12.280594  2775 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.434522  2696 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.480484 31571 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:12.466392 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:12.343986  2788 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:23:12.352577  2743 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:23:12.446801  2641 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:12.440932  2740 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:12.454553  2675 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:12.454128  2813 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:12.496232 32112 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:12.397562  2637 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.483788  2652 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:12.480651  2708 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:12.480083  2723 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:12.505178 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2619) took 2058 ms. Trace:
I20260709 12:23:12.511281  2810 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:23:12.479311  2348 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.520890  2675 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:12.521843  2348 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.522604 32109 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:12.521931  2675 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.518375 31568 rpcz_store.cc:276] 0709 12:23:10.446315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.897636 (+451321us) service_pool.cc:224] Handling call
0709 12:23:10.897981 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.898217 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:10.898257 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:10.902901 (+  4644us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.425504 (+522603us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:11.425561 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.425654 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.504868 (+1079214us) raft_consensus.cc:1685] finished
0709 12:23:12.504901 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.505099 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":406756,"threads_started":1,"wal-append.queue_time_us":945286}
I20260709 12:23:12.493065  2573 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:12.531267 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 94077.1us
I20260709 12:23:12.505930  2731 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:12.531440  2741 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.537392  2741 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:12.542073 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 202024us
I20260709 12:23:12.536772  2408 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:12.543771  2819 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 12:23:12.543658  2831 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.223s
W20260709 12:23:12.627729 31389 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.699s (SENT)
I20260709 12:23:12.545980 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2618) took 2100 ms. Trace:
W20260709 12:23:12.629096 31389 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.736s (SENT)
I20260709 12:23:12.629602 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:12.529795  2652 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:12.631021 31389 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.783s (SENT)
W20260709 12:23:12.631429 32105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 694) took 1402 ms (client timeout 1564 ms). Trace:
I20260709 12:23:12.632406 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.632683 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:12.635906 32105 rpcz_store.cc:269] 0709 12:23:11.225357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.225990 (+   633us) service_pool.cc:224] Handling call
0709 12:23:12.627936 (+1401946us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400112954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:12.628064 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689692928}
I20260709 12:23:12.636286 31566 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:12.636433 31574 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:23:12.633929 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.636812 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:12.637161 31568 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:12.637428 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:12.637822 31389 leader_election.cc:336] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.815s (SENT)
I20260709 12:23:12.638136 31574 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:12.638870 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:12.639223 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 157947us
I20260709 12:23:12.639598 31574 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:12.548238  2839 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:23:12.547160  2830 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:23:12.544797  2816 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.392s	user 0.001s	sys 0.001s
W20260709 12:23:12.545557  2829 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:23:12.546223  2814 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
W20260709 12:23:12.546283  2838 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:23:12.658972  2781 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:12.659675 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.654964  2408 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.660576  2408 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.628777 31573 rpcz_store.cc:276] 0709 12:23:10.446045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.858887 (+412842us) service_pool.cc:224] Handling call
0709 12:23:10.859331 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.350330 (+490999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.350379 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.351003 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.555179 (+204176us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:11.744660 (+189481us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.146171 (+401511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.146256 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.545704 (+399448us) raft_consensus.cc:1685] finished
0709 12:23:12.545730 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.545910 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16257,"prepare.queue_time_us":265252,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":203720,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"thread_start_us":1195758,"threads_started":4,"wal-append.queue_time_us":558033}
I20260709 12:23:12.662375 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.663046  2408 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:12.659201  2790 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:23:12.643906 31498 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:23:12.659294  2803 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:23:12.644009 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:12.644445 31418 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:12.665892 31566 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:12.641961 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.649276 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.603219  2628 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.544198  2741 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:12.634938  2789 consensus_meta.cc:287] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.665s	user 0.014s	sys 0.006s
I20260709 12:23:12.601472  2818 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:12.544584  2834 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.659183  2652 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.680564  2770 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:12.651448 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.681138  2770 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:12.660796 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.666802 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.683736 31420 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:12.667028 31574 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:12.668226 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.685098 31566 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:12.659039  2835 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.676924 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.678443 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:12.674014 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.681519 31565 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:12.688022 31573 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12.
I20260709 12:23:12.647995  2690 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:12.690207 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.682297  2770 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.692579  2637 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.686810  2738 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:12.693922  2775 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.696228  2797 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.625926  2759 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:12.679639  2769 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.000s
I20260709 12:23:12.686429  2789 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.704411 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.832440 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.704753 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.833122 31419 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:12.832861 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d385c04853e749af8fb00afe40a4a255 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e166c1cb41f04d55a85e6c0d7966e32e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:12.711129 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:12.833006 31568 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:12.711550 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:12.708967 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 880) took 1047 ms. Trace:
W20260709 12:23:12.698670  2679 consensus_meta.cc:287] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.389s	user 0.002s	sys 0.012s
W20260709 12:23:12.706648  2825 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:23:12.823240  2690 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:12.699133  2671 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.000s
W20260709 12:23:12.701645  2849 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 12:23:12.774765  2829 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:12.631948  2740 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.837455 31424 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:12.828330 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 382497us
I20260709 12:23:12.834652 31567 rpcz_store.cc:276] 0709 12:23:11.661731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.662212 (+   481us) service_pool.cc:224] Handling call
0709 12:23:11.662564 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.679515 (+ 16951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.679561 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.755894 (+ 76333us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.962844 (+206950us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:11.962897 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.962979 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.708690 (+745711us) raft_consensus.cc:1685] finished
0709 12:23:12.708720 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:12.708908 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3203,"raft.queue_time_us":142163,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":193076,"threads_started":1,"wal-append.queue_time_us":532498}
W20260709 12:23:12.840896 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 460246us
I20260709 12:23:12.841298  2770 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:12.867494 31422 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:12.846807 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:12.847729 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 209919us
W20260709 12:23:12.865880 31465 leader_election.cc:336] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.757s (SENT)
W20260709 12:23:12.869679 31389 leader_election.cc:336] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.883s (SENT)
I20260709 12:23:12.870050 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:12.836628  2853 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
W20260709 12:23:12.870406 31465 leader_election.cc:336] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.971s (SENT)
I20260709 12:23:12.871960 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:12.872349 31498 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:12.873958 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:12.877233 31389 leader_election.cc:336] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.966s (SENT)
I20260709 12:23:12.877609 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.892259 32109 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:12.893693  2555 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:12.896174 31389 leader_election.cc:336] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.968s (SENT)
I20260709 12:23:12.896623 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.896538 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:12.898162 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:12.899124 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:12.900082 31465 leader_election.cc:336] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.264s (SENT)
I20260709 12:23:12.900830 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.901495 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.902087 31568 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:12.904987 31465 leader_election.cc:336] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 3.181s (SENT)
I20260709 12:23:12.901928 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:12.907069 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:12.907729 31417 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:12.867619  2759 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:12.912014 31465 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.511s (SENT)
I20260709 12:23:12.906497 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:12.912765 31465 leader_election.cc:336] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.953s (SENT)
I20260709 12:23:12.912760 31421 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:23:12.905915  2628 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:12.950258 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54108.6us
W20260709 12:23:12.951400 31389 leader_election.cc:336] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.102s (SENT)
W20260709 12:23:12.952292 31389 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.133s (SENT)
I20260709 12:23:12.952801 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:12.953437 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:12.834959  2769 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.954360 31568 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:12.954591 31389 leader_election.cc:336] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.157s (SENT)
I20260709 12:23:12.955448 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:12.958902 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:12.902808  2679 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:12.899991  2835 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.949700  2775 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:12.868005  2671 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:12.910490  2730 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:12.916196  2628 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.990978 31498 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:12.991597 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:12.911104  2735 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:12.868525  2690 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:12.917798  2555 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:12.910948  2675 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:12.959344 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:12.996236  2785 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:13.057179 31423 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:12.899318  2637 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:23:12.994738  2825 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:13.020785 31567 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:13.013933 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.060595 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:13.021078 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.021631 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 660) took 1182 ms. Trace:
W20260709 12:23:13.025121 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.016546 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.019883 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.062992 31570 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:13.046350 31417 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:13.051537 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.052874 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:12.914170  2857 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.061501 31493 rpcz_store.cc:276] 0709 12:23:11.839395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.842772 (+  3377us) service_pool.cc:224] Handling call
0709 12:23:13.021417 (+1178645us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002e7554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:13.021558 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518524800}
I20260709 12:23:12.957968  2738 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.958629  2795 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.069665 31565 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:13.061667 31568 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:12.958112  2834 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:13.008160  2787 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 1.253s	user 0.000s	sys 0.005s
I20260709 12:23:13.031303  2730 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:13.067174 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112660us
I20260709 12:23:12.993908  2508 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.106s
W20260709 12:23:13.079959 31389 leader_election.cc:336] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.210s (SENT)
I20260709 12:23:13.080051  2743 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.080418 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:12.990623  2741 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:13.080545  2743 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.081364  2741 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.083390  2741 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.083894  2741 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:13.084174  2741 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:13.084890  2741 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.085985  2741 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.087702 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 871) took 1926 ms. Trace:
I20260709 12:23:13.078305  2834 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.088573  2769 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.999454  2832 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:23:13.089322  2730 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.066502  2785 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.004015  2789 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:12.993309  2818 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:13.091737  2818 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:13.008234  2859 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.170s	user 0.000s	sys 0.005s
I20260709 12:23:13.073117 31421 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:13.093542 31570 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:13.012121  2744 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.032375  2628 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.025315  2679 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:23:13.033842  2845 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:13.080265  2508 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:13.112150 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.116231 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:13.071812 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 80280.7us
I20260709 12:23:13.116888 31499 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:13.088114 31569 rpcz_store.cc:276] 0709 12:23:11.160787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.160915 (+   128us) service_pool.cc:224] Handling call
0709 12:23:11.217326 (+ 56411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.217647 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.217680 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.232235 (+ 14555us) log.cc:844] Serialized 26 byte log entry
0709 12:23:12.617930 (+1385695us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18004277e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:23:12.717908 (+ 99978us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:12.717967 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.718070 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.087339 (+369269us) raft_consensus.cc:1685] finished
0709 12:23:13.087365 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.087633 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71084,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5358,"spinlock_wait_cycles":5958912,"thread_start_us":73608,"threads_started":1,"wal-append.queue_time_us":1665055}
I20260709 12:23:13.104447 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.072649  2750 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:13.108585 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.065070  2675 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:13.073067  2705 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.112848 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.140851 31493 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:13.120658 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:13.100472 31389 leader_election.cc:336] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.243s (SENT)
I20260709 12:23:13.141952 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:13.142458 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:13.155762  2795 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.156481  2795 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.158751  2795 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:13.159626 31389 leader_election.cc:336] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.353s (SENT)
I20260709 12:23:13.160163 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.161098  2795 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.106102 31498 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:13.136829 31417 raft_consensus.cc:2410] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:13.121920 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.137347 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2635) took 2498 ms. Trace:
I20260709 12:23:13.170325 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.128994 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.171013 31574 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:13.170807 31572 rpcz_store.cc:276] 0709 12:23:10.621343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.932044 (+310701us) service_pool.cc:224] Handling call
0709 12:23:10.932346 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:11.544553 (+612207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:11.544625 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:11.553377 (+  8752us) log.cc:844] Serialized 26 byte log entry
0709 12:23:11.911421 (+358044us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:11.961163 (+ 49742us) log.cc:844] Serialized 14 byte log entry
0709 12:23:11.961529 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:11.961624 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:12.705925 (+744301us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:13.098632 (+392707us) raft_consensus.cc:1685] finished
0709 12:23:13.119618 (+ 20986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.119740 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5795,"prepare.queue_time_us":57241,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":60862,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6780,"spinlock_wait_cycles":37846272,"thread_start_us":862000,"threads_started":2,"wal-append.queue_time_us":887637}
I20260709 12:23:13.172672 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:13.173556 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.173714 31574 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.171780 31499 raft_consensus.cc:2410] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:13.128978 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.176306 31417 raft_consensus.cc:2410] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:13.181836 31419 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:13.183926 31389 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.496s (SENT)
I20260709 12:23:13.184844 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.110483  2832 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.110900  2769 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.195824 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.076079  2738 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.110483  2831 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.113847  2508 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.199213 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:13.114194  2845 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:13.111147  2718 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.110965  2855 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:13.201292  2743 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.236806 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:13.121330  2735 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.107s
W20260709 12:23:13.255157 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.199594  2559 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.188733  2408 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:23:13.234088 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47118.1us
I20260709 12:23:13.191774  2857 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.227257  2508 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.135977  2750 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.262601 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.235968  2690 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.188583  2841 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:23:13.270984 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 133470us
W20260709 12:23:13.272017 31465 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.107s (SENT)
I20260709 12:23:13.272432 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:13.205597 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.240768 31494 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:23:13.243855 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 664) took 1068 ms. Trace:
I20260709 12:23:13.275009 31493 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:13.274107 31491 rpcz_store.cc:276] 0709 12:23:12.175443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.176017 (+   574us) service_pool.cc:224] Handling call
0709 12:23:12.176462 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:12.311161 (+134699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.311192 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:12.333767 (+ 22575us) log.cc:844] Serialized 52 byte log entry
0709 12:23:12.628226 (+294459us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:12.909676 (+281450us) log.cc:844] Serialized 14 byte log entry
0709 12:23:12.909833 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.051725 (+141892us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400023ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:13.051795 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.243486 (+191691us) raft_consensus.cc:1685] finished
0709 12:23:13.243614 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.243787 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":444907,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":16704,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":52039,"spinlock_wait_cycles":288591616,"thread_start_us":441683,"threads_started":2,"wal-append.queue_time_us":238101}
W20260709 12:23:13.258070  2862 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 12:23:13.252421  2705 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:13.246088  2860 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:23:13.294126 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:13.283161 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.297084 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:13.298834 32105 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:13.300865 31389 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:13.312888 31574 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:13.293286  2813 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 12:23:13.267707  2818 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.280891  2475 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.287287  2690 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.263441  2559 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.239662  2718 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.330054 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 869) took 3132 ms. Trace:
I20260709 12:23:13.295930  2834 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.312093  2857 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.312327  2348 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:13.353902 32109 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:13.338095 31571 rpcz_store.cc:276] 0709 12:23:10.197886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.210809 (+ 12923us) service_pool.cc:224] Handling call
0709 12:23:10.211180 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:12.495629 (+2284449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.329774 (+834145us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b540023fd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:13.329986 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5218623872}
W20260709 12:23:13.354089  2821 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.188s	user 0.014s	sys 0.000s
I20260709 12:23:13.239677  2675 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.346937  2690 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.373643  2740 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.237107  2831 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.390508 31571 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:13.361577  2348 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.400740  2750 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:13.401680  2865 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:23:13.489655 31418 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:13.409078  2736 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:13.490707  2736 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.488174  2831 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.483237  2740 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.409281  2559 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.241119  2855 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.228142  2832 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.504431  2855 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.506544 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:13.508668  2876 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:13.509184  2876 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.510835  2718 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.511636  2876 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.512337  2876 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:13.512854  2876 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:13.517048  2690 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.505720  2832 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.522446  2797 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.523640  2857 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:13.243422  2845 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.524123  2857 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.382385  2821 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.526281  2857 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.528028  2821 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.488183  2348 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.488818 31565 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:13.473011  2408 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.531086  2408 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.533735  2408 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.401691  2738 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:13.535363 31465 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.662s (SENT)
W20260709 12:23:13.414249  2770 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 12:23:13.492848  2736 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.552559  2785 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:13.442476  2768 consensus_meta.cc:287] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.001s
I20260709 12:23:13.513962  2876 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:13.585744 31569 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:13.599115 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:13.600342  2759 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.674s	user 0.003s	sys 0.010s
W20260709 12:23:13.615868 31465 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.742s (SENT)
I20260709 12:23:13.617908 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.603422  2475 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:13.600719  2408 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:13.616609 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.627375 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.042s
W20260709 12:23:13.627705 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.042s
I20260709 12:23:13.605016  2555 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:13.638443  2744 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.609589  2785 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.624253  2475 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.609165  2628 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.624464  2743 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.670158 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.665416 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.667675 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.671360 31491 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:13.668728 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.637701  2841 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:13.601505  2768 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.664384 31497 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:13.669293  2805 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.648999  2408 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.664702  2797 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.591367  2730 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.627152  2652 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:13.651551  2759 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:13.683907 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5558975260000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:23:13.664520  2744 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.675115  2875 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.670600  2475 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.688855 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.681668  2805 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.691308  2408 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.685626  2736 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:23:13.681754  2785 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.696130  2730 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.698805  2797 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.701308  2628 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.678072  2743 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.686142  2813 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:13.686048  2741 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:13.686046 31540 connection.cc:256] RPC call timeout handler was delayed by -1.086997526000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:23:13.653426  2555 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.682227  2821 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.708531  2740 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:13.731949 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.684041  2795 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:23:13.738202 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:13.742383 31540 connection.cc:256] RPC call timeout handler was delayed by -1.0491975260001709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 12:23:13.747972 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:13.728255  2805 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.708772  2759 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.731317  2705 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.711663  2508 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.751149 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.755378 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.719203  2770 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:23:13.733316  2785 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.782256 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.716847  2875 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.756263  2740 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.813467 31497 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:13.815603 31572 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:13.749986  2741 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.824725 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.828554 31495 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:13.756057  2348 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:23:13.830255  2882 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:13.801190  2408 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.769775  2675 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:23:13.848131 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:13.766355  2705 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.850982 31565 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.864655 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:13.867651 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 359380us
I20260709 12:23:13.871167  2841 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:13.871610 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.873312 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.877849  2744 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.879508  2759 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:13.888952  2890 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:13.889835 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2822) took 1248 ms. Trace:
I20260709 12:23:13.890331 31423 rpcz_store.cc:276] 0709 12:23:12.641463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.641572 (+   109us) service_pool.cc:224] Handling call
0709 12:23:12.642015 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.057675 (+415660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.889531 (+831856us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400352ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:13.889753 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944037632}
I20260709 12:23:13.850719  2637 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:13.905445  2797 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.908704 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.909317 31424 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:13.909739 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:13.908113 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d385c04853e749af8fb00afe40a4a255 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:13.910600 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:13.911320 31422 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.912361  2508 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.914472  2875 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.909966 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.915778  2785 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.895758  2637 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:13.918358  2637 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.919579  2637 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:13.921890 31422 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:13.851959  2408 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.943080  2408 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.891059  2768 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.926801  2741 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.928006 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.945060 31492 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:13.945907 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.946900 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.947459 31492 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:13.928835 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:13.949115 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2825) took 1275 ms. Trace:
I20260709 12:23:13.929028 31423 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:13.949558 31418 rpcz_store.cc:276] 0709 12:23:12.673449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.673667 (+   218us) service_pool.cc:224] Handling call
0709 12:23:13.948970 (+1275303us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540022f454. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:13.949063 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843321216}
I20260709 12:23:13.929658 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 611) took 1054 ms. Trace:
I20260709 12:23:13.930177 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.950939 31498 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.950770 31419 rpcz_store.cc:276] 0709 12:23:12.875067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.875187 (+   120us) service_pool.cc:224] Handling call
0709 12:23:12.907708 (+ 32521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.182337 (+274629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.929441 (+747104us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003ece54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:13.929603 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629846400}
W20260709 12:23:13.930753 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.955077  2743 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.955713  2797 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:13.956638 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:13.931115  2818 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.957520  2770 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:13.957937  2770 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:13.931149 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.958640 31491 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.959235  2770 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.960208  2705 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.960521  2770 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:13.932425 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:13.932578  2845 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.962988 31500 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:13.933645 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 182549us
I20260709 12:23:13.967818 31540 leader_election.cc:400] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:13.968592 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.935019 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.969201 31571 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:13.936038 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.936255 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 616) took 1060 ms. Trace:
I20260709 12:23:13.970798 31421 rpcz_store.cc:276] 0709 12:23:12.876242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.950482 (+ 74240us) service_pool.cc:224] Handling call
0709 12:23:12.950872 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.093410 (+142538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.935929 (+842519us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002120d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:13.936181 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280409472}
I20260709 12:23:13.968815 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:13.972792  2881 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:13.975821 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:13.976789  2881 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.979252  2797 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:13.981472 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:13.984941  2863 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:13.936923 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.934553  2555 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:13.940480  2671 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:13.957630  2818 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:13.988847  2818 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:13.932112 31494 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:13.966991 31572 pending_rounds.cc:85] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 8
I20260709 12:23:13.990520 31572 pending_rounds.cc:107] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:13.990815  2863 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.991492  2863 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:13.992551 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:13.990857 31572 raft_consensus.cc:2889] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.997296 31500 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:14.000079 31491 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:13.895850 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.002409 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:14.008288 31567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.067s	sys 0.106s
I20260709 12:23:14.015767 31569 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:14.016305 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 120560us
I20260709 12:23:14.023813 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.025842 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:14.026433 31574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.015s	sys 0.025s
I20260709 12:23:14.027823 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.011989 31565 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
W20260709 12:23:14.015849 31567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.067s	sys 0.106s
I20260709 12:23:14.008502 31498 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
W20260709 12:23:14.031497 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.031406 31422 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:14.028594 31415 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:14.034148 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.035027 32112 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:14.035781 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.040050 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.041873 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.042434 32107 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:14.045996 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.046500 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.047109 31573 raft_consensus.cc:2376] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9. Re-sending same reply.
I20260709 12:23:14.039026 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.048164 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.048372 31574 raft_consensus.cc:2376] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:23:14.051898 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.054075 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.055279 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.057994 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:14.058295 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.064342 31573 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12. Re-sending same reply.
I20260709 12:23:14.065344 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.060539 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.062310 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.067425 32105 raft_consensus.cc:2410] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:14.070047 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.068156 31574 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:14.072119 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.073992 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.035432  2641 raft_consensus.cc:2764] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:23:14.074772 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.079298 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.079805 32108 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:14.078846 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.077140 31569 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:14.042906  2555 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.078925 31574 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12. Re-sending same reply.
I20260709 12:23:14.087400 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:14.147018 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 72919.1us
W20260709 12:23:14.147137 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55903.9us
I20260709 12:23:14.147773 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.149921 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.148083 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:14.151883 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.152670 31565 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:14.073562  2736 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:14.158571 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.079020  2408 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:14.095629  2675 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.171389 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:14.160506  2886 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:14.187085 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.188200 31491 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:14.191483 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.174669 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.194037 31565 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:14.078496  2841 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:23:14.182708 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.183569 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:14.196506 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.197770 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.199079 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.207010 31424 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:14.199383 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.200218 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.209331 31420 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:14.201824 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.202450 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.202809  2797 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:14.164162  2892 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:14.166950  2408 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.149384  2348 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:23:14.240537 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.173012  2759 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:14.216197 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47398.5us
I20260709 12:23:14.271198 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.149240  2555 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:14.277474 31573 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:14.277769 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.223367 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.266192 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.173219  2735 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:14.155223  2876 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:23:14.272003 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.272943 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.298413 31415 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:14.298776 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:14.300518 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.297780 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.273834 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.238822  2641 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:14.214228  2863 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:14.290186 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.273566 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.241488  2892 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.319052 31419 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:14.217279  2652 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.212867  2736 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:14.278870  2675 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:14.342780 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.027s
W20260709 12:23:14.343492 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.028s
I20260709 12:23:14.302984 31423 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:14.270027  2408 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:14.344029 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 506410us
I20260709 12:23:14.346438 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.238111  2797 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:14.299491  2759 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:14.347560 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 74081.7us
I20260709 12:23:14.347770 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.239020  2475 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.348856 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:14.309762  2641 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:14.352473 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:14.357425  2559 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:14.343180  2675 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.359043  2675 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.323385  2892 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.357697  2736 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.367164 32107 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:23:14.367735 32107 pending_rounds.cc:85] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 10
I20260709 12:23:14.368141 32107 pending_rounds.cc:107] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:23:14.368469 32107 raft_consensus.cc:2889] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:14.370740 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.375344 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:14.376816 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.320709  2735 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.382091 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.379860 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.353072  2637 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.383291 31569 raft_consensus.cc:2376] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6. Re-sending same reply.
I20260709 12:23:14.386615 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.392191 31569 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:14.354516  2671 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.365888  2705 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:23:14.397598  2475 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:14.429527 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.430234 31573 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:14.398142  2841 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:14.399993 32114 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:14.402079 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.402189 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.402853 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.439149 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.379379 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.411267 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.389210 31418 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:14.412951 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:14.414117 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.414628 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.415760 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.432209 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.435314 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.407899  2797 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:14.440006 31565 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:14.440147 31491 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:14.440707 31493 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:14.440770 31499 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:14.439105 32106 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:14.445161 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:14.441155 31573 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:14.440280 31500 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.441484 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.448396 31569 raft_consensus.cc:2376] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9. Re-sending same reply.
I20260709 12:23:14.448575 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.449222 31573 raft_consensus.cc:2376] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8. Re-sending same reply.
I20260709 12:23:14.449193 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.450075 31569 raft_consensus.cc:2368] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
W20260709 12:23:14.452004 32109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.019s	sys 0.036s
W20260709 12:23:14.452867 32109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.019s	sys 0.036s
I20260709 12:23:14.453666 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.452448 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.454756 31496 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:14.454988 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75682.2us
I20260709 12:23:14.455749 32112 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:23:14.455585 31569 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:14.456037 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.456413 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.456622 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.457671 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.458886 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.460076 31569 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:14.460304 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.460403 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:14.460834 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.461093 32107 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.365006  2863 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:23:14.463884 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:14.366377  2743 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:23:14.438656  2841 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:14.297736 31574 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10. Re-sending same reply.
I20260709 12:23:14.462035 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.466750 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:14.467710 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.468487 31493 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:23:14.468348 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:14.462536 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60540.1us
I20260709 12:23:14.416642  2671 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:14.459775 31500 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:14.480731 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.481812 31498 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
W20260709 12:23:14.487576 31465 leader_election.cc:336] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.566s (SENT)
I20260709 12:23:14.488119 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.492128 31568 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:14.493387 31568 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:14.493575 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.496623 31500 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:14.566526 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:14.571600 32110 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.007s
W20260709 12:23:14.572009 32110 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.007s
I20260709 12:23:14.495293 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:14.505343 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:14.511057 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.518642 31574 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:14.574242 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.574985 31574 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.526741 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:14.579329 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52713.8us
W20260709 12:23:14.579713 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84478.6us
I20260709 12:23:14.580116 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:14.494361  2857 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:14.494668  2671 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.495648  2875 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.538175 32107 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:14.470472  2904 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:14.508061  2876 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.496012  2832 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:14.469827  2841 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:14.459548 31573 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:14.554207 31565 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:14.518841  2348 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:14.462692  2641 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:14.516960  2813 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:23:14.570060 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:14.500083 31572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.002s
I20260709 12:23:14.582468 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:14.585212 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:14.586301  2652 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:14.516680  2759 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.648240 31574 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:23:14.631944 31571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.002s	sys 0.036s
W20260709 12:23:14.651898 31571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.036s
W20260709 12:23:14.526773 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 379044us
I20260709 12:23:14.578969  2555 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:14.647693 31493 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:23:14.648159 31572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.002s
W20260709 12:23:14.648115 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62989.8us
I20260709 12:23:14.587384  2904 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.584544  2845 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:14.589592  2851 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:14.587287  2900 raft_consensus.cc:2764] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:23:14.654270 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.654224 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:14.654044 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.689438 31574 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:14.631337  2863 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:14.691188 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 121208us
I20260709 12:23:14.631197 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:14.697350 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:14.635531  2857 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:14.636068  2821 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:14.638477  2348 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:14.657253  2895 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:23:14.649556  2881 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:14.711726 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80641.6us
I20260709 12:23:14.719611 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:14.716928 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.721269 31574 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:14.657577  2851 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:14.634356  2832 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:14.730084 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:14.692585  2841 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.657228  2904 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:14.707795  2821 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.708966  2818 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.657033  2652 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.738333 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.794173 31574 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:14.706902  2555 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:14.723869  2736 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:14.708678  2917 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:14.692256  2845 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.725263  2559 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:14.801721 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.735211  2852 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.737267  2851 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.812819 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:14.814513 31498 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:23:14.814898 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:15.024598 31498 pending_rounds.cc:85] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 6
I20260709 12:23:15.024551 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:15.025072 31498 pending_rounds.cc:107] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:23:15.025326 32113 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.797834  2881 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.793076  2821 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.950733 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:15.031956 31574 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:23:15.032351  2922 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:23:15.033429 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:14.930991 31568 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:14.930991  2818 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:14.987588 31423 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:23:14.988068 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:15.041303 31573 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:15.042243 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:15.042840 31573 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:15.043756 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:14.735383  2743 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 12:23:14.989463 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.815145 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:15.025328 31498 raft_consensus.cc:2889] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:14.802183  2628 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:14.812897  2917 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.805189  2736 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.030881 31492 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:23:14.951838  2912 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:23:15.034603 31574 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:15.044989 31499 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:15.050736 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:15.058261 31573 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:15.068614 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 901) took 1113 ms. Trace:
I20260709 12:23:15.069010 31572 rpcz_store.cc:276] 0709 12:23:13.955409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.966401 (+ 10992us) service_pool.cc:224] Handling call
0709 12:23:13.966810 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.994014 (+ 27204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.994046 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:13.994492 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.653455 (+658963us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:14.653496 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.653553 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.068418 (+414865us) raft_consensus.cc:1685] finished
0709 12:23:15.068437 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.068557 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":658666,"threads_started":1,"wal-append.queue_time_us":719080}
I20260709 12:23:14.817308  2555 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.016779  2795 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:15.083616 31422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.042s	sys 0.051s
W20260709 12:23:15.047688  2901 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.491s	user 0.001s	sys 0.000s
W20260709 12:23:15.047887  2920 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 12:23:15.053217  2881 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:15.053052  2917 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.043001  2475 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:23:15.102569 31568 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:15.017293  2863 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:15.104738 31496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.030s	sys 0.086s
W20260709 12:23:15.151531 31496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.030s	sys 0.086s
W20260709 12:23:15.062160  2910 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 12:23:14.988633  2348 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.107555 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.055954  2818 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:14.960539  2857 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.184518  2919 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.380s	user 0.000s	sys 0.000s
W20260709 12:23:15.186594  2913 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:23:15.187716  2925 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 12:23:15.188898  2929 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:23:15.189394  2735 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:15.190362  2906 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.464s	user 0.000s	sys 0.000s
I20260709 12:23:15.191393  2348 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:15.191861  2915 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 12:23:15.168192  2408 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.001s
I20260709 12:23:15.194721 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1655) took 1354 ms. Trace:
I20260709 12:23:15.194957 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 627) took 1260 ms. Trace:
I20260709 12:23:15.195324 31417 rpcz_store.cc:276] 0709 12:23:13.934378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.936732 (+  2354us) service_pool.cc:224] Handling call
0709 12:23:13.937193 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:13.937693 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.937738 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:13.938517 (+   779us) log.cc:844] Serialized 52 byte log entry
0709 12:23:14.324192 (+385675us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:14.347133 (+ 22941us) log.cc:844] Serialized 14 byte log entry
0709 12:23:14.347319 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.347400 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.194761 (+847361us) raft_consensus.cc:1685] finished
0709 12:23:15.194784 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.194904 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22496,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":776,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":4861,"thread_start_us":384278,"threads_started":1,"wal-append.queue_time_us":589654}
I20260709 12:23:15.198151 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2839) took 1135 ms. Trace:
W20260709 12:23:15.166491  2911 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
W20260709 12:23:15.109629 31422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.042s	sys 0.051s
I20260709 12:23:15.195127 31495 rpcz_store.cc:276] 0709 12:23:13.840300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.840441 (+   141us) service_pool.cc:224] Handling call
0709 12:23:13.840829 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.841293 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.841334 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:13.841864 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.244301 (+402437us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:14.244351 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.244464 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.194483 (+950019us) raft_consensus.cc:1685] finished
0709 12:23:15.194503 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.194647 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6652,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2352,"thread_start_us":379804,"threads_started":1,"wal-append.queue_time_us":777651}
I20260709 12:23:15.215090 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2835) took 1182 ms. Trace:
I20260709 12:23:15.215566 31422 rpcz_store.cc:276] 0709 12:23:14.032877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.037310 (+  4433us) service_pool.cc:224] Handling call
0709 12:23:14.037636 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:14.037867 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:14.525206 (+487339us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.211615 (+686409us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.214394 (+  2779us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.214580 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.214642 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.214716 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.214817 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.215020 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16544,"prepare.queue_time_us":113349,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2396,"thread_start_us":1136972,"threads_started":2}
W20260709 12:23:15.210671  2892 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.000s
W20260709 12:23:15.224424 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 236541us
W20260709 12:23:15.226116 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:15.096131 31494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.018s
I20260709 12:23:15.145962 31573 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 12:23:15.228062 31494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.009s	sys 0.018s
I20260709 12:23:15.075703  2628 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:15.106814 31569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.042s	sys 0.071s
W20260709 12:23:15.229688 31569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.042s	sys 0.071s
I20260709 12:23:15.109361  2795 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:15.052799  2736 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:15.200176 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 674) took 1274 ms. Trace:
I20260709 12:23:15.200451 32113 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:15.231668 31497 rpcz_store.cc:276] 0709 12:23:13.925844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.004307 (+ 78463us) service_pool.cc:224] Handling call
0709 12:23:14.004746 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.005239 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:14.005329 (+    90us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.006022 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.525696 (+519674us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:14.525733 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.525796 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.199919 (+674123us) raft_consensus.cc:1685] finished
0709 12:23:15.199946 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.200109 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7492,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":24306,"thread_start_us":463205,"threads_started":1,"wal-append.queue_time_us":649973}
I20260709 12:23:15.198529 31421 rpcz_store.cc:276] 0709 12:23:14.062809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.062920 (+   111us) service_pool.cc:224] Handling call
0709 12:23:14.063247 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:14.063707 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.063737 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:14.083304 (+ 19567us) log.cc:844] Serialized 52 byte log entry
0709 12:23:14.548556 (+465252us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:14.548609 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.548698 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.197946 (+649248us) raft_consensus.cc:1685] finished
0709 12:23:15.197966 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.198096 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6581,"thread_start_us":380210,"threads_started":1,"wal-append.queue_time_us":432215}
I20260709 12:23:15.147102  2881 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.222829 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 197557us
W20260709 12:23:15.231328 31387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.002s	sys 0.007s
W20260709 12:23:15.221500  2901 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:23:15.238024 31387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.007s
W20260709 12:23:15.239382 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 941799us
W20260709 12:23:15.108199 31491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.033s
I20260709 12:23:15.164135  2863 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:15.240149 31491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.010s	sys 0.033s
W20260709 12:23:15.116261 32110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.022s	sys 0.022s
W20260709 12:23:15.241856 32110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.022s	sys 0.022s
W20260709 12:23:15.242544 31500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.016s
W20260709 12:23:15.242889 31500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.007s	sys 0.016s
I20260709 12:23:15.151405  2559 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.199869  2408 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.242393 31540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.002s	sys 0.011s
I20260709 12:23:15.244951 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 902) took 1289 ms. Trace:
I20260709 12:23:15.245882 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 889) took 1224 ms. Trace:
W20260709 12:23:15.247910 31540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.002s	sys 0.011s
I20260709 12:23:15.248026 31566 rpcz_store.cc:276] 0709 12:23:13.955713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.959438 (+  3725us) service_pool.cc:224] Handling call
0709 12:23:13.959901 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.960267 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.960298 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:13.960823 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.390490 (+429667us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:14.390537 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.390626 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.244756 (+854130us) raft_consensus.cc:1685] finished
0709 12:23:15.244775 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.244891 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1152,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":429273,"threads_started":1,"wal-append.queue_time_us":606758}
W20260709 12:23:15.249740 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 557904us
I20260709 12:23:15.250995 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:15.253588 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:15.265452 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.008s
W20260709 12:23:15.266739 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.007s	sys 0.008s
I20260709 12:23:15.244112  2832 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:15.229390  2892 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.267053 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 685695us
I20260709 12:23:15.265811 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:15.272390  2927 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:15.265763  2908 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:23:15.280866 31421 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:23:15.283038 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.013s
W20260709 12:23:15.299078 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.006s	sys 0.014s
W20260709 12:23:15.299809 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 566300us
I20260709 12:23:15.301270 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:15.304020 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:15.454903 31389 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.162s (SENT)
W20260709 12:23:15.691498 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 236907us
I20260709 12:23:15.457284 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:15.695271 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 238373us
W20260709 12:23:15.463505 31463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.022s
W20260709 12:23:15.477531 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 226497us
W20260709 12:23:15.698328 31463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.000s	sys 0.022s
I20260709 12:23:15.351627 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 883) took 2250 ms. Trace:
I20260709 12:23:15.489981  2968 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:15.698850 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 891166us
I20260709 12:23:15.699337  2968 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.702010 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:15.702277  2968 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:15.381909  2408 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.699046 31570 rpcz_store.cc:276] 0709 12:23:13.101298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.105250 (+  3952us) service_pool.cc:224] Handling call
0709 12:23:13.121648 (+ 16398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:13.421733 (+300085us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:13.764870 (+343137us) log.cc:844] Serialized 14 byte log entry
0709 12:23:14.236639 (+471769us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:15.115135 (+878496us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b2c0010e118. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:23:15.147677 (+ 32542us) log.cc:844] Serialized 52 byte log entry
0709 12:23:15.147869 (+   192us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:15.147899 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.147976 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.345424 (+197448us) raft_consensus.cc:1685] finished
0709 12:23:15.351356 (+  5932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.351544 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81,"prepare.queue_time_us":67384,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":236288,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":11280,"spinlock_wait_cycles":2535168,"thread_start_us":1051934,"threads_started":3,"wal-append.queue_time_us":703609}
I20260709 12:23:15.708374  2970 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:15.354723  2555 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:15.709218  2970 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.709704 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:15.292198  2628 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.710732  2741 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:15.711374  2875 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:15.711977  2875 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.712430  2875 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:15.279820  2652 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:15.306512  2735 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:15.270572  2795 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:15.272794  2797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.035s	sys 0.033s
W20260709 12:23:15.716018  2797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.035s	sys 0.033s
I20260709 12:23:15.282815  2832 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:23:15.716334  2641 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.717525  2832 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:15.718093  2832 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:15.705518  2805 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:15.719089 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:15.719395  2805 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.247027  2852 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:23:15.321647  2924 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 12:23:15.373399  2926 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 12:23:15.393569  2928 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:23:15.723212 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 907) took 1766 ms. Trace:
W20260709 12:23:15.413327  2930 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:23:15.411211  2932 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:23:15.723693 31571 rpcz_store.cc:276] 0709 12:23:13.956931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.971414 (+ 14483us) service_pool.cc:224] Handling call
0709 12:23:13.995111 (+ 23697us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:23:13.995286 (+   175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.995626 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.995654 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.013055 (+ 17401us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.652581 (+639526us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:14.652635 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.652724 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.722531 (+1069807us) raft_consensus.cc:1685] finished
0709 12:23:15.722577 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.722909 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6400,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7753,"spinlock_wait_cycles":50203520,"thread_start_us":597186,"threads_started":1,"wal-append.queue_time_us":694183}
I20260709 12:23:15.730965  2735 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:15.731536  2735 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:15.731961  2735 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:15.732016  2652 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.732723 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2674) took 1656 ms. Trace:
I20260709 12:23:15.732856  2652 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.733196 31571 rpcz_store.cc:276] 0709 12:23:14.076137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.731553 (+1655416us) service_pool.cc:224] Handling call
0709 12:23:15.732021 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.732330 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.732352 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.732417 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.732455 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.732530 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.732651 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:15.412186  2933 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:23:15.735405 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 711) took 1341 ms. Trace:
I20260709 12:23:15.735838 32111 rpcz_store.cc:276] 0709 12:23:14.393376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.393730 (+   354us) service_pool.cc:224] Handling call
0709 12:23:14.394050 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.394451 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.394483 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.395046 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.724202 (+329156us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:14.724242 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.724307 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.734921 (+1010614us) raft_consensus.cc:1685] finished
0709 12:23:15.734962 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.735182 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3401,"raft.queue_time_us":929,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":30592,"thread_start_us":328792,"threads_started":1,"wal-append.queue_time_us":744371}
I20260709 12:23:15.737507  2818 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:15.730577 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 425806us
I20260709 12:23:15.739444 31571 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:15.740170 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 910) took 1641 ms. Trace:
I20260709 12:23:15.740630  2970 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:15.413046  2934 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:15.731350  2955 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:15.744357  2955 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.744800  2955 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:15.405771  2936 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:23:15.746456 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1656) took 1280 ms. Trace:
I20260709 12:23:15.746892 31496 rpcz_store.cc:276] 0709 12:23:14.466084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.466228 (+   144us) service_pool.cc:224] Handling call
0709 12:23:14.470826 (+  4598us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:14.475039 (+  4213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.475068 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:14.498499 (+ 23431us) log.cc:844] Serialized 52 byte log entry
0709 12:23:15.152105 (+653606us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.152160 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.152248 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.745950 (+593702us) raft_consensus.cc:1685] finished
0709 12:23:15.745992 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.746230 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":16371,"thread_start_us":606051,"threads_started":1,"wal-append.queue_time_us":751286}
W20260709 12:23:15.409853  2937 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:23:15.385640  2938 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.750362  2938 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.389083  2949 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:23:15.409250  2959 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:15.756497  2959 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.756930  2959 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:15.414153  2962 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:15.510641  2863 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:15.515764  2892 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.405608  2881 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:15.536439  2939 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.760672  2939 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.763177 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1667) took 1181 ms. Trace:
I20260709 12:23:15.544620 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2669) took 1440 ms. Trace:
I20260709 12:23:15.568941 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2667) took 1502 ms. Trace:
W20260709 12:23:15.526155 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 272389us
W20260709 12:23:15.587484  2967 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:23:15.763808 31574 rpcz_store.cc:276] 0709 12:23:14.066583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.083717 (+1017134us) service_pool.cc:224] Handling call
0709 12:23:15.139049 (+ 55332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.139229 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:15.491618 (+352389us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.568164 (+ 76546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.568261 (+    97us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:15.568428 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.568541 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.568779 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279662,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":2387,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":165,"thread_start_us":400549,"threads_started":2,"wal-append.queue_time_us":81249}
I20260709 12:23:15.590356 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2670) took 1523 ms. Trace:
I20260709 12:23:15.595273  2946 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.596714 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2671) took 1529 ms. Trace:
W20260709 12:23:15.608862  2851 consensus_meta.cc:287] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.010s
I20260709 12:23:15.616305 31565 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:15.619917 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1657) took 2552 ms. Trace:
I20260709 12:23:15.622148 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1662) took 1065 ms. Trace:
I20260709 12:23:15.624244  2917 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.628628 32108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 704) took 1282 ms (client timeout 1564 ms). Trace:
W20260709 12:23:15.629416 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:15.630148  2904 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.836s	user 0.006s	sys 0.012s
I20260709 12:23:15.634290  2964 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:15.648315 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d385c04853e749af8fb00afe40a4a255 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:15.632886  2759 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:15.661126  2675 consensus_meta.cc:287] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.251s	user 0.012s	sys 0.006s
W20260709 12:23:15.663461  2821 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.016s
I20260709 12:23:15.665591  2736 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:15.668731  2841 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.010s
I20260709 12:23:15.248133 32110 rpcz_store.cc:276] 0709 12:23:14.021403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.021570 (+   167us) service_pool.cc:224] Handling call
0709 12:23:14.021929 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:14.022143 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:14.572437 (+550294us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.245479 (+673042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.245547 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:15.245612 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.245689 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.245819 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3069,"prepare.queue_time_us":338362,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":3343,"raft.queue_time_us":3237,"thread_start_us":1196018,"threads_started":2,"wal-append.queue_time_us":599872}
W20260709 12:23:15.673156  2671 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.044s	user 0.016s	sys 0.003s
I20260709 12:23:15.684621 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:15.685886 31465 leader_election.cc:336] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.720s (SENT)
I20260709 12:23:15.685879 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:15.698215  2813 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:15.489297 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 909) took 1490 ms. Trace:
I20260709 12:23:15.375500 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 703) took 2019 ms. Trace:
I20260709 12:23:15.703022  2857 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:15.702226 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.719652  2832 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.722393  2805 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:15.740518 31571 rpcz_store.cc:276] 0709 12:23:14.098399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.734197 (+1635798us) service_pool.cc:224] Handling call
0709 12:23:15.738833 (+  4636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.739883 (+  1050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.740093 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:15.732903 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1664) took 1240 ms. Trace:
I20260709 12:23:15.753436  2652 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.759382  2962 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:15.762880 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:15.541738  2960 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:15.770179 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:15.763590 31500 rpcz_store.cc:276] 0709 12:23:14.582079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.582882 (+   803us) service_pool.cc:224] Handling call
0709 12:23:14.583176 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.583497 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.583524 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.583939 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.243464 (+659525us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.243504 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.243564 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.762768 (+519204us) raft_consensus.cc:1685] finished
0709 12:23:15.762805 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.763025 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13127,"raft.queue_time_us":639,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3860,"thread_start_us":596392,"threads_started":1,"wal-append.queue_time_us":665268}
I20260709 12:23:15.763661 31572 rpcz_store.cc:276] 0709 12:23:14.067031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.108039 (+1041008us) service_pool.cc:224] Handling call
0709 12:23:15.150456 (+ 42417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.153976 (+  3520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.154017 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.154530 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.490409 (+335879us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:15.491518 (+  1109us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.491907 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.492037 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.492113 (+    76us) raft_consensus.cc:1685] finished
0709 12:23:15.492129 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.507308 (+ 15179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11227,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":209484,"raft.run_cpu_time_us":579,"raft.run_wall_time_us":28759,"thread_start_us":293405,"threads_started":1,"wal-append.queue_time_us":249880}
I20260709 12:23:15.770618 31574 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:15.774986  2637 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 12:23:15.936619 32109 rpcz_store.cc:276] 0709 12:23:13.355790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.356483 (+   693us) service_pool.cc:224] Handling call
0709 12:23:13.370968 (+ 14485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.371494 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:13.371535 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:13.372024 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:23:13.915688 (+543664us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b18003dfe40. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:23:14.454605 (+538917us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:14.454642 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:14.454724 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.351845 (+897121us) raft_consensus.cc:1685] finished
0709 12:23:15.351872 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.375396 (+ 23524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406,"raft.queue_time_us":98,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8429,"spinlock_wait_cycles":13044096,"thread_start_us":538751,"threads_started":1,"wal-append.queue_time_us":1422627}
I20260709 12:23:15.936122  2935 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:15.771600  2914 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 1.131s	user 0.001s	sys 0.005s
I20260709 12:23:15.770560  2845 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:15.780830  2949 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.784314  2871 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:15.937172  2904 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.951638  2949 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.952134  2871 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:15.953383  2871 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.954126  2949 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.773099 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1658) took 1305 ms. Trace:
W20260709 12:23:15.831012 32108 rpcz_store.cc:269] 0709 12:23:14.345927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.346173 (+   246us) service_pool.cc:224] Handling call
0709 12:23:15.628202 (+1282029us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400112954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:15.628367 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943682816}
I20260709 12:23:15.936739  2671 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.898952 31573 rpcz_store.cc:276] 0709 12:23:14.067253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.233173 (+1165920us) service_pool.cc:224] Handling call
0709 12:23:15.233530 (+   357us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:15.489007 (+255477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.489067 (+    60us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:15.490354 (+  1287us) log.cc:844] Serialized 78 byte log entry
0709 12:23:15.575522 (+ 85168us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:15.575565 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.578370 (+  2805us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.589821 (+ 11451us) raft_consensus.cc:1685] finished
0709 12:23:15.589851 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.590131 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159528,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9206,"thread_start_us":339464,"threads_started":2,"wal-append.queue_time_us":96371}
W20260709 12:23:15.935860 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 193673us
I20260709 12:23:15.938778 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 913) took 1529 ms. Trace:
I20260709 12:23:15.975610 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 911) took 1688 ms. Trace:
W20260709 12:23:15.937567 31304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 289602us
I20260709 12:23:15.901108 31568 rpcz_store.cc:276] 0709 12:23:14.556719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.566227 (+  9508us) service_pool.cc:224] Handling call
0709 12:23:15.621801 (+1055574us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400058054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:15.621961 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572366720}
W20260709 12:23:15.932132 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.956193 31571 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:15.977612 31574 rpcz_store.cc:276] 0709 12:23:14.287561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.769710 (+1482149us) service_pool.cc:224] Handling call
0709 12:23:15.770202 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.957707 (+187505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.975517 (+ 17810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:15.934000 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2673) took 1866 ms. Trace:
I20260709 12:23:15.977311 31572 rpcz_store.cc:276] 0709 12:23:14.409094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.937688 (+1528594us) service_pool.cc:224] Handling call
0709 12:23:15.938069 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.938431 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.938458 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.938515 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:15.938547 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.938603 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.938716 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:16.013774 31570 rpcz_store.cc:276] 0709 12:23:14.067896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.710593 (+1642697us) service_pool.cc:224] Handling call
0709 12:23:15.711153 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.775204 (+ 64051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.775240 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:15.775302 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:15.775346 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.933689 (+158343us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b5400262fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:15.933734 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.933909 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94506240}
I20260709 12:23:15.955448  2904 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.904080 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2672) took 1836 ms. Trace:
I20260709 12:23:15.936952  2964 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:15.793390  2923 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.749s	user 0.000s	sys 0.002s
I20260709 12:23:16.019675 31565 rpcz_store.cc:276] 0709 12:23:14.067681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.615064 (+1547383us) service_pool.cc:224] Handling call
0709 12:23:15.615759 (+   695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:15.901659 (+285900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.904004 (+  2345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:15.899704 31491 rpcz_store.cc:276] 0709 12:23:14.491941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.492060 (+   119us) service_pool.cc:224] Handling call
0709 12:23:14.492335 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.492553 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.492576 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.492979 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.241135 (+748156us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:15.241183 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.241255 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.732456 (+491201us) raft_consensus.cc:1685] finished
0709 12:23:15.732506 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.732712 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":747870,"threads_started":1,"wal-append.queue_time_us":717325}
I20260709 12:23:15.946162  2348 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:15.939481  2881 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.024684 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 912) took 1731 ms. Trace:
I20260709 12:23:15.768136  2938 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:15.950264  2935 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.780926  2705 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:16.025622 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.879s (SENT) [suppressed 33 similar messages]
I20260709 12:23:15.792791  2939 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.781395  2818 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.030109 31571 rpcz_store.cc:276] 0709 12:23:14.287895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.955419 (+1667524us) service_pool.cc:224] Handling call
0709 12:23:15.955911 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.019072 (+ 63161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.019354 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:15.977223 31494 rpcz_store.cc:276] 0709 12:23:14.467376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.467494 (+   118us) service_pool.cc:224] Handling call
0709 12:23:14.469523 (+  2029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.469797 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.469833 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.470362 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.228403 (+758041us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:15.228441 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.228516 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.751726 (+523210us) raft_consensus.cc:1685] finished
0709 12:23:15.767876 (+ 16150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.772927 (+  5051us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":689269,"threads_started":1,"wal-append.queue_time_us":722462}
I20260709 12:23:15.789139  2795 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.898097 31569 rpcz_store.cc:276] 0709 12:23:13.999148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.474406 (+475258us) service_pool.cc:224] Handling call
0709 12:23:14.474762 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:14.499084 (+ 24322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:14.499208 (+   124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.510085 (+ 10877us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.230069 (+719984us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:15.230112 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.230174 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.488576 (+258402us) raft_consensus.cc:1685] finished
0709 12:23:15.488633 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.488997 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27490,"raft.queue_time_us":24350,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":7466,"thread_start_us":719338,"threads_started":1,"wal-append.queue_time_us":812341}
I20260709 12:23:16.022078  2813 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.037220 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:15.900068 31567 rpcz_store.cc:276] 0709 12:23:13.067393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.070111 (+  2718us) service_pool.cc:224] Handling call
0709 12:23:13.070567 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:13.459959 (+389392us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:14.031486 (+571527us) log.cc:844] Serialized 14 byte log entry
0709 12:23:14.518745 (+487259us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:14.519301 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:23:14.519456 (+   155us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:14.519756 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:23:14.519997 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.617983 (+1097986us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b18000bd040. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:23:15.619371 (+  1388us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400262ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:15.619413 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.619505 (+    92us) raft_consensus.cc:1685] finished
0709 12:23:15.619518 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.619725 (+   207us) inbound_call.cc:177] Queueing success response
0709 12:23:15.640971 (+ 21246us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18000bd040. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:15.768804 (+127833us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18000bd040. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
Metrics: {"mutex_wait_us":2133,"prepare.queue_time_us":39432,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":113784,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":9260,"spinlock_wait_cycles":456765184,"thread_start_us":1203215,"threads_started":3,"wal-append.queue_time_us":661625}
I20260709 12:23:15.900908  2955 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.048430  2917 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:15.944993  2851 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.032021  2841 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.059034  2841 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:16.061136 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 375443us
I20260709 12:23:16.061378  2841 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:16.061738 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.956208  2962 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:16.062413 31465 leader_election.cc:336] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.778s (SENT)
I20260709 12:23:16.063305  2832 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.065358  2964 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.068557  2935 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.068830  2735 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.071556 31573 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:16.071971  2875 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.074184  2875 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.025151  2759 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.076118  2955 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.076464  2759 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.077032 32107 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:16.079506  2851 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.081936  2671 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.084354  2959 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.087054 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.087940 31496 raft_consensus.cc:2393] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:15.902550 31566 rpcz_store.cc:276] 0709 12:23:14.067468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.259351 (+1191883us) service_pool.cc:224] Handling call
0709 12:23:15.259723 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.479354 (+219631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.479430 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.480655 (+  1225us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.576801 (+ 96146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:15.579606 (+  2805us) log.cc:844] Serialized 14 byte log entry
0709 12:23:15.594869 (+ 15263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.596115 (+  1246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:15.596213 (+    98us) raft_consensus.cc:1685] finished
0709 12:23:15.596236 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:15.596492 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2596,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":159903,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":1517,"thread_start_us":314341,"threads_started":2,"wal-append.queue_time_us":102445}
I20260709 12:23:16.012277  2821 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.055338  2408 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.055051  2705 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.055855  2938 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.056154  2778 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:16.056341  2736 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.056779  2818 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.773140  2900 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.271s
I20260709 12:23:16.039301  2348 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:16.055146 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 285260us
I20260709 12:23:15.947009  2946 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:15.946728  2675 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:15.947196  2857 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.106537 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.107287 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.044955  2813 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:16.127581 31574 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:16.107833  2705 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.132727  2927 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:16.133463  2927 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.135051 31491 raft_consensus.cc:2368] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:16.138237 31421 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:16.115231  2871 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.139055  2857 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.108119  2778 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.146782  2959 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.149323 32105 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:16.155529 31418 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:16.157327 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1667) took 1575 ms. Trace:
I20260709 12:23:16.167124 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.167593 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 915) took 1721 ms. Trace:
I20260709 12:23:16.167999 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.181012 31573 rpcz_store.cc:276] 0709 12:23:14.446597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.027875 (+1581278us) service_pool.cc:224] Handling call
0709 12:23:16.050014 (+ 22139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.071986 (+ 21972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.167336 (+ 95350us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b54001a6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:16.167533 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8441728}
W20260709 12:23:16.181528 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68669.9us
I20260709 12:23:16.169286  2818 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.038157  2960 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.170269 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:16.156126  2940 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.170954  2675 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.171015  2348 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.171231  2735 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.172730  2821 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.174427  2917 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.175776 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.176517 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.177282 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.178771 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.184243  2744 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:16.194063 31494 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:16.178122 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.180474 31565 rpcz_store.cc:276] 0709 12:23:14.582278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.035278 (+1453000us) service_pool.cc:224] Handling call
0709 12:23:16.125554 (+ 90276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.157004 (+ 31450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.157036 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:16.157092 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:16.157129 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.157178 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.157278 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:16.195223 31498 raft_consensus.cc:2368] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
W20260709 12:23:16.191493 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 127990us
I20260709 12:23:16.190307 31421 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:16.179622  2778 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:16.127333  2408 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.199234  2735 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:16.199755  2735 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:16.200166  2735 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:16.194037  2927 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.194831  2940 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.207113 31572 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:16.207856 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.208590 31417 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.211321 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.212003 31423 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:16.228220 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58060.3us
I20260709 12:23:16.230361 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.242074  2637 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:16.230962 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.245124 31417 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:16.246409 31423 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:16.253497 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55823us
I20260709 12:23:16.255533 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.256870 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:16.257805  2691 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.258555  2691 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:16.258936  2691 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:16.259258  2691 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:16.260603  2408 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.196455  2917 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.263854  2917 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.267794 31494 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:16.271773 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 914) took 1840 ms. Trace:
I20260709 12:23:16.272220 31570 rpcz_store.cc:276] 0709 12:23:14.431094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.017891 (+1586797us) service_pool.cc:224] Handling call
0709 12:23:16.046020 (+ 28129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.211851 (+165831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.211885 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:16.211935 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:16.211972 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.271566 (+ 59594us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400317754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:16.271607 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.271721 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350550912}
I20260709 12:23:16.273011 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1669) took 1690 ms. Trace:
I20260709 12:23:16.273378 31574 rpcz_store.cc:276] 0709 12:23:14.582852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.033310 (+1450458us) service_pool.cc:224] Handling call
0709 12:23:16.094055 (+ 60745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.140113 (+ 46058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.272801 (+132688us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540027f954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:16.272956 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67581312}
I20260709 12:23:16.278813  2960 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.279598 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.280395 31422 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:16.283551 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.284169 31421 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.265141  2841 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:16.264732  2946 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:16.295769 31465 leader_election.cc:336] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.766s (SENT)
I20260709 12:23:16.296275 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:16.305590 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:16.324602 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.335762 31424 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:16.339619  2916 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.340123 31494 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:16.324913  2946 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.325065  2863 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:23:16.322530  2871 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:23:16.347442  2871 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:16.347899  2871 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:16.349076  2871 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.350338  2871 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.352116 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:16.353931 31573 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:23:16.354295 31573 pending_rounds.cc:85] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:16.354631 31573 pending_rounds.cc:107] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:23:16.354892 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.355269 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:16.356050 31568 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:16.354113 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:16.357009 31574 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:16.360210 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.325130  2735 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.361546 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.362111 31417 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.362462  2735 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.363775  2813 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.365424 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.365958  2813 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.366143 31415 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:16.367141 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:16.368098 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.368422 31390 leader_election.cc:400] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:16.368717 31390 leader_election.cc:403] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:16.369232 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.369771 31492 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:16.371309  2671 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:16.354919 31573 raft_consensus.cc:2889] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:16.372845 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.373090 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 807) took 2016 ms. Trace:
W20260709 12:23:16.373222 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 86821.6us
W20260709 12:23:16.373880 31465 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.998s (SENT)
I20260709 12:23:16.374368 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:16.374310  2982 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:16.382982 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.383893  2960 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:16.368592 31415 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:16.374343 31419 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:16.373505 32105 rpcz_store.cc:276] 0709 12:23:14.356240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.365739 (+  9499us) service_pool.cc:224] Handling call
0709 12:23:14.366036 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:16.183299 (+1817263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.372841 (+189542us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540058eb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:16.373036 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4079165824}
I20260709 12:23:16.396116 31390 leader_election.cc:400] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:16.396478 31390 leader_election.cc:403] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:16.397330 31492 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:16.398473 31422 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:16.403798 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.394364 31421 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:16.413472 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.417225 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.418967 31494 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:16.414988 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:16.423034 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.400149  2744 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.407147  2691 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:16.433295  2986 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:23:16.401418  2917 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:16.411163  2841 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:16.436110 31493 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:16.435868  2841 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.424816 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:16.441043 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.410987  2813 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:16.443836 31417 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:23:16.446583 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.434535  2691 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.452999 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:16.454109 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55626.6us
W20260709 12:23:16.456281 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82441.4us
W20260709 12:23:16.457412 31465 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.089s (SENT)
I20260709 12:23:16.457937 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:16.459782 31491 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:16.460790 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:16.461371  2876 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.462904  2863 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.463148 31573 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:16.463100 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.474105 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.463714  2797 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:16.475620  2797 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:16.476866  2797 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.450816  2744 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.480950  2744 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.483723 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.485289 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:16.486193 32107 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:16.487092  2818 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.487769  2832 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.469141  2671 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:16.488782  2671 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:16.490816 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:16.491564 31500 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:16.492228 31492 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:16.487159  2946 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:16.486490 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:16.524343 31491 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:16.498312 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:16.528869 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58146.6us
I20260709 12:23:16.539019 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:16.544370 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:16.540272 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:16.554960  2841 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:16.555517  2990 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:23:16.556420 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.557042 32107 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:16.557469  2832 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:16.558072  2900 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:16.558539  2900 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:16.558940  2900 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.559592  2348 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:16.560197  2348 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:16.563820 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65581us
W20260709 12:23:16.556566 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 99194.6us
W20260709 12:23:16.602200 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62006.6us
I20260709 12:23:16.466574  2863 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.640170 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.607285  2939 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:16.655754 31465 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.140s (SENT)
I20260709 12:23:16.597394  2917 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:16.672133 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 185714us
W20260709 12:23:16.635736  2987 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:23:16.647276 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:16.688264 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 76708.4us
I20260709 12:23:16.628953  2960 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.683406 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.694914  2959 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.701783  2555 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:23:16.702298  2797 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.702188  2959 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.702843  2797 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.703470  2768 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:16.703948  2768 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.704312  2768 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:16.704641  2959 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.704928  2797 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:16.707962 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:16.624073  2968 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:23:16.708585 31493 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:16.759234  2876 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:16.708280  2348 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:16.769879 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:16.767364  2876 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.681908 31496 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:16.789480 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:16.794898 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 164033us
I20260709 12:23:16.781661  2637 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.723208  2927 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:23:16.759572  2940 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:16.694695  2917 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.828585 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.782029  2968 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:16.775856  2705 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:16.786254  2863 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:16.860487 31465 leader_election.cc:336] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.150s (SENT)
I20260709 12:23:16.829061  2637 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:16.768748  2960 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:16.879704 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.901844 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:16.902544 32108 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:16.843313  2968 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:16.858632  2946 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:16.895325  2999 log.cc:927] Time spent T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:16.922233 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:16.973527 32110 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Advancing to term 10
I20260709 12:23:16.918388  2968 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:16.911015  2778 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.014s
I20260709 12:23:16.987107 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:16.963433  2679 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.229s
W20260709 12:23:16.994602 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 311288us
I20260709 12:23:16.926198  2939 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:17.008574 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 176561us
I20260709 12:23:17.010699 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:16.976831  2916 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:16.981007  2940 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:16.984728  2959 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:17.034832 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.984284  2946 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:17.103914 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 360378us
I20260709 12:23:17.043828  2813 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:17.146788  3010 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.147329  3010 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.147560  2960 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:17.149329  3010 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.140714  2876 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:17.155552  2933 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.356s	user 0.001s	sys 0.001s
I20260709 12:23:17.156040 32108 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:17.158901  2679 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:17.122709  2813 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:17.160063  2813 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.096276  2959 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:17.070987 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:16.998504  2778 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.101289  2916 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.206107 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:17.173620 31500 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.682s	user 0.018s	sys 0.009s
I20260709 12:23:17.209050 31500 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:17.153864  2768 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:17.141239  2871 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.743s	user 0.014s	sys 0.005s
W20260709 12:23:17.171466 31465 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.160s (SENT)
I20260709 12:23:17.218907 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:17.166605  3001 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 12:23:17.223801 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.137948  2821 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.226889 32107 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:23:17.168076  2998 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:23:17.228449 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:17.228860 32106 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:17.228760 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:17.225999 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:17.235494 32110 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:17.237720 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.240461 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:17.243453 32105 raft_consensus.cc:2368] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:17.249774 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.250396 31422 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 6.
I20260709 12:23:17.252030  2988 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:17.264073 32107 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:17.231299  2935 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:17.225917  2879 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:23:17.241536  2917 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.170888  2959 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:17.275885 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:17.276154  2995 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:23:17.277100  3002 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:23:17.277176 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:17.219518  2939 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:17.278649  3000 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:23:17.279950 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:17.282841  2997 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:23:17.285702  2959 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:17.286808  2935 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.289738  2935 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.270884  2988 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.293246 32106 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:17.293823  2900 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.005s
I20260709 12:23:17.259091  2876 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.238067  2821 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.286428  2959 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:17.300724 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:17.301095 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.305297 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:17.302151 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.268782  2960 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.312207 31423 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:17.310596  2857 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 12:23:17.323143 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 271323us
I20260709 12:23:17.333020  2821 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.307346  2637 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.333231  3014 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:17.343887 31496 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.002s
I20260709 12:23:17.333608  3009 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:17.333048 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:17.310765  2935 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:23:17.336639 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.306797  3005 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:17.299539  2871 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:17.323369  2705 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:17.342329 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.294224  2900 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.352766 32106 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:17.355108 31500 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:17.355370 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:17.363255 31465 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.282s (SENT)
I20260709 12:23:17.346926  2768 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:17.363919 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 81209.4us
I20260709 12:23:17.367681 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:17.351946  3005 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.368781  2778 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.349011  2959 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:23:17.374922  2876 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.375492 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:17.375690 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:17.376484 31495 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:17.376346 31500 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:17.361704  2637 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.373112 32107 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:17.362665  2871 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:17.367262  2857 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:17.383073 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50105us
I20260709 12:23:17.383800 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:17.365602  2821 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:17.387022 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:17.387621 31500 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:17.388770 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:17.385010  2916 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.368999  3015 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.373759  3005 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.381353  2960 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:17.382740  2857 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.389691  2637 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.392372  2768 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.382778  2968 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.401166  3014 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:17.401468 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44439.3us
I20260709 12:23:17.394171  2857 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.390741  2959 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:17.389864  2821 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:17.393687  2960 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.406701  2959 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:17.411500  2900 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.411645  2959 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.413151  2959 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:17.412586  2871 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.394541  2778 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:23:17.409758 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.409106  2960 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:17.423671 31465 connection.cc:256] RPC call timeout handler was delayed by -1.1232386550000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.336s for a response
I20260709 12:23:17.409258  3009 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:23:17.425835 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.442711 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 700) took 1008 ms. Trace:
W20260709 12:23:17.443076 31465 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.078s (SENT)
I20260709 12:23:17.444579 32106 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:17.443400 31496 rpcz_store.cc:276] 0709 12:23:16.434575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.443617 (+  9042us) service_pool.cc:224] Handling call
0709 12:23:16.459760 (+ 16143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:16.460164 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:16.460494 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 12:23:17.344479 (+883985us) log.cc:844] Serialized 14 byte log entry
0709 12:23:17.344779 (+   300us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:17.345285 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:23:17.348199 (+  2914us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:17.348253 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.348341 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:17.442422 (+ 94081us) raft_consensus.cc:1685] finished
0709 12:23:17.442452 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:17.442621 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30817,"prepare.queue_time_us":573,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":21026,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":20493,"thread_start_us":152499,"threads_started":1,"wal-append.queue_time_us":576322}
I20260709 12:23:17.445669  3010 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:17.445772 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:17.446333 31492 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.409873  2813 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.425194  2900 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:17.427064  2795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.028s	sys 0.043s
I20260709 12:23:17.460063 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:17.465339 31492 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
W20260709 12:23:17.453567  2795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.029s	sys 0.043s
I20260709 12:23:17.470063 32080 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.453114  2900 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.459630  2968 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.426263  2821 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.479768 31416 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:17.476591  2982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.008s	sys 0.005s
I20260709 12:23:17.475136  2900 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.459426  3015 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:23:17.502801  3013 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:17.503402  3013 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:17.504289  3013 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:17.493805  2982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.008s	sys 0.005s
W20260709 12:23:17.523682 31465 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.155s (SENT)
W20260709 12:23:17.526346  3016 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:17.529996  3005 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.532681  2735 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:17.535022 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:17.540967  2797 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:17.541743  3005 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.540783  2960 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.553791 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.550933  2821 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.536235  2917 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:23:17.551811  2797 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:17.610292 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 114599us
W20260709 12:23:17.611320 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 79898.7us
I20260709 12:23:17.592625  2982 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:17.620951 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:17.626852  2960 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.627410  3027 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:17.630187  3027 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:17.631132  3027 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:17.616209  2982 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:17.635514 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 111864us
I20260709 12:23:17.651161 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:17.652868 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:17.653924 32106 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:17.658052  2795 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:17.658474  2795 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:17.659240  2795 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.634852  2982 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.687680 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:17.689024 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:17.689474 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:17.689616 31569 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:17.690079 31565 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.690619 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:17.691167 31570 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.692392 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:17.693150 31568 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:17.698201 31570 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:17.698796 31565 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:17.704840  3034 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:17.705618  3034 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:17.684270 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.683019  2735 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:17.733211  2735 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:17.733716  3024 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:23:17.771004 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 127859us
W20260709 12:23:17.772734 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72827.9us
I20260709 12:23:17.665019  2982 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.772969 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:17.788224 31419 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:17.702543 31320 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:17.785741  2795 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.809824 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.813302 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:17.814036 31495 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:17.815670 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:17.822139 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.823050  3027 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:17.823576  3027 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:17.823861  2946 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:17.823527  2917 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:17.654758  2797 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:17.822271 32105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 818) took 1359 ms (client timeout 1717 ms). Trace:
W20260709 12:23:17.827005 32105 rpcz_store.cc:269] 0709 12:23:16.462472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.462792 (+   320us) service_pool.cc:224] Handling call
0709 12:23:17.822100 (+1359308us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400520154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:17.822219 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777071360}
I20260709 12:23:17.796198  2935 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:17.828928 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 172740us
W20260709 12:23:17.831904 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:17.830265 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57385.9us
W20260709 12:23:17.835649 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.864275 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.865760 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.868649 31421 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:17.825138  2940 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.830482  3033 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:17.876087 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.872454 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:17.880074 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:17.880530 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 56041.5us
I20260709 12:23:17.881547 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.885732 31424 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:17.787220  3034 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:17.891202 31421 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:17.878968  3033 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.899160 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:17.882485  2555 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:17.900074  2555 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.905073 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:17.908071 31424 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:17.910230 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 109620us
I20260709 12:23:17.913192 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:17.835186  2939 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 12:23:17.832355  2968 consensus_queue.cc:1175] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 12:23:17.836107  2935 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:17.936024 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.936800 31420 raft_consensus.cc:2368] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:17.939565 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:17.940367 31416 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 6: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:17.946190  2832 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:17.947098  2832 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:17.949501  2832 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:17.951030  2939 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:17.951233  2555 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.951639  2939 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:17.903044  3033 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.971026 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:17.957376  2857 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:23:17.952147  3040 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:17.984141  3010 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:17.991441  3029 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:23:17.992094  2988 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.992825  2935 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:17.993276  2916 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:17.943073  2946 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.995111  2735 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:17.899073  3027 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:17.974815  3030 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.003s
I20260709 12:23:17.971055  2927 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:18.027364 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112887us
W20260709 12:23:18.028244 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 194474us
I20260709 12:23:18.030701 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.063208 31496 raft_consensus.cc:2368] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:18.064419 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:18.049360 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47446.1us
W20260709 12:23:18.038748  2900 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.002s
I20260709 12:23:18.012542  3010 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:18.067833 31389 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.576s (SENT)
I20260709 12:23:18.068867 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:18.068848  2679 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:18.071220 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.071561 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.075242 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:18.075538 31491 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:18.072017 31495 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:18.073170 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.069104  2935 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.078888  2935 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.061340  2832 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.081269  2935 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.081081  2832 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.071714  2946 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.083206  2832 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.083664  2735 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:18.083956  2946 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.084172  2735 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:18.085104  2735 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.086341  2679 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:18.015012  2857 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.092273  2857 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.066120  2927 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.096616  2927 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.098745  3046 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:23:18.038090  3040 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.104142 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:18.104511  2813 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.098434 31320 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:23:18.109198 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.108820 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.076874  2876 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:18.134941 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:18.136081 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.137467 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.129235 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.141585 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.123613  2946 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.132541  2982 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:18.131101  2917 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.155201 31424 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:18.071528  2900 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:18.149863 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 241236us
I20260709 12:23:18.145428  2940 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:18.178403 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49233.7us
I20260709 12:23:18.180225 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.182664 31424 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:18.146473  2813 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:18.141074  3054 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:23:18.185182 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 117384us
W20260709 12:23:18.188898 31389 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.597s (SENT)
I20260709 12:23:18.189275 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:18.186107  2705 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:18.193850  3034 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:18.194478  2900 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:18.192269  2917 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:18.196125  2917 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:18.196708  2917 consensus_queue.cc:1243] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:18.201542  2555 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:18.201912 31389 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.636s (SENT)
I20260709 12:23:18.203011 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:18.204209  2705 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:18.141110  3033 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:18.205768 31389 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.669s (SENT)
I20260709 12:23:18.208472  3033 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:18.211052 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 149077us
W20260709 12:23:18.212636 31389 leader_election.cc:336] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.783s (SENT)
I20260709 12:23:18.213155 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:18.213512 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.217156  3046 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:18.217206 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.217869  3046 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:18.218122 31566 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
W20260709 12:23:18.202577 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.157258  2876 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:18.223253 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.224983 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.238384 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 265818us
W20260709 12:23:18.204231  3055 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:23:18.241547 31389 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.871s (SENT)
I20260709 12:23:18.182124  3047 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.245263 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.246060 32105 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:18.245713  2876 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.246454  2675 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:18.190932  3054 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.246855  2675 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:18.247224  3054 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:18.247771  2675 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.159919  2946 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.218122  2968 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:18.261904 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:18.265439 31572 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:18.266609  3010 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:18.267975 31389 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.879s (SENT)
I20260709 12:23:18.274396 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:18.268710  2821 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.237810  3005 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.275147 31419 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:23:18.249223  2671 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.301324 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.301496 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.301903 31491 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:18.280252  2675 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.317843 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.288250  2778 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:18.318667 32105 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:18.332845 31573 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:18.337512 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.338338 32110 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:18.298251  2821 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:18.341481 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:18.347380 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.312737  2795 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:18.353061 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 85117.3us
W20260709 12:23:18.353744 31389 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.922s (SENT)
I20260709 12:23:18.299243  3005 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.357242 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.360594  3010 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.361276 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.362087 31497 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 7: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:18.362820 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:18.364673 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.365597 31493 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:18.366137 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.367164 31417 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:18.369071 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.324429  2778 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:18.308374  2671 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.375157 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:18.273859  3046 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.406324 32106 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.423995  3005 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.380911  2778 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:18.432734 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79016.6us
W20260709 12:23:18.434027 31389 leader_election.cc:336] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.997s (SENT)
I20260709 12:23:18.434427 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:18.435544 31389 leader_election.cc:336] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.059s (SENT)
I20260709 12:23:18.435938 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:18.436872 31389 leader_election.cc:336] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.150s (SENT)
I20260709 12:23:18.382244 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.382661 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:18.372711  3047 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.383543 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47694.3us
I20260709 12:23:18.384018  3010 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:18.241329  2871 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Committing config change with OpId 9.8: config changed from index 3 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:18.401029  2797 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:18.404523  2821 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.411720  2946 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.467264  2939 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.467900  2946 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:18.468309  2939 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:18.468369  2946 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.470916  3047 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.473389  2927 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.444708  2795 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:18.465211  3005 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.476841  3005 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.477108  3047 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.465211 31415 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:18.475597  2927 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.480858  3005 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.489423 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:18.490010 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:18.490396 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.490180 31320 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.493990 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:18.494688 31569 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:18.510018 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 317506us
I20260709 12:23:18.437209 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.465900 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.522439 31424 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:18.454770  3040 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.466744 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.528290 31419 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:18.524526 31491 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
W20260709 12:23:18.529667 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 330274us
I20260709 12:23:18.533020  2832 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.537495 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:18.539194 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 102328us
W20260709 12:23:18.540036 31389 leader_election.cc:336] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.620s (SENT)
I20260709 12:23:18.534801 31320 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.470503  2946 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:18.443971  2813 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:18.545363 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.549863 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.552225 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.552400 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.563580 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.563727 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.593705 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.594645 31498 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:18.594359 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.596208 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.599671 31496 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:18.601979 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.606178 31495 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:18.606316 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.555729  3005 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:18.561939 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 424526us
I20260709 12:23:18.615253 31492 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:18.616469 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.616948 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:18.599014  3036 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:23:18.622140 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.627341 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:18.546072  2832 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.634109 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.634411 32106 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:18.549258  3054 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.638842 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:18.638397 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.596884  2821 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:23:18.639789 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 333532us
I20260709 12:23:18.629045  2968 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:23:18.650599 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:18.626485  2946 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:18.651325 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:18.630749  3048 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.657907 32110 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:18.668417 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:18.666841 31567 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.668187 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:18.672241 32105 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:18.675884 31574 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.680703 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.682943 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.661029  3072 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.690183 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:18.674499  3010 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:18.694141 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:18.695304 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:18.697304 31496 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.657203  2982 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:18.674657  3069 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:18.699295 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:18.687867  3049 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.694882  2671 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.668329  2946 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.716774  3010 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:18.766180 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:18.781800 32105 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:18.781358 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:18.716177  3069 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.792603 32109 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:18.792717  3069 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:18.793291  3069 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:18.793669  3069 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:18.793730 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 126892us
I20260709 12:23:18.794056  3069 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:18.794445 31465 leader_election.cc:336] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.077s (SENT)
I20260709 12:23:18.717190  3072 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.823285 31496 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:18.827356 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.753130 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:18.835822 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.836519 31424 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:18.838333 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:18.846393 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 150913us
I20260709 12:23:18.848315 32107 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:18.849231 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.853888 31491 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:18.848335 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.848096 31569 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:18.880323 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:18.882879 31423 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:18.880127 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:18.848754  2675 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 12:23:18.894325 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.893586 31419 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:18.849462  2876 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.737703 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:18.904716 32110 raft_consensus.cc:606] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:18.844946  3073 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:18.903478 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:18.900437 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:18.917807 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:18.919406 31416 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:18.883226  2939 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:18.882534  3014 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:18.895545  2671 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.896006  2832 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:18.904111  3027 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:18.943127 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.954316 31493 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:18.958989 31423 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:18.972896 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.973168 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:18.973742 31570 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:18.974858 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:18.977077 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 182663us
I20260709 12:23:18.982793 31571 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:18.986756 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:18.987053 31465 leader_election.cc:336] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.201s (SENT)
I20260709 12:23:18.986960 31387 leader_election.cc:400] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:18.987721 31387 leader_election.cc:403] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:18.993788 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.998876 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:18.987500 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:19.002526 31387 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:19.004838 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.004702 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:19.007448 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:19.008486 31569 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:18.994518 31568 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:19.019809 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:18.971928  3027 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:18.970438  3073 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:18.970943  3054 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:18.930023  2940 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:23:18.979735  2832 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:19.032624 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55131.6us
I20260709 12:23:18.900462  2982 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:18.940200  2939 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:18.995335  3042 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:18.992267  2821 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:19.068384 32106 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:18.949293  2671 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:19.020152  3078 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.948316  3014 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:19.083458 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:19.116408 31566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.031s
W20260709 12:23:19.063688  3036 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:19.026413  3005 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:19.038442  3040 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:19.031473  3027 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.122080 31568 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:19.122151 31566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.032s
I20260709 12:23:19.122730 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:19.032143  2935 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:19.134440 31565 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:19.073530 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:19.124797 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.134404 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:19.136449 31572 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:18.947383  3010 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:19.137411 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:19.140059 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:19.141680 31423 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:19.150969 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 145080us
I20260709 12:23:19.152616 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:19.069975  2832 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:19.125193  3042 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:19.159947 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 181778us
I20260709 12:23:19.162396 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:19.157984 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:19.158810 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 171764us
I20260709 12:23:19.174031 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:19.166224 31566 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:19.174645 31423 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:19.177650 31567 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.006s
I20260709 12:23:19.178478 31567 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:19.179391 31420 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:23:19.153640  3065 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 12:23:19.181474 31569 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:23:19.185211 31465 leader_election.cc:336] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.657s (SENT)
I20260709 12:23:19.189281 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:19.157645  3076 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 12:23:19.193279 31572 raft_consensus.cc:2410] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:23:19.193624 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:19.154747  2821 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:19.204918 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:19.153996  3049 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:19.208105 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:19.211720 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.492852  3126 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.493539  3126 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:19.173679  2832 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:21.496829 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1690) took 2406 ms (client timeout 1723 ms). Trace:
I20260709 12:23:19.163097  3072 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:19.202332  3081 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:23:21.497423 31566 rpcz_store.cc:269] 0709 12:23:19.090414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.190954 (+100540us) service_pool.cc:224] Handling call
0709 12:23:21.496753 (+2305799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:19.153656  2935 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:23:19.234697  3047 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:19.271360  3082 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
I20260709 12:23:19.162655  2946 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:19.263373  3049 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:19.255220  3071 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:21.499828  3071 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:21.499782  3049 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.502261  3071 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:19.521503  3086 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.471s	user 0.001s	sys 0.000s
I20260709 12:23:19.263151  3058 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.232s
W20260709 12:23:19.529191  2797 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.041s	user 0.012s	sys 0.000s
I20260709 12:23:19.456755  3090 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:19.288517  3098 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.252s
I20260709 12:23:19.238945  3073 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:19.493912  3099 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
W20260709 12:23:19.577531  3093 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:19.520567  3042 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:19.531898  3097 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
W20260709 12:23:19.578764  3079 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
W20260709 12:23:19.574472  2778 consensus_meta.cc:287] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.147s	user 0.015s	sys 0.005s
W20260709 12:23:19.582639  3089 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 12:23:19.582926  3014 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:19.579097  2939 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:19.591620  3069 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.002s
I20260709 12:23:21.513760  3069 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.515805  3069 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:19.580796  2671 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:21.516669 31570 raft_consensus.cc:2368] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
W20260709 12:23:19.655975  2871 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.127s	user 0.012s	sys 0.000s
W20260709 12:23:19.669096  3112 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:23:19.840014  3027 consensus_meta.cc:287] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.002s
W20260709 12:23:19.845547  3085 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:23:20.568785  3010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.003s	sys 0.007s
W20260709 12:23:20.637676  2982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.003s	sys 0.006s
W20260709 12:23:21.242441 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 2.05711e+06us
W20260709 12:23:21.395771 31416 consensus_meta.cc:287] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 2.475s	user 0.021s	sys 0.013s
I20260709 12:23:21.529875 31416 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:21.397433 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2868) took 2629 ms. Trace:
I20260709 12:23:21.416230 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 963) took 2927 ms. Trace:
W20260709 12:23:21.531324 31465 connection.cc:256] RPC call timeout handler was delayed by -2.2338143209999544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 12:23:21.531792 31465 connection.cc:256] RPC call timeout handler was delayed by -2.201414320999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 12:23:21.532269 31465 connection.cc:256] RPC call timeout handler was delayed by -2.1906143209998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 12:23:21.452999 31310 maintenance_manager.cc:419] P 79dd877deb754ad9bbc3b169ee250de3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033426
W20260709 12:23:21.455945 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1691) took 2365 ms (client timeout 1783 ms). Trace:
W20260709 12:23:21.466934 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.345s (SENT) [suppressed 28 similar messages]
I20260709 12:23:21.472163 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 671) took 2283 ms. Trace:
W20260709 12:23:21.478598 31540 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:48852 dropped due to backpressure: service queue is full with 50 items
I20260709 12:23:21.481755  3124 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:21.487150 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.607s	user 0.010s	sys 0.053s
I20260709 12:23:21.490538  3053 raft_consensus.cc:993] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:21.496825  3126 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:21.498517 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2704) took 2501 ms (client timeout 1928 ms). Trace:
W20260709 12:23:21.547952 31566 rpcz_store.cc:269] 0709 12:23:18.996952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.498335 (+2501383us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.498443 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.549067 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1679) took 2530 ms (client timeout 1937 ms). Trace:
W20260709 12:23:21.549489 31566 rpcz_store.cc:269] 0709 12:23:19.019014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.548829 (+2529815us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.548998 (+   169us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:23:21.503283  3090 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:19.570744  3084 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.431s	user 0.001s	sys 0.000s
I20260709 12:23:21.508409  2778 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.553431  3090 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:21.553568  2778 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:21.453289 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.273s	user 0.017s	sys 0.046s
I20260709 12:23:21.530781 31418 rpcz_store.cc:276] 0709 12:23:18.768382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.779800 (+ 11418us) service_pool.cc:224] Handling call
0709 12:23:18.845241 (+ 65441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:18.851914 (+  6673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.851945 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:18.895055 (+ 43110us) log.cc:844] Serialized 52 byte log entry
0709 12:23:19.081814 (+186759us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:19.082063 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.082206 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.397142 (+2314936us) raft_consensus.cc:1685] finished
0709 12:23:21.397167 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.397347 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6278,"raft.queue_time_us":6541,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":38818,"thread_start_us":149630,"threads_started":1,"wal-append.queue_time_us":622497,"wal-append.run_cpu_time_us":2904,"wal-append.run_wall_time_us":1123747}
I20260709 12:23:21.554195  3124 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.556432  3124 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:21.527567  3010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.872s	user 0.003s	sys 0.007s
I20260709 12:23:21.559563  3053 raft_consensus.cc:1081] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
W20260709 12:23:21.560520 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.708s	user 0.011s	sys 0.054s
W20260709 12:23:21.560871 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 2.70864e+06us
I20260709 12:23:21.531494 31571 rpcz_store.cc:276] 0709 12:23:18.488511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.497849 (+  9338us) service_pool.cc:224] Handling call
0709 12:23:18.982371 (+484522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.983275 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.416016 (+2432741us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002616d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:21.416168 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113587584}
I20260709 12:23:21.535434 31420 rpcz_store.cc:276] 0709 12:23:19.188369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.471378 (+2283009us) service_pool.cc:224] Handling call
0709 12:23:21.471669 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.471843 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.471869 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.471908 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.471955 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.472006 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.472109 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:21.563956 31537 connection.cc:256] RPC call timeout handler was delayed by -1.032143134999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 12:23:21.545352 31416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2877) took 2636 ms (client timeout 1679 ms). Trace:
W20260709 12:23:21.543565 31569 rpcz_store.cc:269] 0709 12:23:19.101398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.455692 (+2354294us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.455829 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.565868 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1685) took 2477 ms (client timeout 1922 ms). Trace:
W20260709 12:23:21.566305 31569 rpcz_store.cc:269] 0709 12:23:19.088877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.565655 (+2476778us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.565795 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.567245 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1681) took 2539 ms (client timeout 1997 ms). Trace:
W20260709 12:23:21.550524 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1689) took 2460 ms (client timeout 1871 ms). Trace:
W20260709 12:23:21.534823  2982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.003s	sys 0.006s
W20260709 12:23:21.564841 31416 rpcz_store.cc:269] 0709 12:23:18.894620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.894771 (+   151us) service_pool.cc:224] Handling call
0709 12:23:21.530505 (+2635734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.544315 31540 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:48852 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1681)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1683)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1692)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2684)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 971)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 972)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1704)
W20260709 12:23:21.567628 31569 rpcz_store.cc:269] 0709 12:23:19.049223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.567066 (+2517843us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.567188 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.568544 31566 rpcz_store.cc:269] 0709 12:23:19.090117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.550321 (+2460204us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.550458 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.570465 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.390s	user 0.018s	sys 0.047s
W20260709 12:23:21.570850 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 2.39008e+06us
W20260709 12:23:21.571130 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1683) took 2483 ms (client timeout 2059 ms). Trace:
W20260709 12:23:21.572479 31569 rpcz_store.cc:269] 0709 12:23:19.088244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.570929 (+2482685us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.571062 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.573516 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1684) took 2485 ms (client timeout 2150 ms). Trace:
W20260709 12:23:21.573994 31569 rpcz_store.cc:269] 0709 12:23:19.088571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.573324 (+2484753us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.573452 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.571570 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1692) took 2384 ms (client timeout 1967 ms). Trace:
W20260709 12:23:21.574858 31566 rpcz_store.cc:269] 0709 12:23:19.187836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.571389 (+2383553us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.571503 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:23:21.528501  3027 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.582509  3027 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:21.586974 31571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2698) took 2741 ms (client timeout 2234 ms). Trace:
W20260709 12:23:21.587154 31415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.608s	user 0.028s	sys 0.037s
W20260709 12:23:21.587402 31571 rpcz_store.cc:269] 0709 12:23:18.845922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.586766 (+2740844us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.586903 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:23:21.588465 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.589339 31571 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
W20260709 12:23:21.589773 31571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1678) took 2571 ms (client timeout 2836 ms). Trace:
W20260709 12:23:21.590174 31571 rpcz_store.cc:269] 0709 12:23:19.018722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.588148 (+2569426us) service_pool.cc:224] Handling call
0709 12:23:21.589713 (+  1565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.569208  3090 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.592940  3069 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:21.594871 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.622365 31566 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
W20260709 12:23:21.622896 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2690) took 2944 ms (client timeout 3107 ms). Trace:
I20260709 12:23:21.600019 31540 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48852 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2688)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1695)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 971)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 972)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1713)
W20260709 12:23:21.623231 31566 rpcz_store.cc:269] 0709 12:23:18.678648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.594510 (+2915862us) service_pool.cc:224] Handling call
0709 12:23:21.622821 (+ 28311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.596758  3044 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:21.597458  3010 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:21.645330  3044 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.646272  3010 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.648500  3010 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:21.598080  2675 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.649144  2675 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.651813  2675 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:21.598445 32080 connection.cc:256] RPC call timeout handler was delayed by -1.4452904240001772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:23:21.652352 32080 connection.cc:256] RPC call timeout handler was delayed by -1.0023792490001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 12:23:21.654323 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:21.599211  2832 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:21.655710 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 122922us
I20260709 12:23:21.656697  2832 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:21.657553 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:21.658108 32109 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:21.662043  3044 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:21.662974 31567 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:21.599643  3053 raft_consensus.cc:670] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } [suppressed 2 similar messages]
W20260709 12:23:21.610647 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2684) took 2968 ms (client timeout 2791 ms). Trace:
W20260709 12:23:21.664261 31569 rpcz_store.cc:269] 0709 12:23:18.641938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.610329 (+2968391us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:21.610545 (+   216us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:21.621510 31415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.643s	user 0.029s	sys 0.038s
I20260709 12:23:21.665768 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2867) took 2898 ms. Trace:
I20260709 12:23:21.666137  3124 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:21.666189 31415 rpcz_store.cc:276] 0709 12:23:18.767880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.768046 (+   166us) service_pool.cc:224] Handling call
0709 12:23:18.827699 (+ 59653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.852588 (+ 24889us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:18.852634 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.893444 (+ 40810us) log.cc:844] Serialized 26 byte log entry
0709 12:23:21.445931 (+2552487us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b48000030d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:23:21.665254 (+219323us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:21.665313 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.665402 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.665458 (+    56us) raft_consensus.cc:1685] finished
0709 12:23:21.665475 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.665703 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5476,"raft.queue_time_us":5595,"raft.run_cpu_time_us":16323,"raft.run_wall_time_us":2587455,"spinlock_wait_cycles":14335744,"thread_start_us":2686472,"threads_started":1,"wal-append.queue_time_us":723833,"wal-append.run_cpu_time_us":1720,"wal-append.run_wall_time_us":1001781}
I20260709 12:23:21.670850 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:21.673480 32109 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:21.674615 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:21.675433  2832 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:21.675899  2832 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:21.676764  2832 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.680510 32105 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
W20260709 12:23:21.622910 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 156003us
I20260709 12:23:21.680951 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:21.681236 31389 connection.cc:256] RPC call timeout handler was delayed by -2.6725214419998338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3332s for a response
I20260709 12:23:21.681840 31566 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:23:21.682245 31566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2688) took 3015 ms (client timeout 3354 ms). Trace:
W20260709 12:23:21.682579 31566 rpcz_store.cc:269] 0709 12:23:18.666450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.623887 (+2957437us) service_pool.cc:224] Handling call
0709 12:23:21.682190 (+ 58303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.683915 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:21.686074  3010 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.689664 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.690263 31566 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:21.689873  3010 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.691264 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.691810 31566 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:21.692548 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.686393  2675 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.688772  2946 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:21.622573  3090 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.625564  3069 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.726910  3090 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:21.728314 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.512s	user 0.015s	sys 0.047s
W20260709 12:23:21.728766 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.512s	user 0.016s	sys 0.048s
W20260709 12:23:21.729683 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.729377 31540 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48852 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1702)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1712)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1696)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1699)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1701)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 967)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2682)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 968)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 969)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2703)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2705)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2706)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1675)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1677)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 970)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 971)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 972)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 974)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1704)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1713)
W20260709 12:23:21.746984 31565 consensus_meta.cc:287] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 2.602s	user 0.016s	sys 0.032s
I20260709 12:23:21.747567 31565 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:21.748226 31565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2702) took 2777 ms (client timeout 1785 ms). Trace:
I20260709 12:23:21.755626 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:21.759862 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 910) took 3519 ms. Trace:
I20260709 12:23:21.760344 32108 rpcz_store.cc:276] 0709 12:23:18.240106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.240245 (+   139us) service_pool.cc:224] Handling call
0709 12:23:18.252070 (+ 11825us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:18.361295 (+109225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.361328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:18.361856 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 12:23:18.702496 (+340640us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:18.702532 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.702624 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:21.759564 (+3056940us) raft_consensus.cc:1685] finished
0709 12:23:21.759589 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.759763 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104889,"raft.queue_time_us":109922,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10595,"thread_start_us":340227,"threads_started":1,"wal-append.queue_time_us":415358}
W20260709 12:23:21.748997 31565 rpcz_store.cc:269] 0709 12:23:18.970729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.056848 (+ 86119us) service_pool.cc:224] Handling call
0709 12:23:21.748140 (+2691292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.764891  3129 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.765453  3129 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:21.767369 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:21.767617  3129 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:21.772037 31566 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:21.772881 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.773433 31566 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:21.774183 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.774726 31566 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:21.775465 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.775990 31566 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:21.776737 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.777205 31566 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 5.
W20260709 12:23:21.780198 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.783670 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:21.764916 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.787575 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 730) took 3002 ms. Trace:
W20260709 12:23:21.787830 31465 connection.cc:256] RPC call timeout handler was delayed by -1.5867071339998802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4143s for a response
I20260709 12:23:21.788025 31565 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:21.789501 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.790066 31565 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:21.787593 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 734) took 2621 ms. Trace:
I20260709 12:23:21.791148 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.791988 31565 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:21.790969 31494 rpcz_store.cc:276] 0709 12:23:19.166349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.166489 (+   140us) service_pool.cc:224] Handling call
0709 12:23:19.197108 (+ 30619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:19.197362 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:21.388629 (+2191267us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.787274 (+398645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.787322 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.787366 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.787429 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.787539 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397855,"prepare.queue_time_us":2190790,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":397790,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":665,"threads_started":1,"wal-append.queue_time_us":1358}
I20260709 12:23:21.788116 31497 rpcz_store.cc:276] 0709 12:23:18.785527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.792963 (+  7436us) service_pool.cc:224] Handling call
0709 12:23:18.793239 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.793408 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:19.039073 (+245665us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.787098 (+2748025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.787172 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.787240 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.787329 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.787473 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2567779,"prepare.queue_time_us":277676,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":2567972,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":419125,"threads_started":2,"wal-append.queue_time_us":530197}
W20260709 12:23:21.800665 31491 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.871s	user 0.046s	sys 0.037s
W20260709 12:23:21.801154 31491 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.871s	user 0.046s	sys 0.037s
I20260709 12:23:21.802889 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.803669 31566 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:21.825311  3069 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:21.827126 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.827999 31565 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:21.829181 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.830717 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.831422 31565 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:21.832398 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.833074 31565 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:23:21.841102 31574 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 3.165s	user 0.021s	sys 0.006s
I20260709 12:23:21.842489  2946 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:21.844090 31574 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:21.844208 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63398.4us
I20260709 12:23:21.845319  2946 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:21.850190 31422 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1658) took 3500 ms (client timeout 1859 ms). Trace:
I20260709 12:23:21.843842 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.846592 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:21.854188 31566 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:21.854274 31574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2685) took 3212 ms (client timeout 2091 ms). Trace:
W20260709 12:23:21.850641 31422 rpcz_store.cc:269] 0709 12:23:18.350082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.350201 (+   119us) service_pool.cc:224] Handling call
0709 12:23:21.849959 (+3499758us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b540010bb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:21.850116 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8015034752}
I20260709 12:23:21.834036 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:21.855978 31574 rpcz_store.cc:269] 0709 12:23:18.642256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.655255 (+ 12999us) service_pool.cc:224] Handling call
0709 12:23:21.844868 (+3189613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.856530 31565 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 7: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:21.857656 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.857921 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.860173 31566 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:21.860529 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.861105 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.871941 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 667) took 2729 ms. Trace:
I20260709 12:23:21.886778 31565 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:21.861361 31574 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:21.886529 31419 rpcz_store.cc:276] 0709 12:23:19.142139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.188629 (+ 46490us) service_pool.cc:224] Handling call
0709 12:23:21.871426 (+2682797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.871610 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.871636 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.871680 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.871712 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.871766 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.871871 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.888952 31566 raft_consensus.cc:2368] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:21.889074 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.891707 31565 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:21.917096 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.918040 31574 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:23:21.926122 31496 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.019s	user 0.024s	sys 0.040s
W20260709 12:23:21.926752 31496 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.019s	user 0.025s	sys 0.040s
I20260709 12:23:21.931980 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2872) took 3148 ms. Trace:
I20260709 12:23:21.932492 31417 rpcz_store.cc:276] 0709 12:23:18.784004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.787433 (+  3429us) service_pool.cc:224] Handling call
0709 12:23:18.787765 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.787984 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:19.039993 (+252009us) log.cc:844] Serialized 14 byte log entry
0709 12:23:19.204580 (+164587us) log.cc:844] Serialized 14 byte log entry
0709 12:23:19.216203 (+ 11623us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.556513 (+2340310us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18001e80e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1
0709 12:23:21.931415 (+374902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.931485 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.931545 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.931637 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.931876 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2773922,"prepare.queue_time_us":2472447,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":98,"raft.queue_time_us":95,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6199,"spinlock_wait_cycles":37942912,"thread_start_us":310231,"threads_started":2,"wal-append.queue_time_us":484011,"wal-append.run_cpu_time_us":2492,"wal-append.run_wall_time_us":1059741}
I20260709 12:23:21.935828 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.936733 31566 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:21.938057 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.939008 31565 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:21.940966 31574 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:21.941699 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.942203 31574 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:21.944691 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.945763 31565 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:21.945976 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.946527 31574 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:21.946879 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:21.947551 31565 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.953751 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 669) took 2776 ms. Trace:
I20260709 12:23:21.955374 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.956022 31574 raft_consensus.cc:2368] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:21.954313 31421 rpcz_store.cc:276] 0709 12:23:19.177710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.181298 (+  3588us) service_pool.cc:224] Handling call
0709 12:23:21.517113 (+2335815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.517310 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:21.625211 (+107901us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.953463 (+328252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.953516 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:21.953556 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.953620 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.953707 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240903,"prepare.queue_time_us":39382,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":191052,"threads_started":3,"wal-append.queue_time_us":91161}
I20260709 12:23:21.957257 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.959977 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:21.960950 31574 raft_consensus.cc:2368] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:21.962469 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 967) took 3327 ms. Trace:
I20260709 12:23:21.963006 31574 rpcz_store.cc:276] 0709 12:23:18.635193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.961548 (+3326355us) service_pool.cc:224] Handling call
0709 12:23:21.961826 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.962003 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.962030 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.962071 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:21.962102 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.962153 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.962411 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.965298 31574 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:21.965898 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2682) took 3330 ms. Trace:
I20260709 12:23:21.966302 31574 rpcz_store.cc:276] 0709 12:23:18.635813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.964696 (+3328883us) service_pool.cc:224] Handling call
0709 12:23:21.964993 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.965677 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.965851 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.967888 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 968) took 3305 ms. Trace:
I20260709 12:23:21.968242 31574 rpcz_store.cc:276] 0709 12:23:18.662230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.967102 (+3304872us) service_pool.cc:224] Handling call
0709 12:23:21.967406 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.967574 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.967600 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.967639 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:21.967667 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.967730 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.967833 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:21.970072 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 969) took 3297 ms. Trace:
I20260709 12:23:21.977211 31565 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:21.979413 31320 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 4 to 6, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 6 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:21.981307 31320 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 5 to 7, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:21.991441 31567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1682) took 2929 ms (client timeout 1783 ms). Trace:
W20260709 12:23:21.991864 31567 rpcz_store.cc:269] 0709 12:23:19.062296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.211315 (+149019us) service_pool.cc:224] Handling call
0709 12:23:21.991223 (+2779908us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002a26d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:21.991357 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391577856}
W20260709 12:23:21.993242 31318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 275) took 13699 ms (client timeout 15000 ms). Trace:
I20260709 12:23:21.995164  2940 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.006196  2940 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:21.996290  2876 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.009115  2876 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.011269  2876 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:21.997404  2916 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.011946  2916 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.014114  2916 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.002260 32106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:22.014745 32106 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:23:22.015085 32106 raft_consensus.cc:614] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:22.004529  3049 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.017038  3049 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.019233  3049 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.020774 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:22.008359  2940 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.022594 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:22.023157 31566 raft_consensus.cc:2376] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9. Re-sending same reply.
I20260709 12:23:22.023537 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.024343 31566 pending_rounds.cc:85] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:23:22.024652 31566 pending_rounds.cc:107] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:23:22.024973 31566 raft_consensus.cc:2889] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:22.028877  2671 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.029371  2671 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:22.031679 31568 consensus_meta.cc:287] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 2.872s	user 0.046s	sys 0.042s
I20260709 12:23:22.032058 31568 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:22.032577 31568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2707) took 3034 ms (client timeout 1679 ms). Trace:
I20260709 12:23:22.032980  2797 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:22.032912 31568 rpcz_store.cc:269] 0709 12:23:18.997703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.029665 (+ 31962us) service_pool.cc:224] Handling call
0709 12:23:22.032499 (+3002834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.033586  2797 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.004930 31320 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.706418  2675 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.036895 31320 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 2 to 5, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:21.970759 31574 rpcz_store.cc:276] 0709 12:23:18.672243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.969292 (+3297049us) service_pool.cc:224] Handling call
0709 12:23:21.969572 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:21.969733 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:21.969779 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:21.969823 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:21.969861 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:21.969922 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:21.970023 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.040783 31574 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.040989  2797 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:22.024722 31318 rpcz_store.cc:269] 0709 12:23:08.297750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.297903 (+   153us) service_pool.cc:224] Handling call
0709 12:23:21.993038 (+13695135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:11.678348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:11.734034 (+ 55686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:11.740735 (+  6701us) write_op.cc:435] Acquired schema lock
0709 12:23:11.749263 (+  8528us) tablet.cc:662] Decoding operations
0709 12:23:11.869462 (+120199us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:11.869548 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:11.869574 (+    26us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:23:12.151837 (+282263us) tablet.cc:701] Row locks acquired
0709 12:23:12.155057 (+  3220us) write_op.cc:260] PREPARE: finished
0709 12:23:12.180242 (+ 25185us) write_op.cc:270] Start()
0709 12:23:12.275689 (+ 95447us) write_op.cc:276] Timestamp: P: 1783599792180170 usec, L: 0
0709 12:23:12.278702 (+  3013us) op_driver.cc:348] REPLICATION: starting
0709 12:23:12.517824 (+239122us) log.cc:844] Serialized 8727 byte log entry
0709 12:23:13.894864 (+1377040us) op_driver.cc:464] REPLICATION: finished
0709 12:23:14.567467 (+672603us) write_op.cc:301] APPLY: starting
0709 12:23:14.567617 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:14.690467 (+122850us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:14.690605 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:15.739452 (+1048847us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b180032f380. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f955331 00007fc11f955221 00007fc11f94ff6c 00007fc11d0b030b
0709 12:23:15.741427 (+  1975us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5c0028fd0c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f955331 00007fc11f955221 00007fc11f94ff6c 00007fc11d0b030b 00007fc11d0affd3 00007fc11d1aee34 00007fc11d19a97c 00007fc11d19ed61 00007fc11d19ed19 00007fc11d19eca9 00007fc11d19ec71
0709 12:23:15.790166 (+ 48739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:15.934742 (+144576us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:23:15.934819 (+    77us) write_op.cc:312] APPLY: finished
0709 12:23:15.935530 (+   711us) log.cc:844] Serialized 152 byte log entry
0709 12:23:16.027668 (+ 92138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:16.135683 (+108015us) write_op.cc:454] Released schema lock
0709 12:23:16.135775 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:16.136447 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:16.136488 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13366,"reported_tablets":49,"spinlock_wait_cycles":30976,"child_traces":[["op",{"apply.queue_time_us":663702,"apply.run_cpu_time_us":30774,"apply.run_wall_time_us":1568942,"num_ops":22,"prepare.queue_time_us":711485,"prepare.run_cpu_time_us":30263,"prepare.run_wall_time_us":1021939,"raft.queue_time_us":502515,"raft.run_cpu_time_us":49546,"raft.run_wall_time_us":451956,"replication_time_us":1615995,"spinlock_wait_cycles":6461056,"thread_start_us":1574398,"threads_started":5,"wal-append.queue_time_us":480748,"wal-append.run_cpu_time_us":56218,"wal-append.run_wall_time_us":2901527}]]}
I20260709 12:23:22.042309  2675 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:22.041222 31574 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:22.024643 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.044909 31574 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.043956  2671 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.051851 31574 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:22.053730 31570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2691) took 3365 ms (client timeout 1657 ms). Trace:
W20260709 12:23:22.064250 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2695) took 3341 ms (client timeout 2133 ms). Trace:
W20260709 12:23:22.125721 31572 rpcz_store.cc:269] 0709 12:23:18.723327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.062668 (+3339341us) service_pool.cc:211] Skipping call since client already timed out
0709 12:23:22.064182 (+  1514us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:23:22.125669 31570 rpcz_store.cc:269] 0709 12:23:18.688353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.974559 (+286206us) service_pool.cc:224] Handling call
0709 12:23:22.053479 (+3078920us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001a6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:22.053646 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5844019456}
I20260709 12:23:22.127404 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:22.128002 31572 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:22.065493 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.896s	user 0.000s	sys 0.049s
I20260709 12:23:22.073822  3069 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:22.130856 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.961s	user 0.000s	sys 0.050s
I20260709 12:23:22.131150  3069 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.074940  3071 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.068503 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 965) took 3579 ms. Trace:
I20260709 12:23:22.134383  3071 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.075416  3108 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.134832 31573 rpcz_store.cc:276] 0709 12:23:18.489055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.491267 (+  2212us) service_pool.cc:224] Handling call
0709 12:23:18.491527 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.491818 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.491847 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.492309 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:23:18.895986 (+403677us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:18.898139 (+  2153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.898207 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.068285 (+3170078us) raft_consensus.cc:1685] finished
0709 12:23:22.068308 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.068446 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57873,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4861,"thread_start_us":402740,"threads_started":1,"wal-append.queue_time_us":743515}
I20260709 12:23:22.135607  3108 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.136840 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:22.137446 31573 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:22.138255  3108 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:22.084420 31498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.102s	user 0.017s	sys 0.033s
W20260709 12:23:22.085737 31423 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 2.910s	user 0.026s	sys 0.063s
W20260709 12:23:22.142513 31498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.160s	user 0.018s	sys 0.034s
I20260709 12:23:22.142697 31423 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
W20260709 12:23:22.143217 31423 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 668) took 3000 ms (client timeout 2090 ms). Trace:
I20260709 12:23:22.085980 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:22.143514 31423 rpcz_store.cc:269] 0709 12:23:19.142372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.155830 (+ 13458us) service_pool.cc:224] Handling call
0709 12:23:22.143155 (+2987325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.144189 31569 raft_consensus.cc:2410] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:23:22.144685 31569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2686) took 3492 ms (client timeout 4143 ms). Trace:
I20260709 12:23:22.144928 31572 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:22.145162 31569 rpcz_store.cc:269] 0709 12:23:18.652368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.085721 (+3433353us) service_pool.cc:224] Handling call
0709 12:23:22.144619 (+ 58898us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:22.088056 31463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.057s	user 0.061s	sys 0.056s
W20260709 12:23:22.146471 31463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.115s	user 0.061s	sys 0.056s
I20260709 12:23:22.146574 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2703) took 3150 ms. Trace:
I20260709 12:23:21.692616  3010 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:22.150498 32110 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:23:22.121071 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9856026309998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:23:22.121590  3098 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.121685  3147 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.120622  3090 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.127357 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:22.075940  3091 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.078858  3124 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:22.139355 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:22.176836 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:22.138654 31573 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:23:22.178470 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2706) took 3181 ms. Trace:
I20260709 12:23:22.153213 31574 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:22.178947 31573 rpcz_store.cc:276] 0709 12:23:18.997462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.138084 (+3140622us) service_pool.cc:224] Handling call
0709 12:23:22.138368 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.178176 (+ 39808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.178409 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.141443 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.141733 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.148226 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2701) took 3221 ms. Trace:
I20260709 12:23:22.147121 31568 rpcz_store.cc:276] 0709 12:23:18.996636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.033754 (+3037118us) service_pool.cc:224] Handling call
0709 12:23:22.034125 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.080264 (+ 46139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.080294 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.080667 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.125414 (+ 44747us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:22.125457 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.125521 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.125561 (+    40us) raft_consensus.cc:1685] finished
0709 12:23:22.125571 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.146501 (+ 20930us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45784,"raft.queue_time_us":46963,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"thread_start_us":44393,"threads_started":1,"wal-append.queue_time_us":41356}
I20260709 12:23:22.143524 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1716) took 3348 ms. Trace:
I20260709 12:23:22.166235 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:22.166718 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:22.174517 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9856026309998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:23:22.184531 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9343026309998095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 12:23:22.179986 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2705) took 3182 ms. Trace:
W20260709 12:23:22.185065 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9343026309998095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:23:22.185563 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9109026309997716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:23:22.185374 31574 rpcz_store.cc:276] 0709 12:23:18.997205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.040285 (+3043080us) service_pool.cc:224] Handling call
0709 12:23:22.040623 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.179687 (+139064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.179919 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:22.186157 31540 connection.cc:256] RPC call timeout handler was delayed by -2.9109026309997716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:23:22.188895 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.189790 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1675) took 3191 ms. Trace:
I20260709 12:23:22.190286 31569 rpcz_store.cc:276] 0709 12:23:18.997936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.145969 (+3148033us) service_pool.cc:224] Handling call
0709 12:23:22.146257 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.189349 (+ 43092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.189392 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.189447 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:22.189512 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.189585 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.189722 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.196333  3010 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:22.197074  3010 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:22.187678  3091 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:22.201572  3091 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.202873  2821 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:22.203109  3091 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.204290  2821 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.187441 32110 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:22.187963 31571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2697) took 3406 ms (client timeout 3390 ms). Trace:
I20260709 12:23:22.181629 31566 rpcz_store.cc:276] 0709 12:23:18.927336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.023764 (+3096428us) service_pool.cc:224] Handling call
0709 12:23:22.024112 (+   348us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:22.079185 (+ 55073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.079214 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:22.079751 (+   537us) log.cc:844] Serialized 78 byte log entry
0709 12:23:22.096628 (+ 16877us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:22.133979 (+ 37351us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.137373 (+  3394us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.138164 (+   791us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.138793 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.148013 (+  9220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.148053 (+    40us) raft_consensus.cc:1685] finished
0709 12:23:22.148065 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.148177 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56646,"prepare.queue_time_us":59119,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":61484,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":279,"thread_start_us":53530,"threads_started":2,"wal-append.queue_time_us":16878}
I20260709 12:23:22.207077 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.217587 32105 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:22.198211  3010 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.223475 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 972) took 3069 ms. Trace:
I20260709 12:23:22.224042 31568 rpcz_store.cc:276] 0709 12:23:19.154237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.182006 (+3027769us) service_pool.cc:224] Handling call
0709 12:23:22.222813 (+ 40807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.223041 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.223080 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.223138 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:22.223183 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.223254 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.223401 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.225167 31570 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:23:22.225571 31570 pending_rounds.cc:85] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 8
I20260709 12:23:22.225869 31570 pending_rounds.cc:107] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:22.226155 31570 raft_consensus.cc:2889] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:22.227172 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 970) took 3090 ms. Trace:
I20260709 12:23:22.227602 31570 rpcz_store.cc:276] 0709 12:23:19.136354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.176107 (+3039753us) service_pool.cc:224] Handling call
0709 12:23:22.176514 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.226845 (+ 50331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.227090 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.228055 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 732) took 3369 ms. Trace:
W20260709 12:23:22.228926 31465 connection.cc:256] RPC call timeout handler was delayed by -1.3140143209998314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31070000000000003s for a response
W20260709 12:23:22.229467 31465 connection.cc:256] RPC call timeout handler was delayed by -1.2600349029999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:23:22.229853 31465 connection.cc:256] RPC call timeout handler was delayed by -1.1313349029996971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:23:22.230223 31465 connection.cc:256] RPC call timeout handler was delayed by -1.0917143209999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33540000000000003s for a response
W20260709 12:23:22.230777 31465 connection.cc:256] RPC call timeout handler was delayed by -1.0323170289993868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:23:22.231104  2916 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.231587  2916 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.232877  3114 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.233503 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.233387  3114 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.234133 31493 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:22.234469  2940 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.235158 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.235010  2940 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.235823  3114 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.236340 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.236557  3114 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.237193  3027 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.237059  3114 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.237344  3034 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.237727  3027 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.228490 31491 rpcz_store.cc:276] 0709 12:23:18.858963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.896690 (+ 37727us) service_pool.cc:224] Handling call
0709 12:23:18.896987 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.897177 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:21.801610 (+2904433us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.227750 (+426140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.227799 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:22.227847 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.227906 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.228003 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2573765,"prepare.queue_time_us":238885,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":376791,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":2923642,"threads_started":2,"wal-append.queue_time_us":60097}
I20260709 12:23:22.238891 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.239001 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:22.239291 31466 connection.cc:256] RPC call timeout handler was delayed by -1.8895730360000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:23:22.239523 31497 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
W20260709 12:23:22.239758 31466 connection.cc:256] RPC call timeout handler was delayed by -1.7608730359997935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:23:22.240129 31466 connection.cc:256] RPC call timeout handler was delayed by -1.7404823729998498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 12:23:22.240397 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.240658  3047 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.241199  3047 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.241503 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.242815 31500 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:22.242971 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.243211  3040 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.235790 31493 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:22.243680  3040 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.245098 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 731) took 3398 ms. Trace:
I20260709 12:23:22.245720  3040 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.246238  3040 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.235956  2876 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.247864  3078 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:22.248011 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.248235  3054 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.248623  2795 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.248736  3054 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.249161  2795 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.237059  2940 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.250325  2940 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:22.233723  2916 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.239758  3027 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.249477  3047 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.251434 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1714) took 3456 ms. Trace:
I20260709 12:23:22.265213 31496 rpcz_store.cc:276] 0709 12:23:18.794731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.857837 (+ 63106us) service_pool.cc:224] Handling call
0709 12:23:18.858485 (+   648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.882995 (+ 24510us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:21.927228 (+3044233us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.229119 (+301891us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.229552 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.229691 (+   139us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:22.229726 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.229791 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.251232 (+ 21441us) raft_consensus.cc:1685] finished
0709 12:23:22.251250 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.251371 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":283641,"prepare.queue_time_us":241771,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":7199,"raft.queue_time_us":299596,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6400,"thread_start_us":3037312,"threads_started":2,"wal-append.queue_time_us":29425}
I20260709 12:23:22.237946  3034 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.230290 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 724) took 3540 ms. Trace:
I20260709 12:23:22.268942 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2700) took 3364 ms. Trace:
I20260709 12:23:22.269528 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 971) took 3127 ms. Trace:
I20260709 12:23:22.270087 31573 rpcz_store.cc:276] 0709 12:23:19.142575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.180230 (+3037655us) service_pool.cc:224] Handling call
0709 12:23:22.268921 (+ 88691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.269119 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.269142 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.269181 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:22.269222 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.269305 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.269455 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.269392 31567 rpcz_store.cc:276] 0709 12:23:18.904758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.992656 (+3087898us) service_pool.cc:224] Handling call
0709 12:23:21.992968 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.077935 (+ 84967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.077965 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.078373 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.254103 (+175730us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:22.263329 (+  9226us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.268629 (+  5300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.268699 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.268737 (+    38us) raft_consensus.cc:1685] finished
0709 12:23:22.268748 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.268853 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89669,"raft.queue_time_us":85616,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":175402,"threads_started":1,"wal-append.queue_time_us":56658}
I20260709 12:23:22.182242 31498 rpcz_store.cc:276] 0709 12:23:18.795277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.858469 (+ 63192us) service_pool.cc:224] Handling call
0709 12:23:18.896511 (+ 38042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:18.896830 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:18.896857 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:18.919591 (+ 22734us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.143118 (+3223527us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:22.143173 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.143259 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.143311 (+    52us) raft_consensus.cc:1685] finished
0709 12:23:22.143328 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.143463 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":421,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2755,"thread_start_us":3160505,"threads_started":1,"wal-append.queue_time_us":644475,"wal-append.run_cpu_time_us":1811,"wal-append.run_wall_time_us":1001846}
W20260709 12:23:22.273474 31571 rpcz_store.cc:269] 0709 12:23:18.781438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.165858 (+3384420us) service_pool.cc:224] Handling call
0709 12:23:22.187869 (+ 22011us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:22.258769 31540 connection.cc:256] RPC call timeout handler was delayed by -2.8146026309996159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:23:22.259591 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.275238 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.275858 31494 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:22.277117 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.277498 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1677) took 3279 ms. Trace:
I20260709 12:23:22.245446 31500 rpcz_store.cc:276] 0709 12:23:18.846531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.849027 (+  2496us) service_pool.cc:224] Handling call
0709 12:23:22.242468 (+3393441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.243179 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.244929 (+  1750us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b540007f8d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:22.245046 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7803690752}
I20260709 12:23:22.247486  2876 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.250828  2857 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.263628 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.250819  2940 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.264129  3144 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.264299  3062 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.280895 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:22.237380 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.239523 31491 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.285578 31424 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:22.285416 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:22.267694 31495 rpcz_store.cc:276] 0709 12:23:18.690102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.695420 (+  5318us) service_pool.cc:224] Handling call
0709 12:23:18.695750 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.695982 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:18.852243 (+156261us) log.cc:844] Serialized 14 byte log entry
0709 12:23:21.989193 (+3136950us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180039baa0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a
0709 12:23:22.229981 (+240788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.230030 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:22.230071 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.230127 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.230238 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240575,"prepare.queue_time_us":250462,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":244972,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":43451136,"thread_start_us":280771,"threads_started":2,"wal-append.queue_time_us":363303}
W20260709 12:23:22.278935 31540 connection.cc:256] RPC call timeout handler was delayed by -2.7831026310000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:23:22.142484  3069 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.280854 32108 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:22.281384 31416 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:22.281772  3098 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.278218 31572 rpcz_store.cc:276] 0709 12:23:19.018297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.148075 (+3129778us) service_pool.cc:224] Handling call
0709 12:23:22.212383 (+ 64308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.274772 (+ 62389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.274801 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.274864 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:22.277160 (+  2296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.277254 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.277427 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:22.285998 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:22.290633 31415 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:23:22.296778 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.282604 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:22.250967  3049 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:22.277961  2797 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.292227 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:22.290441 31540 connection.cc:256] RPC call timeout handler was delayed by -2.7831026310000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:23:22.304738 31540 connection.cc:256] RPC call timeout handler was delayed by -2.7111026309999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 12:23:22.305078 31540 connection.cc:256] RPC call timeout handler was delayed by -2.7111026309999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 12:23:22.305383 31540 connection.cc:256] RPC call timeout handler was delayed by -2.686802630999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 12:23:22.305801 31540 connection.cc:256] RPC call timeout handler was delayed by -2.686802630999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 12:23:22.306174 31540 connection.cc:256] RPC call timeout handler was delayed by -2.6859026309998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 12:23:22.298758 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:22.296165 31417 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:22.307196  3114 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.307701 31491 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:22.248415  3078 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:22.309628 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.310670  3078 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.299415 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.279870  2671 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.291488 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.299503 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.306206 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 974) took 3108 ms. Trace:
I20260709 12:23:22.312131 32109 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:22.312441 31566 rpcz_store.cc:276] 0709 12:23:19.197433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.305521 (+3108088us) service_pool.cc:224] Handling call
0709 12:23:22.305789 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.305930 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.305953 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.305989 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:22.306017 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.306064 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.306157 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:22.300251 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67858.2us
W20260709 12:23:22.315797 31465 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.879s (SENT)
W20260709 12:23:22.317126 31540 connection.cc:256] RPC call timeout handler was delayed by -2.6166026309997505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:23:22.317492 31540 connection.cc:256] RPC call timeout handler was delayed by -2.6166026309997505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:23:22.317801 31540 connection.cc:256] RPC call timeout handler was delayed by -2.5590026309996574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:23:22.318110 31540 connection.cc:256] RPC call timeout handler was delayed by -2.5527026309996472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:23:22.318410 31540 connection.cc:256] RPC call timeout handler was delayed by -2.5527026309996472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:23:22.318717 31540 connection.cc:256] RPC call timeout handler was delayed by -2.4933026310000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:23:22.319025 31540 connection.cc:256] RPC call timeout handler was delayed by -2.4933026310000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:23:22.319320 31540 connection.cc:256] RPC call timeout handler was delayed by -2.17740263099995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2425s for a response
W20260709 12:23:22.319644 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5330026309998175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31410000000000005s for a response
W20260709 12:23:22.319957 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5330026309998175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31410000000000005s for a response
I20260709 12:23:22.311609 31495 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:22.327117 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.330209 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44279.5us
I20260709 12:23:22.291222  2857 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.273010  3040 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.207716  3090 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.335389 31569 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:22.335611  3041 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:22.336203  3066 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:22.336592  3066 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:22.336985  3066 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.337164 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.337929 32113 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:22.339897  3034 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.342275  2876 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.293071  3054 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.343089  3071 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:22.344340  2940 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.295933  3113 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:23:22.299553  3049 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.305160  3109 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:22.336853 31568 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:22.254981  3147 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.356691 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.331542 31540 leader_election.cc:400] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:22.326808 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:23:22.358614 31570 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.359089 31570 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.359254 31573 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:22.336683 31569 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:22.360630 31540 leader_election.cc:403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:22.365990 31571 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:22.367717 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2699) took 3482 ms. Trace:
I20260709 12:23:22.332477  2795 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.291396  3144 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.348102  3049 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:22.295189  3062 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.368233 31565 rpcz_store.cc:276] 0709 12:23:18.885288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:21.977961 (+3092673us) service_pool.cc:224] Handling call
0709 12:23:21.978287 (+   326us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:22.076476 (+ 98189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.076504 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:22.077168 (+   664us) log.cc:844] Serialized 78 byte log entry
0709 12:23:22.131674 (+ 54506us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:22.350911 (+219237us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.351444 (+   533us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.352722 (+  1278us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.367038 (+ 14316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.367138 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:22.367200 (+    62us) raft_consensus.cc:1685] finished
0709 12:23:22.367219 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.367657 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99276,"prepare.queue_time_us":5358,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":99059,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":2251648,"thread_start_us":272984,"threads_started":2,"wal-append.queue_time_us":54450}
I20260709 12:23:22.376057  3091 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:22.384600 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.376735 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60949.5us
I20260709 12:23:22.379071  3109 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:22.382762 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.382838 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51491.7us
I20260709 12:23:22.321069  2797 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.386561 31568 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:22.332576  2671 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:22.406003 31465 leader_election.cc:336] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.085s (SENT)
I20260709 12:23:22.395263  3109 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.396319 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.396821  3040 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.397961  2857 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.398420 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 973) took 3223 ms. Trace:
I20260709 12:23:22.398662 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.363051  3124 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:22.401713  3090 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.362903  3041 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:22.403702 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.406700 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:22.393965  3062 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.407761 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:22.423470 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:22.400223  3147 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.415423 31570 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.425262 31416 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:22.492141 31415 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:22.424988 31574 rpcz_store.cc:276] 0709 12:23:19.175088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.286873 (+3111785us) service_pool.cc:224] Handling call
0709 12:23:22.397740 (+110867us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:23:22.397935 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.398121 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.398149 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:22.398190 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:22.398224 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.398275 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:22.398364 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8297728}
W20260709 12:23:22.495407 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 164504us
I20260709 12:23:22.448297 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.461488  3044 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.237s
I20260709 12:23:22.700344  2797 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:22.701419 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.431164 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 132513us
I20260709 12:23:22.705330 31420 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:22.696174 31422 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:22.698148  3098 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:22.692374  3155 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 12:23:22.612116 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.599196 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.726840 31491 raft_consensus.cc:2410] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:22.696627 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.727823 31418 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:22.716009 31570 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:22.715804 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 326251us
I20260709 12:23:22.732797 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:22.753495 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.718302  3047 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:22.755831 32135 debug-util.cc:398] Leaking SignalData structure 0x7b0800316f00 after lost signal to thread 30274
I20260709 12:23:22.756845  3108 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.757863  3125 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:22.757812  2927 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:22.754245 31417 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:22.806144 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.797075 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.795192 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47314.8us
W20260709 12:23:22.769439 31389 connection.cc:256] RPC call timeout handler was delayed by -2.26374000099986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:23:22.862973 31498 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:22.786441 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.863449 31389 connection.cc:256] RPC call timeout handler was delayed by -2.1755400009997174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 12:23:22.864456 31389 connection.cc:256] RPC call timeout handler was delayed by -1.9111225639999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:23:22.729875  3090 raft_consensus.cc:2764] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:22.868942 31418 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:22.864742 31389 connection.cc:256] RPC call timeout handler was delayed by -1.87168667800006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 12:23:22.809928 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:22.871718 31389 connection.cc:256] RPC call timeout handler was delayed by -1.79394000100001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
I20260709 12:23:22.872046 31491 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
W20260709 12:23:22.853591 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002da220 after lost signal to thread 31356
I20260709 12:23:22.822587 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:22.819429 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:22.807907 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.858299 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 452309us
W20260709 12:23:22.874626 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5460 after lost signal to thread 31449
I20260709 12:23:22.866972 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.867750 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.867911 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 65654.5us
W20260709 12:23:22.876212 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002e53c0 after lost signal to thread 31524
W20260709 12:23:22.876500 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002e53e0 after lost signal to thread 31525
W20260709 12:23:22.877918 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed340 after lost signal to thread 31599
I20260709 12:23:22.878110 31574 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:22.878283 32135 debug-util.cc:398] Leaking SignalData structure 0x7b0800104320 after lost signal to thread 31600
I20260709 12:23:22.871064 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:22.873541 31421 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 5.
I20260709 12:23:22.879279 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:22.768601  3064 raft_consensus.cc:1064] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:23:22.884166 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08003dad60 after lost signal to thread 32138
I20260709 12:23:22.881709 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:22.885792 31418 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:22.886415 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7440 after lost signal to thread 32139
I20260709 12:23:22.886497 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.888149 31465 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 3.107s (SENT)
I20260709 12:23:22.727125  3049 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.821834  3144 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.801281  3143 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.892658 31495 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:22.765810  2935 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:23:22.869160  3066 consensus_meta.cc:287] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.006s
I20260709 12:23:22.824131  2671 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:22.803721  2982 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:22.906276 31540 leader_election.cc:400] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:22.923463 31540 leader_election.cc:403] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:22.916486 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:22.924913 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48380.1us
I20260709 12:23:22.802960  3005 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:22.918469 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 99184us
W20260709 12:23:22.920589 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45020.8us
I20260709 12:23:22.928333 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.932296 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.934980 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.801373  3010 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:23:22.935885 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.891866  3143 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.913166  2857 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:22.944943 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 51818.3us
W20260709 12:23:22.946738 31465 leader_election.cc:336] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 3.390s (SENT)
I20260709 12:23:22.947858 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.907856  2935 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:22.921303  3144 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.953244 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:22.929952  3034 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:22.952816 31500 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:22.946000  3090 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:22.969285 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:22.919986  3066 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:22.980229 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:22.981200 31500 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:22.930334  2982 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.946242  3005 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.962435  3034 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.904896  3041 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:22.970806  3047 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:23:22.982971 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 103799us
I20260709 12:23:22.992197 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:22.990875 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:22.993732 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.001021 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.985700  3109 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.019346 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.004832 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.005038 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:22.967929  3144 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.010428 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:22.987118  3049 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:22.986436  3108 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:23.022943 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:22.993482  3034 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.021194 32113 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:22.998379  2857 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:23.060623 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 134343us
I20260709 12:23:23.031112 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.069679 31500 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:23.066103 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:23.067721 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 121184us
I20260709 12:23:23.018086  2821 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:23.029192  3090 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:23.030700  3098 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.069962  3147 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:23.076197 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.080617 31415 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:23.076403 32113 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:23.079535 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.086467 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.129848 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.130838 31424 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:23:22.885865  3129 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:23.135807 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.136276 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.136941 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.068408  2857 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.138309 31419 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:23.143029 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.143985 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.144979 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.148653 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:23.150009 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 277653us
I20260709 12:23:23.149322 31500 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:23.142184 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 189440us
I20260709 12:23:23.082010  3090 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:23.135515  3108 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.145495 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:23.154668 31389 connection.cc:256] RPC call timeout handler was delayed by -1.5238203310000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:23:23.157450 31389 connection.cc:256] RPC call timeout handler was delayed by -1.5004203309999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 12:23:23.157496 32107 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEARNER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:22.998939  2935 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.162528 32108 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:23:23.162640 31389 connection.cc:256] RPC call timeout handler was delayed by -1.4725203309999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:23:23.163414 31389 connection.cc:256] RPC call timeout handler was delayed by -1.3681203309997727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:23:23.152158  3160 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:23:23.147445  2857 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:23.163746 31389 connection.cc:256] RPC call timeout handler was delayed by -1.3636203310002202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 12:23:23.076822  3049 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 12:23:23.169557 31389 connection.cc:256] RPC call timeout handler was delayed by -1.3357203310001751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:23:23.170725 31389 connection.cc:256] RPC call timeout handler was delayed by -1.3096203310001329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:23:23.171206 31389 connection.cc:256] RPC call timeout handler was delayed by -1.2673203310000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:23:23.171717 31389 connection.cc:256] RPC call timeout handler was delayed by -1.1710203309999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:23:23.175225 31389 connection.cc:256] RPC call timeout handler was delayed by -1.1440203309998651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 12:23:23.174643 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:23.175691 31389 connection.cc:256] RPC call timeout handler was delayed by -1.0954203309997865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 12:23:23.158957  3090 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:23.128935  2821 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.187724 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:23.194155 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:23.167292  3047 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:23:23.190611 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:23.197513 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:23.193122 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.204066 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:23.207511 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 141488us
I20260709 12:23:23.208981 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.211432 31417 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:23.213565 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.214749 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.215788 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.216450 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.216751 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.217422 32108 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:23.218115 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.173049  3158 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:23:23.244482 31500 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:23.243929 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.234004  3041 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 12:23:23.234390 31465 leader_election.cc:336] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.599s (SENT)
I20260709 12:23:23.246457 32109 raft_consensus.cc:2410] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:23.255806 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.247103 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.285575 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.286469 32106 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:23.200501  3175 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:23.191723  2916 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:23:23.225988  3108 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:23.226226  3066 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.225309  3147 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:23.204494  3143 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.197377  3098 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:23:23.243093  3167 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:23:23.313782 32105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
W20260709 12:23:23.314813 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 80455.2us
W20260709 12:23:23.314893 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 135629us
I20260709 12:23:23.225102  3177 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:23.236361  3005 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:23.328343 31465 leader_election.cc:336] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.616s (SENT)
W20260709 12:23:23.343104 31465 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.628s (SENT)
W20260709 12:23:23.288137  3164 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 12:23:23.237275  3168 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:23:23.234592  3182 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:23.250095  2982 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:23.325721 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:23.322448  3179 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:23.326846  3114 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.320782  3041 consensus_queue.cc:1243] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:23:23.329000 31389 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.545s (SENT)
I20260709 12:23:23.363467 31491 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:23.364831 31498 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:23.365211 31498 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:23.365984 31498 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.327877 32105 raft_consensus.cc:606] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:23.318897  3157 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:23.317497  3108 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:23.374886  3108 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:23.375602 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2879) took 1119 ms. Trace:
I20260709 12:23:23.375993 31423 rpcz_store.cc:276] 0709 12:23:22.255928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.256040 (+   112us) service_pool.cc:224] Handling call
0709 12:23:22.256318 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.803859 (+547541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.803889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.804346 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.924163 (+119817us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:22.924203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:22.924271 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:23.375381 (+451110us) raft_consensus.cc:1685] finished
0709 12:23:23.375402 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.375526 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547186,"raft.queue_time_us":547295,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":110650,"threads_started":1,"wal-append.queue_time_us":180911}
I20260709 12:23:23.325773  3181 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.327521  3184 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.367166  3188 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:23.383055  3181 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.382562  3157 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:23.387063  3157 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:23.383644  3098 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.391755  3098 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.330794  3173 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.394804  3173 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.403096 31498 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.342896  3177 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:23.352876  3144 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:23.350557  3182 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.411863  3182 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:23.415132  3098 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:23.415980  3181 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.418081  3177 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.332924  3191 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:23.351194 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 140912us
I20260709 12:23:23.323575  3147 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:23.339877  3163 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
W20260709 12:23:23.332939 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 117204us
I20260709 12:23:23.436913 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.438046 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.438696 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:23.355022 31389 leader_election.cc:336] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.602s (SENT)
I20260709 12:23:23.439818 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:23.441052 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 85660.8us
I20260709 12:23:23.442826 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:23.431315 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 227302us
I20260709 12:23:23.446934 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.448451 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.444738 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.445221 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.448479 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.454095 31497 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:23.457779 31498 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:23.436857  3147 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:23.437078  3158 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.443823  3184 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:23.474511 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 119501us
W20260709 12:23:23.475750 31389 leader_election.cc:336] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.718s (SENT)
I20260709 12:23:23.476255 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.444375  2857 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.462742 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.443740  3098 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:23.462476 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.479539 31499 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
W20260709 12:23:23.481824 31389 leader_election.cc:336] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.723s (SENT)
I20260709 12:23:23.484947 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.485963  3114 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.462978  3191 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:23.466195  3157 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:23.487556 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 240572us
W20260709 12:23:23.487774 31389 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.754s (SENT)
I20260709 12:23:23.461273  3190 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:23.491756 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.471921  3041 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:23.494062 31389 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.783s (SENT)
I20260709 12:23:23.494714 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.481768  3143 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.496770 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:23.480926  2939 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:23.498672 31389 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.830s (SENT)
W20260709 12:23:23.501339 31389 leader_election.cc:336] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.937s (SENT)
I20260709 12:23:23.501716 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.503691 31499 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.505460 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:23.488358  3191 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:23.506413 31389 leader_election.cc:336] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.967s (SENT)
I20260709 12:23:23.478541  3170 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:23:23.496538 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.493732  3098 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:23.505435  3190 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:23.507721  3144 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.495348  3041 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:23.489385  3194 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:23.494803  3173 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.473338  3158 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.494243  3108 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.507273 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.512429  3049 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.507651  3197 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:23.536422 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 91718.8us
I20260709 12:23:23.515441  3041 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.508627  3191 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:23.513587  3098 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:23.544951  3144 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:23.546694  3181 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.547359 31568 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:23.552675 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:23.518468  2857 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.511144 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:23.562667 31499 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:23.558511 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:23.569227 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.578657 31566 raft_consensus.cc:2376] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9. Re-sending same reply.
W20260709 12:23:23.579026 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67957.4us
I20260709 12:23:23.579934 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.584163 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:23.583850 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.585083 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.589097 31416 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:23.591006 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.592113 31572 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.591957 31574 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:23.590317 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.564498  3098 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:23.609439 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.609915 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:23.624526 31465 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.091s (SENT)
I20260709 12:23:23.626591 32113 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:23.627127 32113 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:23.584818  2939 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:23.588572  2871 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:23.641595 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.642318 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.519115  3190 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:23.632474 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.651022 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:23.671427 31416 raft_consensus.cc:2376] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13. Re-sending same reply.
I20260709 12:23:23.672333 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.672900 31416 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:23.673048 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.673724 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.659754 31491 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:23.668960 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.677079 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.678525 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.676239 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.678952 31497 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:23.680280 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.681007 31416 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:23.682690 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.683506 31416 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:23.670517 31572 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:23.686231 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.686972 31572 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:23.688084 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.688941 31572 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:23.689514 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.690469 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.691785 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.692167 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.693713 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:23.695758 31497 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.693962 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:23.689875 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.705996 31572 raft_consensus.cc:2376] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10. Re-sending same reply.
I20260709 12:23:23.707080 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.707686 31572 raft_consensus.cc:2376] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:23:23.708654 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.709857 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.710516 31572 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:23.711647 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.712278 31572 raft_consensus.cc:2376] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10. Re-sending same reply.
I20260709 12:23:23.713213 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.713920 31572 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:23.715075 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.715744 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:23.716689 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.717310 31572 raft_consensus.cc:2376] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11. Re-sending same reply.
I20260709 12:23:23.719048 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.718250 31416 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:23.648329  3108 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:23.582336  3181 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.619978  3184 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:23.738622 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.649653  2939 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.592417  3090 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.746136 31572 raft_consensus.cc:2376] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7. Re-sending same reply.
I20260709 12:23:23.753756 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:23.754180 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 66911.3us
I20260709 12:23:23.745850 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.668597  2871 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:23.731189  3034 consensus_meta.cc:287] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:23:23.747488 31416 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:23.605149  3162 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 12:23:23.764776 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.765707  3090 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:23.766397  3196 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:23:23.772608  3158 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.772879 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:23.807637 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.810392 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.747488 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:23.779152 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.811815 32108 raft_consensus.cc:2410] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:23:23.780946 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:23.812316 32107 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:23.817022 31415 raft_consensus.cc:2368] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13.
I20260709 12:23:23.818097 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.818696 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
W20260709 12:23:23.819283 31389 leader_election.cc:336] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.746s (SENT)
I20260709 12:23:23.776875  2871 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:23.822182 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.804368  3182 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.794080 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:23.790951 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.751957  2939 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.670209  3166 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:23:23.837606 31572 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:23.825350 31416 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:23.827358 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.792677  3157 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.805366  3047 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:23:23.831620 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.842343 31568 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:23.791690  3034 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.844520  2821 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.844913  3034 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.845749 31494 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:23.833686 32113 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.847993 32113 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:23.848676  3175 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:23.825055  3188 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.796025 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.850332 31567 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:23.850195  3188 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.851581 31567 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:23.852931 31567 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.836621 31566 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:23.839290 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:23.870028 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 115125us
I20260709 12:23:23.839846 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:23.873102  3206 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.873916  3188 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:23.875535 31422 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:23.877650 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55533.3us
I20260709 12:23:23.879633 31567 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:23.883401 31420 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:23.882314 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 108111us
I20260709 12:23:23.890954 31574 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:23.893062  3129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38884 (request call id 8) took 5650 ms. Trace:
I20260709 12:23:23.898873 31574 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:23.910054 31389 leader_election.cc:400] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8.
I20260709 12:23:23.917929 32107 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:23.920571 31572 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:23.921622 31568 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:23.893580  3129 rpcz_store.cc:276] 0709 12:23:18.242769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.242885 (+   116us) service_pool.cc:224] Handling call
0709 12:23:18.405441 (+162556us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b54003f0aa0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196daec4 00007fc11975e8d7 00007fc11976a03c 00007fc1197696b3 00007fc1197619fa 00007fc11e7294c9 00007fc117ca5c54 00007fc117ca5be2 00007fc117ca5b11 00007fc117ca5a8c
0709 12:23:18.418344 (+ 12903us) log.cc:844] Serialized 508 byte log entry
0709 12:23:23.892956 (+5474612us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13575,"raft.run_cpu_time_us":1060,"raft.run_wall_time_us":1059,"spinlock_wait_cycles":20614912}
I20260709 12:23:23.921885 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.923336 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.923713 31304 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d385c04853e749af8fb00afe40a4a255 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:23:23.891899  2821 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:23.752635  3184 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:23.924925 31466 leader_election.cc:400] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13.
I20260709 12:23:23.925601 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:23.927449 31466 leader_election.cc:403] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:23.927992 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.929162 31574 raft_consensus.cc:2410] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:23.925132 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:23.932526 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 313205us
I20260709 12:23:23.937476 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.894519  3198 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:23.939986 31419 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:23.941018 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.945252 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.947908 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:23.947702 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.926978  2821 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:23.925082  3218 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:23.966949 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.968869 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.941831  3175 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13.
I20260709 12:23:23.966782 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.938887  3125 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:23:23.979756 32113 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:23.978401 31574 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
I20260709 12:23:23.964283  2821 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.983160 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.981334 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:23.982035 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.968178  3218 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:23.989094 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:23.989899 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:23.990430 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:23.964912  2813 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:23:24.001528 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.002146 31574 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:24.005390  3063 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:23:24.006955 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.007593 31574 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:23.987088  3181 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:23.985551  3213 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:23.998884  3014 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:23.998925  3044 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:24.022854 31574 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:23:24.032356  3214 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:24.035665  3064 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:24.039454  3217 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:24.044552  3191 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.045755 31569 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:24.019899  3014 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.055945  3014 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.047304  3184 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:24.052148  3226 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:23:24.054844  3207 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:23:24.055388  3201 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:23:24.062639  3177 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.004s
I20260709 12:23:24.063061  3177 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.063482 31424 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:24.064177 31500 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:24.029843  3182 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.071789 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.071386 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.073249 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.075021 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.075577 31570 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:24.076259 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:24.076440 31465 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.787s (SENT)
I20260709 12:23:24.076823 31570 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:24.076841 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.077610 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.078228 31570 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:24.079044 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.080405 31570 raft_consensus.cc:2368] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:24.081988 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:24.082440 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:24.083699 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.083874 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.084185 31566 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:24.085811 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:24.086591 31570 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 11 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:23:24.092119 31573 raft_consensus.cc:2368] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:24.107134 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:24.127349 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.137995 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.138960 31566 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:24.140530 31570 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:24.140851 31567 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:24.140204 31574 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 12:23:24.142953 31573 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:24.079917  3184 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:24.083397  2916 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:24.150882 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.151475  3219 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:24.154098 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.155416  3198 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:24.138051  3218 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.098552  3090 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:24.159838  3090 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:24.160230  3090 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:24.160521  3129 raft_consensus.cc:993] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:24.160948  3129 raft_consensus.cc:1081] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
W20260709 12:23:24.162304  3221 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:23:24.162904  2939 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:24.163841 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.165488  2939 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.166404 31417 raft_consensus.cc:2368] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9.
I20260709 12:23:24.166456 31496 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:24.167738 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:24.168893 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:24.169998 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.170359 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:24.170993 31422 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:24.171936 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:24.147419  3184 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:24.172511  3184 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:24.172978 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.090144  3192 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.174357  3062 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:24.175624 31422 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:24.189798 31422 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:23:24.174104  2871 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.215262 31497 raft_consensus.cc:2955] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:24.160245  3177 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:24.226989 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 141703us
I20260709 12:23:24.229753 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:24.243587 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 251523us
I20260709 12:23:24.220458  3181 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:23:24.238732  3125 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:24.296984 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 213129us
W20260709 12:23:24.247977  3147 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 12:23:24.247366  3191 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.298561 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:24.314922 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81582.5us
W20260709 12:23:24.325771 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95277.6us
W20260709 12:23:24.346601 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48115.1us
I20260709 12:23:24.347738 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:24.349387 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.351212 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.357165 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.358248 31415 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:23:24.353184 31465 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.791s (SENT)
W20260709 12:23:24.301440  3098 consensus_meta.cc:287] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
W20260709 12:23:24.306316  3228 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
I20260709 12:23:24.366698 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.368358 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1729) took 1425 ms. Trace:
I20260709 12:23:24.368722 31492 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:24.368853 31494 rpcz_store.cc:276] 0709 12:23:22.931733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.931973 (+   240us) service_pool.cc:224] Handling call
0709 12:23:24.356114 (+1424141us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54000244d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:24.356239 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098709888}
W20260709 12:23:24.387230 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 139412us
I20260709 12:23:24.350051  3192 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:24.363366  3218 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:24.363616  3198 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:24.403262 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57130.6us
I20260709 12:23:24.375481  3191 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.306872  3147 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.404561  3125 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:24.363024  3182 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:24.407966  3191 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:24.403317  3014 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:24.414726  3232 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:23:24.415242  3237 raft_consensus.cc:2764] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:24.414955  3125 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:24.411154  3230 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 12:23:24.416651  3234 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:23:24.415593  3236 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:24.434930 31572 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:24.406541  3218 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:24.374931  3098 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.407169  3198 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:24.447130  3124 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:24.420521  3191 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:24.452119 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61854.1us
I20260709 12:23:24.455596 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:24.461283 31565 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:24.469163  2821 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.470372 31419 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:24.470741  3169 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:24.471733  3169 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:24.472025  3014 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.472610  3014 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:24.472959  3014 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:24.473295  3014 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:24.475647  2935 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:24.477723  3041 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.005s
I20260709 12:23:24.478389 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 753) took 1153 ms. Trace:
I20260709 12:23:24.450362  3218 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.478142  3041 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.486357 31500 rpcz_store.cc:276] 0709 12:23:23.325265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.325452 (+   187us) service_pool.cc:224] Handling call
0709 12:23:24.478218 (+1152766us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002e7554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:24.478323 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655102336}
I20260709 12:23:24.487697 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.451558  3198 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.491112 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:24.492133 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.493569 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.494321 32107 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:24.492956 32113 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:24.453091  2871 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.492389 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:24.432235  3238 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:23:24.498749 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:24.513115 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.514294 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.532655 32107 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:24.533923 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.536319 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.497872  3206 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:24.579077 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 171566us
I20260709 12:23:24.511493  3182 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:24.514045  3181 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:24.527702  3188 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:24.617134 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 321030us
I20260709 12:23:24.537292  3246 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:24.639213 31567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:23:24.639863 31567 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.640239 31567 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:24.642804 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.514088  3184 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.609470  3194 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:24.652611  3171 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 12:23:24.659498 31419 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:24.668903 31570 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:24.578999  3206 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.673293  2821 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:24.676088  3041 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:24.689146  3090 consensus_meta.cc:287] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 12:23:24.689721  3090 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:24.691231  3249 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:23:24.692435  3184 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.666483  3194 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:24.668035  3027 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:23:24.692471  3206 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:24.708120  3251 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:23:24.706049  3184 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:24.708761  3184 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.711732 31418 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:24.699712  3147 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.712267  3246 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.762285 32108 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:24.757965 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 400832us
I20260709 12:23:24.765450 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.713238  3184 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.762698 31567 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:24.767781 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 234624us
I20260709 12:23:24.682052  3014 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.773672 32107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:24.775708 32107 raft_consensus.cc:606] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:24.776142 31567 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.771297 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.777621  3184 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:24.772760  3194 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.780303  3184 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:24.743438  3246 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.774960  3147 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.782107 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.784122 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:24.786492  3184 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.787190  3147 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:24.787863  3147 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:24.788975  3147 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.789633 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:24.790779  3242 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.368s	user 0.000s	sys 0.003s
I20260709 12:23:24.791632 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.797657 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.800503 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.805538  3198 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.807850  3090 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.811193  3191 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.814508  3191 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.814934 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:24.815665 31495 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:24.820034 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:24.802316  3098 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:24.822818 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:24.833305 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.835526 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.841150 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:24.841636 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:24.843247 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 176858us
I20260709 12:23:24.843358 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:24.843868 32106 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:24.768172  3181 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:24.845624 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.847532 31498 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:24.846427 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 272381us
W20260709 12:23:24.849174 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.851459 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 191855us
I20260709 12:23:24.854192 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:24.846266 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 180630us
I20260709 12:23:24.867944 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.882951 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.883018 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:24.890663 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 189477us
W20260709 12:23:24.891726 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.773648  3218 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.895323 31494 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:24.896752 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.845448  2916 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:23:24.902101 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.910087 31422 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:24.902621 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48554us
I20260709 12:23:24.911532 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.855618  3098 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:24.925865  3218 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.926935  3090 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:24.927634 31574 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:24.928130 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.928941 31574 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:24.929634  3197 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:24.882565  3014 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:24.932998 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.938845 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:24.939724 31419 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.940274 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.921917  3194 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.933777 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.952898 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.953480 31494 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.956190 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.957722 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:24.959055 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53942.1us
I20260709 12:23:24.967355 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.967906 32111 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:24.968719 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.969055 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:24.969480 32112 raft_consensus.cc:2368] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13.
I20260709 12:23:24.970031 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.970121 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:24.970810 32109 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:24.970728 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.971443 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:24.972458 32111 raft_consensus.cc:2368] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10.
I20260709 12:23:24.976771 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:24.936831  3191 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:24.943231 31498 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:24.895009  3041 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:23:24.988209  3041 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:24.988593  3041 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:24.989513  3041 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:24.990787 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:24.982569 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71140.3us
I20260709 12:23:24.983238  3144 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:24.992046 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.900019  2871 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:23:24.984019 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.984042  3191 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:24.986071  3237 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:24.983644 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48102.2us
I20260709 12:23:24.992976 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:24.970518 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.003993  3245 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:25.004208  3215 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:25.005300  3213 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:25.005960  3213 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:25.007416 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.008101 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.009634 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.010854 31568 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:25.014497 31422 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:24.993022 31498 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:24.943957  3197 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.947527  3223 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:24.942204  3098 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:24.976452  3263 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:25.030444 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.015077 31494 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:25.015266 31566 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:25.034601 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.006306  3213 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.035953 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.993618  3248 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:25.038029 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.038335 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:24.983656  2795 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:25.043012 31420 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:25.036692 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:24.996752  3191 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:24.996549  3188 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:24.996004  3237 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.046944 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.005705  3245 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:25.047382  3188 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.051090  3188 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.051175  3198 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.036650  3184 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:23:25.044324  3248 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.054798  3248 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:25.054656  3044 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:24.984658  3181 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:25.056262  3259 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:25.033411  3223 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:25.058626 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.033842  3194 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.050266  3245 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.063184  3171 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:25.063910  3274 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:23:25.070601 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.057876  3147 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.059274  3237 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.091178 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.064899  3194 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.067183  3184 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.095620 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.061301  2821 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:23:25.079283  3192 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.098768  3210 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:25.111111 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 93810us
I20260709 12:23:25.074644  3218 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.103957 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:25.092404  3257 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:25.100344  3194 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.116464 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.120774 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.105202  3198 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.122992 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.125362  3263 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:25.125842  3263 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.126248  3263 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:25.127269  3276 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:23:25.132375  3192 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.133150  3192 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.117285  3257 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.134999  3257 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:25.119493  3184 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:25.138717 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:25.139639 31423 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1677) took 1464 ms (client timeout 1630 ms). Trace:
W20260709 12:23:25.140012 31423 rpcz_store.cc:269] 0709 12:23:23.674997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.677359 (+  2362us) service_pool.cc:224] Handling call
0709 12:23:25.138516 (+1461157us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800001298. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:23:25.139554 (+  1038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890624}
I20260709 12:23:25.141037 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.145882  3182 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.113931  3223 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.149091  3223 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.094594  3213 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.151486  3213 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:25.121404  3218 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.142750 31389 leader_election.cc:400] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
I20260709 12:23:25.157335 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.158787 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.160634  3182 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.161119  3182 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.161578  3182 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.140969  2795 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:25.162863  2795 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.163230  2795 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:25.168018 31389 leader_election.cc:400] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9.
W20260709 12:23:25.170034 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.172251  3218 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.197254 31419 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:25.145141  3188 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.199946  3192 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:25.120520  3245 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.203121  3245 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:25.203500 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:25.204646 31492 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2.
I20260709 12:23:25.213810  3191 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.216696  3182 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.227388 31568 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:25.229317 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1011) took 1675 ms. Trace:
I20260709 12:23:25.229693 31565 rpcz_store.cc:276] 0709 12:23:23.553585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.557701 (+  4116us) service_pool.cc:224] Handling call
0709 12:23:23.557915 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.461681 (+903766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.229069 (+767388us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54001ccd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:25.229252 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077195136}
I20260709 12:23:25.214545  3248 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.231717  3263 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:25.233311  3235 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.866s	user 0.003s	sys 0.000s
I20260709 12:23:25.233889  3263 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.237021  3173 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:25.237531  3173 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.239346 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 761) took 1294 ms. Trace:
I20260709 12:23:25.240716  3237 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.239857 31497 rpcz_store.cc:276] 0709 12:23:23.944487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.944601 (+   114us) service_pool.cc:224] Handling call
0709 12:23:23.945270 (+   669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:23.945674 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.945713 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:23.953757 (+  8044us) log.cc:844] Serialized 508 byte log entry
0709 12:23:24.215133 (+261376us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:24.348001 (+132868us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.374743 (+ 26742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.374813 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.232654 (+857841us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:25.238956 (+  6302us) raft_consensus.cc:1685] finished
0709 12:23:25.239083 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.239266 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26032,"raft.queue_time_us":28745,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10863,"spinlock_wait_cycles":5516672,"thread_start_us":260255,"threads_started":1,"wal-append.queue_time_us":301936}
I20260709 12:23:25.243686  3194 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.238569  3173 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.245168  3188 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.226524  3246 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.247716  3194 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.248723 31565 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:25.233340  3248 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.252177  3147 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.303611  3147 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.304848 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1001) took 1753 ms. Trace:
I20260709 12:23:25.305263 31569 rpcz_store.cc:276] 0709 12:23:23.551206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.554809 (+  3603us) service_pool.cc:224] Handling call
0709 12:23:23.555199 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:24.046114 (+490915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.304632 (+1258518us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400057654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:25.304795 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127788544}
I20260709 12:23:25.306042  3147 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.254184  3257 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.258868  2795 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.259881  3182 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.316011  2795 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.318565  3257 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.266930  3246 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:25.267470 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 98649.7us
I20260709 12:23:25.362915  3248 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:25.364020  3194 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:25.364414  3194 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.364880 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.364895  3147 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.365690  3246 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:25.366252 31418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2904) took 2293 ms (client timeout 1572 ms). Trace:
I20260709 12:23:25.366089  3246 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:25.366789 31418 rpcz_store.cc:269] 0709 12:23:23.079087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.079222 (+   135us) service_pool.cc:224] Handling call
0709 12:23:25.366067 (+2286845us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540010b654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:25.366187 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3748966656}
I20260709 12:23:25.367226  3246 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:25.367995 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.365275  3194 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.260682  3237 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:25.292220  3247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.006s	sys 0.020s
W20260709 12:23:25.290529 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1740) took 1384 ms (client timeout 1610 ms). Trace:
W20260709 12:23:25.368965  3247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.006s	sys 0.020s
W20260709 12:23:25.369072 31572 rpcz_store.cc:269] 0709 12:23:23.905988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.923076 (+ 17088us) service_pool.cc:224] Handling call
0709 12:23:25.290285 (+1367209us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400319054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:25.290460 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174333696}
W20260709 12:23:25.294483 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.370241 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.370820 31418 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:25.320514 31569 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:25.371390 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.243813  3191 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.330015 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2926) took 1283 ms. Trace:
I20260709 12:23:25.330883 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.377259 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.377496 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.332017 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.333786 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2915) took 1577 ms. Trace:
I20260709 12:23:25.334715 31415 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:25.339038  3181 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.359519 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.361408 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.366132 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.282502  3184 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:25.371865 31418 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:25.323657 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.374033 31566 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:25.374707 31424 rpcz_store.cc:276] 0709 12:23:24.047155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.359612 (+312457us) service_pool.cc:224] Handling call
0709 12:23:24.359939 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.360161 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:25.311291 (+951130us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.329676 (+ 18385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.329726 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:25.329770 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.329848 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.329958 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":950799,"prepare.queue_time_us":951018,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":245,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":17492,"threads_started":1,"wal-append.queue_time_us":16856}
I20260709 12:23:25.379663 31416 rpcz_store.cc:276] 0709 12:23:23.755964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.880729 (+124765us) service_pool.cc:224] Handling call
0709 12:23:23.881433 (+   704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.881684 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:24.079748 (+198064us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.310111 (+1230363us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b180047ce60. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11d15b3c7 00007fc11976d9a7 00007fc11977d0bf 00007fc11977d038
0709 12:23:25.310335 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.310554 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.310616 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:25.333436 (+ 22820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.333550 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.333715 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7740,"prepare.queue_time_us":2523331,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":2977,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":11834112,"thread_start_us":315766,"threads_started":2,"wal-append.queue_time_us":168169}
I20260709 12:23:25.390035 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.390864 31417 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.387122 31565 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:25.392643 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.398485 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.400414 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.401577 31416 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2.
I20260709 12:23:25.402908 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.403893 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.399484 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.406344 31421 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:25.369099  3194 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:25.419848 31421 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:25.405364 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.389822  3248 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.399099  3191 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.429579 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.385708  3287 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.419991  3257 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:25.434046 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.385430  3147 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.448385 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.442466 31417 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:25.405260  3263 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:23:25.453713 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.458003  3294 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:25.458376  3147 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:25.458562  3294 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:25.459507  3294 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.451352  3192 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.450454  3090 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:25.465359 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:25.456032  3293 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.464819  3257 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:25.455344  3184 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.485379  3181 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.485947  3181 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.490768  2813 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:25.490928 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88157.7us
I20260709 12:23:25.492956  3197 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:25.493373  3197 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.494074 32112 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:25.494172  3197 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:25.494722 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 420882us
I20260709 12:23:25.494860  3125 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:25.495343  3125 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.498548 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.500068 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.495406  3197 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:25.502200 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 427679us
I20260709 12:23:25.496325  3125 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:25.511036 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.517657 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:25.518354 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.519227 31415 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:25.515350 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.504535  3257 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:25.524255 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 153483us
W20260709 12:23:25.525880 31465 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.679s (SENT)
I20260709 12:23:25.526966 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:25.515681  3098 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:25.527848 31571 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:25.530066 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.530578 31565 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.531795 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.531872 31572 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:25.532703 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.533499 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.533916 31389 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.532804 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.535710 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.535843 31573 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.536535 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.534910  3125 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.539394 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.546068  3188 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.544494  3287 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:23:25.547763  3287 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:25.548106  3287 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.541355  3063 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.550767 31422 raft_consensus.cc:2410] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:23:25.551023  3063 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.551492  3063 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.535459  3295 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.535414  2797 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.548889  3287 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.559607  3287 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.563051  3257 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.542203 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:25.566095 31567 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.567052 31565 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:25.544211 32113 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:25.565596 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.569095  3295 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:25.569710  3295 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:25.571219 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:25.572924 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.574242  3173 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.575106  2813 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:25.575802 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46603us
I20260709 12:23:25.575840  2813 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:25.576674  2813 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.577564  2813 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:25.578635 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.592849 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.583209 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.584018 31500 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:25.584395 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:25.584757 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:25.600284 31497 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:25.601879 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.604064 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:25.607903  3184 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.608278  3049 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:25.722719 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:25.725054 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:25.727257 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98789.8us
I20260709 12:23:25.727445 31491 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:25.729117 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.528031  3254 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260709 12:23:25.742116 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 170951us
I20260709 12:23:25.585073 31573 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:25.731619 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:25.746546 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.748428  3188 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:25.749020  3188 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.749956  3188 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.750900  3098 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:25.752838 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.752843  3034 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:25.754925  3034 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.757848  3034 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.765791 31567 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:25.768093 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:25.771283 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:25.775189 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:25.776302 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:25.777768 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.531025  3260 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.195s
I20260709 12:23:25.608780  3184 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.724462  3257 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:25.741251  3218 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:25.607825  3253 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 12:23:25.590716  3014 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
W20260709 12:23:25.791641 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.780737 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.804443 31491 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:25.797897 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.802282 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.806373 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.810695 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:25.786536  3124 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:25.794236  3177 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:25.786309  3263 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:25.794406  3272 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:25.797101  3206 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:25.820622 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:25.801421  3218 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:25.828070 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85074.3us
I20260709 12:23:25.802608  3223 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.816148  3203 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:25.809798  3034 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.822417  3177 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:25.815739  3124 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.856034  3174 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:25.856613  3174 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.856438  3124 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.857661  3124 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:25.857498  3174 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.822077  3206 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:25.859247  3206 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.860707  3252 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.855016  3177 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.855392  3253 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:25.883548  3253 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:25.884462  3253 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.885658  3253 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:25.835958  3263 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:25.840010  3218 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.822162  3272 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:25.829640  3066 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:25.868625  2813 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:25.890503  2813 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:25.892024 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54576.2us
I20260709 12:23:25.892629  2813 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.868942  3063 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.894707  3063 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.895520 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.896039 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.897563 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.899039 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:25.900720 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.877374  3184 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:25.879567 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:25.880635 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.882794  3252 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:25.913578 32107 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:25.919991 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.920912 32106 raft_consensus.cc:2376] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11. Re-sending same reply.
I20260709 12:23:25.928681 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:25.910815  3272 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:25.927845 32110 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:25.933820  3263 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:25.935616  3304 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:23:25.919672  3191 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:25.865859  3246 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.944245  3044 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:26.014963 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 209795us
I20260709 12:23:26.084583  3044 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.084669  3041 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:26.019934 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.087294 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.087049  3044 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.023454 31418 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:26.024869 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 706) took 1128 ms. Trace:
I20260709 12:23:26.091624 31423 rpcz_store.cc:276] 0709 12:23:24.896434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.172089 (+275655us) service_pool.cc:224] Handling call
0709 12:23:25.172587 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.452149 (+279562us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:25.452196 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.452685 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.800017 (+347332us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:25.800049 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.800108 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.024252 (+224144us) raft_consensus.cc:1685] finished
0709 12:23:26.024299 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.024632 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61344,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":602036,"threads_started":2,"wal-append.queue_time_us":361945}
I20260709 12:23:26.094447  2939 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.095471  2939 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.036978 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:26.099546 31565 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.038941 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:26.098371  3090 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:26.054628 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 126136us
I20260709 12:23:26.058446 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:26.059512 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.060789 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:26.112548 31567 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:26.113355 31569 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:26.114334 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.065554 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.066563 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.066885 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:26.116672  3125 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.004s
I20260709 12:23:26.067303 32114 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:26.083170  2857 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.117970  2857 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.103554  3090 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:26.125411 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.131680 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.132810 32112 raft_consensus.cc:2393] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:26.129827  3090 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.134768 32114 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:25.975870  3177 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.158833  3173 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.159921  3173 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.161429  3177 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.956600  3181 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.164362  3181 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.947198  3191 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.122627  2857 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.168349  3191 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:25.975061  3206 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:25.961846  3218 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.192168  3218 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:25.963265  3246 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.956050  3252 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:25.961702  3272 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.157298  2939 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.157753  3180 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:26.194820 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48344.6us
I20260709 12:23:26.195153  3180 consensus_queue.cc:1243] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:23:26.138443  3170 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:26.195757  3170 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.197017  3170 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.198271  3170 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:26.202878  3174 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:26.203192 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.204252  3174 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.204661  3174 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.205396  3166 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:26.205825  3166 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.189183  3014 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.207794  3014 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.214989  3047 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.204671 31571 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:26.170178  3173 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.219784 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.220815  3176 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:26.221128 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 156029us
I20260709 12:23:26.216566  3014 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.221798 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.224956 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:26.225937 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.226100 32106 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:26.228494 31495 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:23:26.229264 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47382.9us
I20260709 12:23:26.229800 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.231623 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.232192  2939 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.233034 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.232846  2797 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:26.234591 31419 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:26.236894 31565 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:26.238806 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.205914  3174 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.244745 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.243167  2939 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.251080 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:26.252205 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 431557us
I20260709 12:23:26.251979  3166 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.254999  3206 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.257504 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:26.259018  3176 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.259449  3176 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:26.259838  3176 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:26.260239 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.261133 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.264156 31420 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:26.264990  3272 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.265501  3177 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:26.267145  2939 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.267181  3177 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.268097  3177 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.268204 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.270234  3166 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:26.270390 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.272090 31567 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:26.272423 31569 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:26.273324 31422 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:26.267961 31570 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:26.276965 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.286334 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.282595  3272 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.287509 31423 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:26.289641 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:26.287331 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:26.292701 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 143803us
I20260709 12:23:26.295025 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:26.295953 31420 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:26.296326 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:26.297117  3272 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.300403  3173 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:26.306241 31493 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:26.309514  3206 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:26.310386 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.299068  3272 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:26.324195  3272 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.324928  3239 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.325341  3239 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.320216  3173 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:26.327739  3173 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.321867  3327 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:23:26.332448 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 179392us
I20260709 12:23:26.301971  2939 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:26.334911  2939 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.335381  2939 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:26.340875  3044 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.326532  3239 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.351897 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:26.352280  3239 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:26.352691 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75811.1us
I20260709 12:23:26.353782  2871 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:26.353840  3206 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:26.354571  2871 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.355031  3041 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:26.355402  3041 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.356415  3041 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.356985  2871 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.358106 31418 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:26.323484 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.359732 31491 raft_consensus.cc:2376] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10. Re-sending same reply.
I20260709 12:23:26.323700  3174 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.376806  3177 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.381479  3238 raft_consensus.cc:993] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:26.383188  3238 raft_consensus.cc:1081] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:26.383522 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.384860  3177 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.387039  3041 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.396596 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:23:26.351131 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61733.8us
I20260709 12:23:26.334606 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:26.404821 31423 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:23:26.404855 31420 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:23:26.412222 31569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
W20260709 12:23:26.413185 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.415421  2916 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:26.418658  3158 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.418964  3224 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.420097  3223 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:26.434067 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71307.3us
I20260709 12:23:26.433836 32110 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:26.421622 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:26.446732 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.440783 31569 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.451793 31569 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.441220 31423 pending_rounds.cc:85] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 8
W20260709 12:23:26.450158 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 98568.5us
I20260709 12:23:26.464511 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:26.452605 31423 pending_rounds.cc:107] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:26.471495 31423 raft_consensus.cc:2889] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:26.448750  3327 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:26.475889 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141487us
I20260709 12:23:26.476385  3224 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:26.500092 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.479220  3238 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.482187  3158 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.482021 31322 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.483104  3206 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.496369  2939 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.490273 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.505865 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:26.471731  2797 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.512606  3272 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.524260  3238 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.526001  3294 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:26.527052  3272 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.527410  3257 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.528306  3246 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:26.531424 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 109890us
I20260709 12:23:26.472803  3191 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:23:26.524343 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.532546  3158 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.498170  3218 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:26.533356 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.534080  3293 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.510614  3206 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.539677  3318 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.525225  3203 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:23:26.553155 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47392.8us
I20260709 12:23:26.543560  3294 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.552304  3327 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:26.582834  3184 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:26.583592  3184 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:26.584846  3184 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.586743  3257 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.588377  3293 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.589193  3257 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.586869  3246 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.568305 31322 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 10, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.596495 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.542806  2916 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:23:26.580408  3294 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.592890  3293 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.624413 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.623529 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.633263  3144 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.633646 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:26.633880  3190 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:26.634073  3144 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.635310  3206 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.636451  3144 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.636706  3206 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.640944  3158 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:26.641363 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.641630  3158 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:26.642889 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 72196.4us
I20260709 12:23:26.644675  2916 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:26.645287 31320 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 299) took 30237 ms (client timeout 15000 ms). Trace:
I20260709 12:23:26.645378  2916 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.647969  2916 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.648475  2916 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.648931  2916 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.648213 31322 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 8 to 7, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.633387 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.629658 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.659997 31420 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:26.667060  3066 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:26.667420 31322 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.668998  3066 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:26.651929  3158 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.661263 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.654726  3327 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.669869 31322 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.632014  3090 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.680702  3190 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.681181  3190 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.681300  3246 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:26.646039 31320 rpcz_store.cc:269] 0709 12:22:56.414491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.442790 (+ 28299us) service_pool.cc:224] Handling call
0709 12:23:26.644953 (+30202163us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:22.332671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:22.343500 (+ 10829us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:22.343554 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:23:22.343573 (+    19us) tablet.cc:662] Decoding operations
0709 12:23:22.344537 (+   964us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:22.344632 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:22.344668 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:22.345349 (+   681us) tablet.cc:701] Row locks acquired
0709 12:23:22.345400 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:23:22.345557 (+   157us) write_op.cc:270] Start()
0709 12:23:22.345676 (+   119us) write_op.cc:276] Timestamp: P: 1783599802345501 usec, L: 0
0709 12:23:22.345696 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:23:22.407483 (+ 61787us) log.cc:844] Serialized 3326 byte log entry
0709 12:23:23.943684 (+1536201us) op_driver.cc:464] REPLICATION: finished
0709 12:23:24.417100 (+473416us) write_op.cc:301] APPLY: starting
0709 12:23:24.417216 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:24.420368 (+  3152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:24.442422 (+ 22054us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:24.572684 (+130262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:24.645983 (+ 73299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:23:24.661575 (+ 15592us) write_op.cc:312] APPLY: finished
0709 12:23:24.675288 (+ 13713us) log.cc:844] Serialized 65 byte log entry
0709 12:23:24.675487 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.675602 (+   115us) write_op.cc:454] Released schema lock
0709 12:23:24.675649 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:24.676035 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.676060 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4021480,"reported_tablets":47,"spinlock_wait_cycles":8064,"child_traces":[["op",{"apply.queue_time_us":461287,"apply.run_cpu_time_us":4814,"apply.run_wall_time_us":258921,"num_ops":8,"prepare.queue_time_us":241127,"prepare.run_cpu_time_us":23409,"prepare.run_wall_time_us":584913,"raft.queue_time_us":374830,"raft.run_cpu_time_us":16006,"raft.run_wall_time_us":340535,"replication_time_us":1567763,"thread_start_us":877658,"threads_started":4,"wal-append.queue_time_us":528489,"wal-append.run_cpu_time_us":44162,"wal-append.run_wall_time_us":2781113}]]}
I20260709 12:23:26.682224  3190 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.682924  3048 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.683314  3048 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.683634  3190 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.684293  3048 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.685724  3048 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.676685  3034 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:23:26.617560  3318 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.669869  3238 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.672362  3218 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.695309 31322 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.701685 31422 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:26.704275  2939 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:26.711417 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.731492 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.731779 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.732007 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.712553  3318 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:26.713883  3333 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:23:26.733193 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.694872  3327 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.735106 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.735800 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.735967  3327 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.736418 31567 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:26.738300 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.741442 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:26.742005 31570 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:26.744720 31322 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 7, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 7 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:26.717515 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 88493.8us
I20260709 12:23:26.756044 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:26.759691  3124 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:26.761328  3330 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:23:26.717818  3294 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.764520  3294 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.718194  3010 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.718564 31418 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:26.720798  3176 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.721688  3218 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.767436  3218 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.726081 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.767983  3176 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:26.727597 31417 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:26.728785 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.729664 31565 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:26.733796 31424 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
W20260709 12:23:26.714880 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 132346us
I20260709 12:23:26.770586 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.771643 31322 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.747888 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.749001  2916 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.750229  3224 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.752472  3047 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:26.784233  3047 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.785264  3047 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.786298 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.787071 32114 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:26.787402 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.788028  3224 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:26.788748  3224 consensus_queue.cc:1243] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:26.789666  3224 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.790046  3224 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.773211 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:26.742018 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.788693 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.792027 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:26.792918 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.793177  3170 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.775298 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.793926  3170 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:26.793345 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.786459  3047 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.796440 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.797010 31491 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.796979 31569 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.798390 31499 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:23:26.801534 31537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.555s (SENT) [suppressed 43 similar messages]
I20260709 12:23:26.802268 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.802654  3252 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:26.802875 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.799233 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.799679 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.797111 31500 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:26.803514 31495 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:26.804479 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.804582 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.805675 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.806001 31500 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.800139 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.800818 31566 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:26.808308 31497 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:26.809506 31492 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:26.810093 31497 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:26.810459 31497 pending_rounds.cc:85] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 4
I20260709 12:23:26.810657 31497 pending_rounds.cc:107] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:23:26.812331 31569 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.812637 31497 raft_consensus.cc:2889] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:26.801105 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.815356 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:26.798712  3010 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:26.816254  3090 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:26.803107 31499 raft_consensus.cc:2410] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:23:26.816821  3090 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.817128  3327 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.816843  3010 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:26.817816  3327 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.806466 31500 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:26.818616 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:26.819025  3090 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.819839  3090 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.819522 31500 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.820364  3327 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:26.820489 31500 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.821012 31497 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.821656  3224 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:26.823159  3224 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.817922  3010 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:26.823943 31491 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:26.824652  3010 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.826076  3010 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:26.830294  3239 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:26.830770  3319 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.831705  3124 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:26.832086  3124 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:26.832878 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44407.3us
I20260709 12:23:26.833434  3246 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:26.833616 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:26.833849  3246 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.834203  3246 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:26.834368  2939 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:26.834782  2939 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.835127  2939 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:26.832985 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59865.1us
I20260709 12:23:26.832999  3124 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:26.835567 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.836658  3319 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:26.837736  2797 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:26.836687  3124 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.846767  2797 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.847276 31498 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:26.849046  2797 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.851121  3319 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.851670  3319 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.853679  3319 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:26.854152  3319 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:26.854633  3319 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.855685 31498 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:23:26.855890 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.855187 31500 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:26.859665 31495 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:26.859916 31309 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.325s	user 0.023s	sys 0.006s
W20260709 12:23:26.860050 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44784.9us
W20260709 12:23:26.922649 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.922822 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:26.923758 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.860384 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 194333us
I20260709 12:23:26.926098 31497 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
W20260709 12:23:26.860788 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58433.9us
W20260709 12:23:26.885489 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.930584 31570 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:26.856024  2797 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:23:26.940300 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.940953 31493 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:26.916169  3170 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:26.945624 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:26.949331 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.934427  3327 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.956933 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.937399  3144 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:26.955261 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:26.941459 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 79229.5us
I20260709 12:23:26.854423  3246 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:26.960987 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.961453 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:26.959062 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:26.962628 32114 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:26.945322  3170 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:26.967944 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112141us
I20260709 12:23:26.971067 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.968930 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.953336  3190 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.941045  3206 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:23:26.979632 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:26.965390  3294 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:26.980497 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:26.976540 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:26.980537 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:26.960232  3144 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:26.989357 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:26.970386  3191 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:27.003834 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:26.992285  3294 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.992479  3144 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.017956 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.020612 32110 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:27.024165 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.024786 32112 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:27.026484 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.021515  3191 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:27.030474 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.033087 32106 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:27.026207  3294 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.036585 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:27.042356 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:26.993786  3173 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:27.043234 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.047361 31569 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:27.049553 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.050890  3090 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.051131  3248 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:27.051798  3317 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.056008 32114 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:27.059078 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.034691  3319 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.028534  3181 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.064260 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:27.066588 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.069429 31567 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:23:27.030352  3064 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:23:27.064992 32111 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:27.073714  3181 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.075963  3181 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.083026  3177 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.083742 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.084630  3319 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:27.085219  3319 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:27.085939  3338 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:27.085618  3339 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:27.086477  3339 consensus_queue.cc:1243] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:27.084730  3177 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.087282  3246 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.086342  3319 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.090365  3319 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:27.085741 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:27.086404  3338 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.109658 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.110320 32114 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:27.072269  3248 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:27.116631 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.032255  3170 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.144447 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:27.112893  3338 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.150175 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.153528  2939 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.118222  3206 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:27.108708  3181 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:23:27.142516  3090 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.170544 31418 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:23:27.174665 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88935.4us
I20260709 12:23:27.181627  3177 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:27.182036  3177 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:27.182938  3177 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.184108  3177 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.192235  2939 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.192483 31497 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:27.194747 31494 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:27.164458  3294 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.200740  3294 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.205484  3144 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.207000  3170 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:27.211081  3317 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:27.211793  3317 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:23:27.220570  3206 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:27.249166 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.269204 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.266352 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.270026 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:27.214517  3317 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.274330 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.275308  3047 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.275375 32106 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:27.270645 31418 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:27.287566 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.288659 32110 raft_consensus.cc:2410] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:23:27.257524  3184 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.143018  3191 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.301537 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.341586 32112 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:27.342811 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:27.313894 31537 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.032s	sys 0.055s
W20260709 12:23:27.343611 31537 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.033s	sys 0.061s
W20260709 12:23:27.343954 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 542435us
I20260709 12:23:27.177824  3090 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.349316 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.352591 32111 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:27.298440  3047 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.354843  3047 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:27.359704 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 370444us
I20260709 12:23:27.360657 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:27.279213  2939 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:27.368224 31418 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:27.370545 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78610.8us
I20260709 12:23:27.341710  3206 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:27.377286 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:27.377470 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.378535 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:27.379832 32113 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:23:27.382706 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 116429us
I20260709 12:23:27.385421 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.299054  3293 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:27.351146  3317 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.392110 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:27.392724 31493 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.392141 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.206996  3248 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:27.375332  3124 consensus_meta.cc:287] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 12:23:27.392218  2939 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.399677 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.400245 32112 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.401503  2939 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.402379  2857 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.402767  2857 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.403117  2857 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.396040  2797 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:27.407485 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:27.408290  3125 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:27.368448  3327 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:27.410120  3327 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.358201 31309 maintenance_manager.cc:643] P 79dd877deb754ad9bbc3b169ee250de3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.477s	user 0.198s	sys 0.037s Metrics: {"bytes_written":30353,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1864,"dirs.run_cpu_time_us":690,"dirs.run_wall_time_us":3099,"drs_written":1,"lbm_read_time_us":391,"lbm_reads_lt_1ms":4,"lbm_write_time_us":112198,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":142258,"threads_started":2,"update_count":8,"wal-append.queue_time_us":323533}
I20260709 12:23:27.412283  3327 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.413913  3327 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.416496 31310 maintenance_manager.cc:419] P 79dd877deb754ad9bbc3b169ee250de3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9875 bytes on disk
I20260709 12:23:27.409574 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:27.425561  3319 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:27.373606  3181 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.447233 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.342350  3184 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.386032  3246 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.391746  3252 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.461149 31309 maintenance_manager.cc:643] P 79dd877deb754ad9bbc3b169ee250de3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.037s	user 0.003s	sys 0.003s Metrics: {"cfile_init":1,"lbm_read_time_us":332,"lbm_reads_lt_1ms":4}
I20260709 12:23:27.427546  3173 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.457827  3014 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.521127 31423 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:27.391664  3317 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.485102  3239 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.398707  3293 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.554257  3293 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.543366  3144 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.569996  3317 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.456997  2939 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:23:27.570847  3260 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:23:27.492961  3252 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.573196  3252 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.545091  3347 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:23:27.574096 32112 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:27.486250  3206 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:27.543445 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56288.7us
I20260709 12:23:27.575132 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:27.576757 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 177732us
I20260709 12:23:27.564225 31493 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:27.493552  3173 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:27.414413  3327 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.566340  3246 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:27.486408  3181 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.583750 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:27.568101 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.618348 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:27.525390  3338 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.625015  3338 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.617331  3317 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:27.626119  3317 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:27.626521  3317 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:27.620297  3347 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:23:27.636603  3064 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:27.646745  3346 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:27.648154  3346 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:27.648620  3346 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:27.649653  3346 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.582532  3173 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.525137  3014 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:27.656189 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 75231.3us
I20260709 12:23:27.661608 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:27.616559  3246 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:27.633061  3090 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.638996  3184 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.651314  3319 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:27.664285  3064 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:27.680549  3064 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.681044  3064 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:27.683056  3346 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:27.684382 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:27.685213  3348 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.685938  3348 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.692467  3246 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:27.699820 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.632879  3144 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:23:27.708371 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.694307  3246 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:27.721381 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:27.705502  3338 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:27.698830  3206 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.698025  3327 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.718626  3177 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:27.724466 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.727020 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.733345 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.733971 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:27.734398 31493 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:27.734719 31494 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:27.736703 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.737111 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:27.764248 31491 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:27.725291  3338 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.723075  2857 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.774565 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:27.776870 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 380554us
I20260709 12:23:27.777549 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.778610 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.779839 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:27.752394  3327 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.765580  3181 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.736696  3206 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.771555  3338 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:27.795703 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.765722  3177 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.791167  3347 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:27.792318 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:27.796437 32112 raft_consensus.cc:2393] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:27.818874  2939 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.804522  3090 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.827208  2939 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.829504  2939 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.809999 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:27.809979 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49539.5us
I20260709 12:23:27.833715 31499 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:27.830708  3090 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:27.792869  3184 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.801841  3181 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:27.799800  3144 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:27.811470  3337 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:23:27.853937 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.810127  3014 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.796437  3327 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.854619 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.883020 31566 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:27.827775  2797 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.859143 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:27.852061 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:27.862557 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.885119 31569 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:27.875769 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.880335 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.860925  3318 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.886376 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:27.830577  3317 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:27.891039 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 465927us
I20260709 12:23:27.850507  3047 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:23:27.873255  3181 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:27.862080  3293 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:27.902258 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 441731us
I20260709 12:23:27.885531  2939 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.913136 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.917219  3010 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.917773  3010 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.919119 31573 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:27.920240  3010 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.921222  3317 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:27.922173 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 75270.9us
I20260709 12:23:27.923017 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.924342 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:27.925369  3184 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:27.926014  3184 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:27.928066 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.929607 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.918413 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.930928 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.931237 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:27.931663 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.932212 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.932736 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.933476 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.894840  2797 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.935578 31574 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:27.936453  2797 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.936703 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.937647 31574 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:27.938907 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.939893 31568 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:27.944176  3327 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.951206  2857 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:27.955127 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.955798 31569 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:27.956110  3177 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:27.962762 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:27.963547  3047 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:27.964107  3047 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.964987 31566 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:27.966506  3293 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:27.968693  3293 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:27.938546 31567 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:23:27.933491 31571 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:27.911607  3353 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.980132  3181 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:27.983268 31570 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:27.975514 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:27.984565 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:27.992532 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:27.993594 32112 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:27.996783 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:27.997571 31569 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:27.999799 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:27.996595 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.007681 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:27.896196  3318 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.013482 31569 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:27.991554  3206 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.020066 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:28.021889 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 208168us
I20260709 12:23:28.007200  3347 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.001610  3319 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:28.008715  3252 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.991364  2939 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.029102 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:28.031764 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 107523us
I20260709 12:23:28.045501 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:28.045506 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 102991us
I20260709 12:23:28.023831  3170 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:28.048715 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.049571 31423 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:28.058629 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44960us
I20260709 12:23:28.059646 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:28.069788 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.061784 31422 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:28.073671 31573 pending_rounds.cc:85] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 4
I20260709 12:23:28.026945  3239 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:23:28.076917 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.086138 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:28.087390 31495 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:28.054551  3366 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.116127 31571 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:28.034288  3252 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.074327 31573 pending_rounds.cc:107] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 12:23:28.074832  3362 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:28.124874 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.124781 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.069671  3347 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.125340 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.080008  3125 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.128971 31573 raft_consensus.cc:2917] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 12:23:28.129482 31573 raft_consensus.cc:2889] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:28.139976 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 119997us
I20260709 12:23:28.149617 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.151549 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.152354 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.152170 31417 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:28.117841  3293 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:28.161933 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.162539 31417 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:28.162876 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:28.164083 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:28.167861 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.127135  3346 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.168828 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.172156 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.173734 31415 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:28.174856 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:28.176257 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119195us
I20260709 12:23:28.137593  2797 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:28.130725  3125 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.127568  3362 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:28.178660 31499 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:28.184547 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.187908 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.153647  3317 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:28.155108  3206 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.185233 31492 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:28.121189  3368 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:23:28.249089 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:28.173926  3248 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:28.186074  3173 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 12:23:28.242265 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.236886 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:28.250588 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.250931 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.252516  3294 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:28.252614  3246 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:28.255406  3376 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.289249 31499 raft_consensus.cc:2368] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:28.070850  3353 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:23:28.137950  3366 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.185942  3125 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.159495  3338 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.281543 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:28.138082  3319 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.194736  3293 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:28.304630 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.189695  3362 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.288677 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:28.279944  3356 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:28.291253 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49144.6us
I20260709 12:23:28.308777 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:28.313850 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:28.291906 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 143040us
I20260709 12:23:28.315321 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.178297  3346 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.236414  3327 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:28.182863  3347 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.256181  3371 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:28.313835  2939 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.323053  3395 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:28.337051  3327 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.305425  3376 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.338729  3347 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.339152  3327 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:28.285270  3173 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.340159  3376 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.304637  3364 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.341181  3173 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.341423  3354 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.341089  3364 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.341928  3354 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.312674 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.321281 31495 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:28.288234  3318 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.323320 31574 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:28.281930  3248 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:28.306413  3368 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:28.330243  3348 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.332635 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.333436 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:28.256994  3191 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:23:28.416589 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:28.343690  3395 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:28.417407 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:28.343833  3364 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.313349  3356 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:28.299111  3124 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.419754  3356 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:28.419910  3124 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.347220 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.286458 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.350831 31421 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:28.347402 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.329195 31416 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:28.346439  3293 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.381592  3346 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.367777  2797 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:28.428639  3124 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.429613  2797 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.382328 31423 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:28.383844 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:28.383860 31495 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:23:28.385018 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.295270  3246 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.415143 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.277949  3206 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.424535 32111 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:28.446087 31572 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:28.452723 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.453501 32111 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 6.
W20260709 12:23:28.482529 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 66049.8us
I20260709 12:23:28.483476 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:28.389204  3363 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 12:23:28.366042  3377 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:28.508713 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 435481us
I20260709 12:23:28.385860  3248 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:28.512490 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 340383us
W20260709 12:23:28.516360 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 132582us
W20260709 12:23:28.538043 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 224273us
I20260709 12:23:28.386237  3368 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:28.576905 32114 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:28.577566 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.578917 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.579144 31492 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:28.576376 31390 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:28.579613 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.575611 31419 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:28.583601 31421 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:28.604115  3348 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:28.583683 31493 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:28.604601  3348 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.605086  3348 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.607259  3396 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:28.609081 31390 leader_election.cc:400] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:28.609462  3380 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.612342  3380 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.589046  3385 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.615278  3385 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.615605 32108 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:28.616175  3246 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.617003 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.617347  3385 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.605022 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.611579  3396 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:28.611505 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.632869 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.633612 31497 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
W20260709 12:23:28.593019 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77149.4us
I20260709 12:23:28.612350 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.618475 31390 leader_election.cc:403] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.590389 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.635910 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:28.631835 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 467798us
I20260709 12:23:28.635519 31574 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:28.597484 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45504.2us
I20260709 12:23:28.641247  3239 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:28.637004 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:28.642627 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.590969  3191 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:28.646837 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.647097 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:28.559008  3394 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.650269 31417 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.651214 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.654448 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.654911 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.655511 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.617843  3206 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.659155 31421 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:28.661695 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.662243 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:28.588853  3386 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.660245 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.653261  3318 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:28.664517 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.664860  3318 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.665171 31499 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:28.598584  3354 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:28.701977 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.633268  3396 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:28.666129 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.659312  3394 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.707792  3370 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:28.708482  3390 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.708988  3390 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.709525  3394 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.710296 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:28.711268  3384 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:23:28.711592  3206 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:28.712569 32112 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:28.712924  3382 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:28.648891  3376 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.645920  3319 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:28.658347 31567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.001s
I20260709 12:23:28.703428 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:28.800459 31567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.006s	sys 0.002s
I20260709 12:23:28.589964  3395 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:28.581058  3383 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.590988  3393 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:28.720779  3386 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.665766  3181 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:23:28.658293  3294 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:28.722769  3090 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:28.723361  3327 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.724561  3352 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:28.725454  3064 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.044s	user 0.009s	sys 0.003s
I20260709 12:23:28.726130  3173 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:28.732205 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:28.734150 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:28.735574  3177 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:28.739733 32108 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:28.648170  3184 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.661993  3252 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.658742  3191 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:28.919505 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.001s	sys 0.013s
I20260709 12:23:28.742033 31415 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:28.743446 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2958) took 1465 ms. Trace:
I20260709 12:23:28.648504  3385 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.665369  3318 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:28.658957  3381 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:28.641927  3239 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.920411 31420 rpcz_store.cc:276] 0709 12:23:27.278099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.278237 (+   138us) service_pool.cc:224] Handling call
0709 12:23:27.278749 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:27.299717 (+ 20968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.299757 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:27.448890 (+149133us) log.cc:844] Serialized 572 byte log entry
0709 12:23:27.910789 (+461899us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:27.910834 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.910964 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.743154 (+832190us) raft_consensus.cc:1685] finished
0709 12:23:28.743178 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.743340 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":394009,"threads_started":1,"wal-append.queue_time_us":541094}
I20260709 12:23:28.757023 31491 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:28.742559 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.760077  3144 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:28.761214 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57853.9us
I20260709 12:23:28.766799 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:28.764788 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 102620us
I20260709 12:23:28.648331  3246 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:28.812453 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51254.9us
I20260709 12:23:28.871291 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:28.940501 31494 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:28.652765  3353 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
W20260709 12:23:28.810463  3369 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:28.777396  3394 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.666268  3371 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:28.811321  3393 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.811102  3383 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:28.911456 31416 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:28.912041 31493 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:28.665591  3401 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.240s
W20260709 12:23:28.964843  3402 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
W20260709 12:23:28.914021 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 179946us
W20260709 12:23:28.919831 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.001s	sys 0.013s
I20260709 12:23:28.966288 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:28.916811  3064 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.967886 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1800) took 1135 ms. Trace:
I20260709 12:23:28.969241  3124 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.802448  3376 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.969599 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.969710  3124 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.942713  3347 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:28.971324  3376 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.940126  3246 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.971849  3124 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.971966  3246 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.973825 32108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:28.974478 32108 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:28.940687  3144 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.974846 32108 raft_consensus.cc:614] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:28.974974  3144 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:28.975759  3404 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:28.975937 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:28.976526 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1805) took 1092 ms. Trace:
I20260709 12:23:28.977020 31570 rpcz_store.cc:276] 0709 12:23:27.859021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.859211 (+   190us) service_pool.cc:224] Handling call
0709 12:23:28.950929 (+1091718us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b5400251cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:28.951068 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216751872}
I20260709 12:23:28.803681  3125 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.913077  3177 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:28.975001 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:28.949193 32112 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:28.812156  3395 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.905865  3352 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.933528  3338 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:28.967818 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:29.080739 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 112969us
I20260709 12:23:29.081933 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:28.924464 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 270075us
I20260709 12:23:29.083243 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:28.971076  3347 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:28.878661  2939 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:28.941222 31387 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:29.095814 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 154660us
I20260709 12:23:28.802685  3368 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.977015 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.032945 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:28.917328  3090 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.968300 31565 rpcz_store.cc:276] 0709 12:23:27.832075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.832254 (+   179us) service_pool.cc:224] Handling call
0709 12:23:27.832593 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:27.846740 (+ 14147us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:27.881232 (+ 34492us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.036577 (+155345us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:28.054783 (+ 18206us) log.cc:844] Serialized 52 byte log entry
0709 12:23:28.054916 (+   133us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:28.055112 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.055307 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.055385 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.747563 (+692178us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18004352e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:28.967643 (+220080us) raft_consensus.cc:1685] finished
0709 12:23:28.967663 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:28.967802 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18658,"prepare.queue_time_us":34843,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":5206,"raft.queue_time_us":29205,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":38912,"spinlock_wait_cycles":3690880,"thread_start_us":133393,"threads_started":1,"wal-append.queue_time_us":177212}
I20260709 12:23:28.945134  3346 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:29.103907 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 165945us
I20260709 12:23:29.044143 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.071388  3376 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:28.938337  3390 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:28.937610  3293 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:28.912999  3327 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.076253 32106 raft_consensus.cc:2368] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:28.933962  3385 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.028647  3366 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.035173  3401 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:28.981179  3383 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.916929  3396 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:28.955147  3393 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.096714 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:29.100014 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 161423us
I20260709 12:23:29.101598 32108 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:29.071841  3252 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:28.971997 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.108621 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:28.979128  3394 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:29.119266 31573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.012s	sys 0.028s
I20260709 12:23:29.123893 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:29.133323 31573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.012s	sys 0.028s
I20260709 12:23:29.125437 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:29.104892  3364 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.129587 32114 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:29.116212  3338 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:29.132558 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.116043  3368 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.149261 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:29.150655 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:29.122200  3400 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.139739 31568 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:29.140251 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.142903 31491 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:29.143126  3406 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.041671  2797 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:23:29.120541  3293 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.145048  3347 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.145609  3184 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.132005  3401 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.146850  3396 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.146965  3064 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.100601  3354 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:23:29.151876 32105 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:29.124142  3353 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:29.162978 31495 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:29.163781 31537 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:29.135852  3356 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.002s
W20260709 12:23:29.185237 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76661.9us
I20260709 12:23:29.187021 32111 raft_consensus.cc:2376] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14. Re-sending same reply.
I20260709 12:23:29.185652 32108 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:29.146145  3415 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:29.082613  3294 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.133730  3252 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.148303  3366 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.206450 32114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:29.215058 32114 raft_consensus.cc:606] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:29.162158  3406 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.120927  3346 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.119053  3376 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.191761  3293 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.208282  3416 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:23:29.119457  3177 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.201670  3401 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:29.201505  3338 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.204154  3347 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.210107  3353 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:29.232002 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81445.3us
I20260709 12:23:29.214067  3252 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.211053  3415 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:29.230965 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67300.2us
I20260709 12:23:29.213394  3386 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.218726  3406 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.242941 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.245652 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:29.247656  3392 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.247798  3352 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:29.115245  3206 consensus_queue.cc:1175] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0065979e5b9a477f8abf064563426291" responder_term: 10 status { last_received { term: 9 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:29.232453  3347 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.238368  3353 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.229691  3260 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.249173  3419 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:29.214547  3356 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.232297  3191 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.200910  3184 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.239908  3415 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:29.184618  3400 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.260855  3177 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.231644  3354 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:29.244154  3239 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.267874  3064 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.267594  3338 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:29.321688  3191 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:23:29.237105  3390 consensus_queue.cc:1175] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8553a13b444649b9a19e5488aabaf1c5" responder_term: 12 status { last_received { term: 11 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:29.294695  3347 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:29.324749 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 195763us
I20260709 12:23:29.300187  3419 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:29.336578 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 93710.4us
I20260709 12:23:29.267377  2797 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:29.354496 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 230949us
I20260709 12:23:29.303164  3260 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:29.355230 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 258620us
I20260709 12:23:29.309700  3438 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.358234  3090 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.356353  3395 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.376096 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:29.377383 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:29.365784  3239 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.363261  3191 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:29.401124 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:29.400059  3090 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.401103  3394 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.408339  3191 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:29.407516  3239 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.402181  3438 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.427452  3428 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.428635  3437 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.429212  3422 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.429566  3421 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:29.410825  3395 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:29.430812  3431 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:23:29.433349  3424 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:23:29.433672  3425 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:23:29.433971  3430 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:29.435606  3362 consensus_meta.cc:287] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.069s	user 0.011s	sys 0.000s
I20260709 12:23:29.435899  3419 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.437621  3417 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.397123  2797 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.448562  3180 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.452553 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.448998  3435 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:29.439954  3090 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:29.481443  3348 consensus_meta.cc:287] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.876s	user 0.009s	sys 0.000s
I20260709 12:23:29.464524  3395 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.483002  3239 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.485335  3090 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.487150  3438 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.439622  3246 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.492051  3246 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.492200  3380 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.492660  3246 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:29.495424 31417 raft_consensus.cc:2368] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
W20260709 12:23:29.496874  3144 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 12:23:29.497756  3144 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.499861  3144 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.500219  2797 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.500938  3395 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.503820  3356 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.452631  3422 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.506345  3422 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.449347  3385 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.460299  3426 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:29.447638  3394 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.459100  3421 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.449759 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:29.534837 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.481892  3348 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.450754  3428 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:29.455427  3437 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.465262  3400 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.472039  3430 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.467499  3346 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.513661  3184 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.518085  3180 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.549371  3180 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.519524 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.550102 31494 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:29.468569  3362 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.551438 32114 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:29.552469  3362 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:29.526947  3414 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.400s	user 0.000s	sys 0.002s
W20260709 12:23:29.532008 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.535642 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:29.535718 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 134943us
W20260709 12:23:29.510481  3319 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.000s
I20260709 12:23:29.556128  3319 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:29.564390  3421 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.570379  3319 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:29.570937  3319 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.572932  3319 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.576298  3430 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.576571  3177 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:29.577292  3177 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.580585  3177 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.536468  3426 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.538545  3394 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.510529  3252 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.550580  3347 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.586603  3366 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.643031 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.589279  3426 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:29.598469  3427 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:29.644503 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.645149 31415 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:29.604352  3437 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.594206  3393 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.646973 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.606781  3394 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.607326  3428 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.652120  3393 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.654521  3401 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.608117 32111 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:29.656651  3401 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:29.661697 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 207537us
W20260709 12:23:29.662339  3367 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.539s	user 0.000s	sys 0.011s
I20260709 12:23:29.663687 31500 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:29.663834 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1797) took 1940 ms. Trace:
W20260709 12:23:29.665216  3411 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.591s	user 0.001s	sys 0.000s
I20260709 12:23:29.664270 31496 rpcz_store.cc:276] 0709 12:23:27.723680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.723799 (+   119us) service_pool.cc:224] Handling call
0709 12:23:27.724157 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:27.811526 (+ 87369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.811568 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:27.812051 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:23:28.008045 (+195994us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:28.008096 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.577661 (+569565us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b54002927d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:28.577729 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.661693 (+1083964us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:29.663580 (+  1887us) raft_consensus.cc:1685] finished
0709 12:23:29.663609 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.663755 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":358,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":204193408,"thread_start_us":195557,"threads_started":1,"wal-append.queue_time_us":235429}
I20260709 12:23:29.669345 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.670018 31491 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:29.671190  3419 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.672605 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.677181  3260 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.680595  3125 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.682832 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1729) took 1023 ms. Trace:
I20260709 12:23:29.682634 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.683297 31498 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:29.683244 31417 rpcz_store.cc:276] 0709 12:23:28.659123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.660026 (+   903us) service_pool.cc:224] Handling call
0709 12:23:29.682636 (+1022610us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b5400212fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:29.682777 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908930816}
I20260709 12:23:29.683848 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.618268  3327 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.684607 31496 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
W20260709 12:23:29.620095  3318 consensus_meta.cc:287] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.677s	user 0.004s	sys 0.005s
I20260709 12:23:29.685362 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.685781 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1809) took 1397 ms. Trace:
I20260709 12:23:29.685482  3318 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.621344  3348 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.686149 31569 rpcz_store.cc:276] 0709 12:23:28.288302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.288447 (+   145us) service_pool.cc:224] Handling call
0709 12:23:29.685610 (+1397163us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400319554. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:29.685728 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3103765888}
I20260709 12:23:29.688482  3318 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:29.621433  3248 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.057s	user 0.004s	sys 0.007s
I20260709 12:23:29.689417  3248 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.691960  3413 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:29.692267  3248 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.692414  3413 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:29.623915  3368 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.693325  3413 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.693835  3368 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.696316  3368 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.696952  3368 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.697494  3368 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.624401  3376 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.625891  3383 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.700413 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.700583 31497 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:29.702239  3047 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.702440  3383 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.632906  3347 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.703428  3431 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:29.703945  3431 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.704596  3368 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.705974  3431 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.706878 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:29.734562 31567 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:29.708200  3246 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.708480 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:29.735901 31574 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:29.735798  3246 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.738490  3246 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.743965 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.744855  3246 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.745409  3246 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.745826  3246 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.746114 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.710100 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.748000 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.710582 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2768) took 1681 ms. Trace:
W20260709 12:23:29.712078 32106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 797) took 1365 ms (client timeout 1515 ms). Trace:
W20260709 12:23:29.751830 32106 rpcz_store.cc:269] 0709 12:23:28.346399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.346946 (+   547us) service_pool.cc:224] Handling call
0709 12:23:29.711870 (+1364924us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540058eb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:29.712005 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501835520}
I20260709 12:23:29.751736 31573 rpcz_store.cc:276] 0709 12:23:28.028968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.029761 (+   793us) service_pool.cc:224] Handling call
0709 12:23:28.049307 (+ 19546us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:29.133700 (+1084393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.133732 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:29.137256 (+  3524us) log.cc:844] Serialized 624 byte log entry
0709 12:23:29.354517 (+217261us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:29.409948 (+ 55431us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.534025 (+124077us) log.cc:844] Serialized 14 byte log entry
0709 12:23:29.690570 (+156545us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180025a500. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:23:29.710178 (+ 19608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.710268 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:29.710381 (+   113us) raft_consensus.cc:1685] finished
0709 12:23:29.710405 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.710530 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260580,"prepare.queue_time_us":74777,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":332363,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":8328,"spinlock_wait_cycles":5645568,"thread_start_us":975697,"threads_started":3,"wal-append.queue_time_us":189067}
W20260709 12:23:29.712931 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50554.1us
I20260709 12:23:29.754261 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:29.755085  3431 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:29.755545  3431 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.756014  3431 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.757390 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.758136 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.713416  3435 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:29.714005  3410 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.591s	user 0.001s	sys 0.000s
I20260709 12:23:29.714792  3352 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:29.715603 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.760452 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.761168 31422 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 6.
I20260709 12:23:29.761484 31493 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:29.762192 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:29.762794 31422 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.762398 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.716173  3364 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.718075 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:29.719493 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1660) took 1017 ms. Trace:
I20260709 12:23:29.763711  3364 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.764205 31497 rpcz_store.cc:276] 0709 12:23:28.702621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.702766 (+   145us) service_pool.cc:224] Handling call
0709 12:23:29.719308 (+1016542us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54002e7a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:29.719412 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275816832}
I20260709 12:23:29.763458 31493 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:29.765925  3364 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.719394 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:29.720932 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:29.721771 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:29.723605 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.767690 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.768169 31569 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:29.768528 31498 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 8: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:29.724481 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.768769  3444 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:23:29.768266 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44748.1us
I20260709 12:23:29.767730 31571 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.634917  3191 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.635502  3353 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.772091  3353 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.635816  3293 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.773679  3191 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.769188 31421 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:29.774852  3293 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.775538 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.777295 32106 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:29.636368  3406 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.640823 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.778365 31416 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:29.778625 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:29.779222 32112 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:29.779479 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.780078 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:29.781059 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.769200  3444 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.641111 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.781695 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:29.782199 31420 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:29.783030 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:29.783396 31387 leader_election.cc:400] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:29.783742 31387 leader_election.cc:403] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:29.623242  3349 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.824s	user 0.018s	sys 0.004s
I20260709 12:23:29.641605 31423 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:29.637650 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:29.785501 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1711) took 2825 ms. Trace:
W20260709 12:23:29.633392 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.709787  3181 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.772117  3412 raft_consensus.cc:993] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:29.778311 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.780006 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.609316  3252 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.612331  3415 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.635179  3417 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.783627 32110 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.728839 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.729068  3413 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.733251 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.779981  3406 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:29.754115  3246 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.786199 32112 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:29.875341 31496 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.856062 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.876840 31499 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.870380 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.878575 31497 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:29.786144  3444 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:29.879529 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:29.880641 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.881265 31497 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:29.883519 31496 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:29.884440 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.885097 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.885819 31497 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:29.853571 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 76028us
I20260709 12:23:29.887238 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:29.886070 31496 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:23:29.887933  3368 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.888679 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:29.889267  3383 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:29.889348  3412 raft_consensus.cc:1081] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:29.889791  3392 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.810251  3124 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:29.890197  3376 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index 2 to 7, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:29.891206  3124 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.891296  3181 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.893324  3124 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.894085  3181 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.888542  3368 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:29.895201  3246 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.896387  3368 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.890211  3392 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.897373  3392 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:29.898085 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 114833us
I20260709 12:23:29.787989 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.900178 31500 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.901467 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:29.903632  3246 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:29.786146 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.910466 31419 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:29.911898 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.810166 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.913022 32106 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:29.913136  3248 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:29.913671  3248 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:29.914742  3248 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.915933 31491 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:29.916360 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.917482  3252 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:29.917862  3252 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.918179  3252 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:29.920159 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:29.921129  3047 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:29.922616 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:29.928016 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:29.931802 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.936242 32110 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:29.938473 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.940008 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:29.925060 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:29.941069 32111 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.961339 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:29.940863 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:29.943646 32105 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.034s	sys 0.022s
I20260709 12:23:29.979640 31571 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:29.985347 32105 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.034s	sys 0.022s
I20260709 12:23:29.980510  3181 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:29.982936 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45594.6us
I20260709 12:23:29.986048  3181 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:29.898437 31422 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:29.991171 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:29.990862  3181 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:29.984349 31568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
W20260709 12:23:29.983935 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47744.9us
I20260709 12:23:29.984412  3401 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.992571 31568 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:29.983939  3419 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:29.993006 31568 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:29.983031 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44675.6us
I20260709 12:23:29.992844 31466 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:29.995905 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:29.994740 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:30.000607 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:29.993765  3364 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:30.004855  3364 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:30.005205  3364 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:30.006291 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 877) took 1032 ms. Trace:
I20260709 12:23:30.008544 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:29.928220  3383 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.011839 31540 leader_election.cc:400] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:30.013532 31500 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:30.016243 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.017925 32111 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:30.005875  3252 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.013826 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:30.033167 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:30.033938 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.035900 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.011384  3361 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:30.024290 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.009291 32105 rpcz_store.cc:276] 0709 12:23:28.974021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.208377 (+234356us) service_pool.cc:224] Handling call
0709 12:23:29.216071 (+  7694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.218079 (+  2008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.218120 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.233497 (+ 15377us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.371227 (+137730us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:29.985892 (+614665us) log.cc:844] Serialized 14 byte log entry
0709 12:23:30.005935 (+ 20043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.006017 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.006081 (+    64us) raft_consensus.cc:1685] finished
0709 12:23:30.006093 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.006221 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23235,"prepare.queue_time_us":42672,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":20818,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7636,"thread_start_us":697778,"threads_started":2,"wal-append.queue_time_us":178733}
I20260709 12:23:30.040198 31500 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:30.042001 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:29.993639  3347 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:30.026372 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:30.043869 31496 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:30.007953  3125 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:30.036170 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.050042 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:30.011118  3370 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.020764 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:30.054103 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.028182 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:30.055074 31571 raft_consensus.cc:2368] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:30.042918 31574 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:29.993255  3419 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.021469  3383 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.046695 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.050936 31492 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:30.051578 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.052845 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.048350 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.042115 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:30.023857  2797 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:30.054031 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.058079 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.030937  3191 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.001163  3401 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.068681 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:30.069684 31566 raft_consensus.cc:2368] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:30.057514 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.020308  3417 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:30.072448 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.035691 31495 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:30.071604 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:30.069519 31422 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:30.073967 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.062286 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.068351 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:30.006299  3392 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.038540  3353 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:30.050522  3377 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:30.038066  3010 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:30.040004  3361 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.063622 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.101713 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.102258 31574 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:30.024222  3413 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:30.084981 32105 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:30.106982 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.084597 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.088016 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.031025  3428 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:23:30.069499  3378 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:30.053740  3405 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.064417 31573 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:30.094159 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.096194 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.084651  3260 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.098289 32112 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:30.097476 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:30.094630  3177 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.058982  3441 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:30.053143  3415 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:30.101634 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.095183  3353 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:30.065349  3383 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.070300  3246 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:30.064352  3406 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:30.054003  3370 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.114046  3293 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:30.113364  3405 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.111430 31566 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:30.111392 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.113348 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:30.115872  3260 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:30.114018 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.094688  3377 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.164431 31572 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:30.099895 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.117473 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.121696  3378 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:30.063510  3403 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
W20260709 12:23:30.123221 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54968.4us
I20260709 12:23:30.055986  3181 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.129172  3353 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:30.125129 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:30.127508 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.109268  3248 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:30.072098  3191 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.130481 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.131616 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.132365 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.107211 31390 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.110044 31569 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:30.138248 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.141333 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.163580 32114 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:30.130421  3441 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:30.135385  3370 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.120987 31496 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:30.166059 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.101171  3368 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:23:30.106389  3361 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:30.142508  3405 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:30.213042 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 105920us
I20260709 12:23:30.182934 31422 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:30.191980 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.165512 31495 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:30.165166  3293 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:30.164876  3260 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.200637 31566 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
I20260709 12:23:30.138986  3246 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:30.200062 31571 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:30.215390 31572 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:30.125434  3177 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.166553  3377 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:30.220571 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.178853  3181 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.225982 31496 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:30.226305 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.227095 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.229173 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.223179 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:30.229852 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.229949 31573 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 6: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:30.230002 31495 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.135484  3406 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.227785 31566 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:30.179821  3047 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:30.232445 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:30.232800 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:30.232525  3246 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.233466  3406 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:30.233784  3441 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.238641 31572 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:30.239957 31500 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:30.240018 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:30.209656  3248 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:30.243870  3177 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:30.219820  3428 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:30.247560 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:30.200868  3395 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:30.234959  3010 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:23:30.240844  3459 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:23:30.236801  3181 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.253279 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.259645 31496 raft_consensus.cc:2410] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:23:30.251731 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:30.232295  3047 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.261716 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:30.222692 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.262634 32108 raft_consensus.cc:2368] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:30.263480 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.264542 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:30.260457 31568 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:30.255600  3457 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:23:30.249094  3401 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:30.255972  3428 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:30.700361  3428 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.256265  3419 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:30.271922  3437 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:31.096583  3437 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.097097  3437 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:30.293215  3455 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:23:30.355773  3444 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.103729  3444 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:30.471117 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:30.491384 31318 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:30.492704 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.105401 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 740) took 1030 ms. Trace:
I20260709 12:23:31.105804 31419 rpcz_store.cc:276] 0709 12:23:30.074635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.492419 (+417784us) service_pool.cc:224] Handling call
0709 12:23:31.105338 (+612919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.106909 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.107766 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2989) took 1094 ms. Trace:
I20260709 12:23:31.108116 31419 rpcz_store.cc:276] 0709 12:23:30.013755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.106611 (+1092856us) service_pool.cc:224] Handling call
0709 12:23:31.107709 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:29.781664 31416 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:30.527031  3473 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.529282  2797 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:30.573400  3405 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.109390  3473 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.110113  3415 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:31.104789 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:30.608136 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:30.631807 31492 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 12:23:31.112058 32113 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11.
I20260709 12:23:31.112277 31492 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:31.112401 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1833) took 1253 ms. Trace:
I20260709 12:23:30.633307  3248 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.112829 31493 rpcz_store.cc:276] 0709 12:23:29.858950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.917232 (+ 58282us) service_pool.cc:224] Handling call
0709 12:23:30.607945 (+690713us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800003398. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e7290a0 00007fc11e728984 00007fc117ca36d4 00007fc117ca3662
0709 12:23:31.112302 (+504357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29604096}
I20260709 12:23:30.659940  3353 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.114491  3473 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.114898 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.115869 31493 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:31.116817 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.117161  3353 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:31.117705 31493 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:30.664055  3364 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.005s
I20260709 12:23:31.118248  3364 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.112821 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1841) took 1094 ms. Trace:
I20260709 12:23:31.119402 31492 rpcz_store.cc:276] 0709 12:23:30.018104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.049771 (+ 31667us) service_pool.cc:224] Handling call
0709 12:23:31.112759 (+1062988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.120775  3364 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:30.685361 32079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.026s	sys 0.038s
W20260709 12:23:31.121596 32079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.027s	sys 0.038s
I20260709 12:23:30.246840  3431 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:30.343658  3456 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:23:31.126246  3431 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:30.349081  3451 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:29.785864 31424 rpcz_store.cc:276] 0709 12:23:26.960460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.966811 (+  6351us) service_pool.cc:224] Handling call
0709 12:23:26.979615 (+ 12804us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:27.026926 (+ 47311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.026960 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:27.059241 (+ 32281us) log.cc:844] Serialized 52 byte log entry
0709 12:23:27.486510 (+427269us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:27.507839 (+ 21329us) log.cc:844] Serialized 14 byte log entry
0709 12:23:27.522335 (+ 14496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.522424 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:28.766333 (+1243909us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:29.622931 (+856598us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b2400181868. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc1164fc9c4 00007fc1164faacb 00007fc1166b5dc9 00007fc1166b5a55 00007fc1166b509d 00007fc1192e710e 00007fc1192fe88c 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221
0709 12:23:29.785283 (+162352us) raft_consensus.cc:1685] finished
0709 12:23:29.785304 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.785427 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33037,"prepare.queue_time_us":21100,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":82171,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2451,"spinlock_wait_cycles":97132672,"thread_start_us":412503,"threads_started":1,"wal-append.queue_time_us":685742}
I20260709 12:23:31.127933  3412 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:31.128518  3412 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.128840 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.129034  3252 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.129525 31424 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:31.129992  3412 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.130038 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2992) took 1097 ms. Trace:
W20260709 12:23:30.712638 31417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.019s	sys 0.026s
W20260709 12:23:31.130932 31417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.019s	sys 0.027s
I20260709 12:23:31.131956 31571 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:31.132165 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 728) took 1427 ms. Trace:
I20260709 12:23:30.724879 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.133105 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.133404 31569 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:31.134275 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.135177 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.136207 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:30.727535 31498 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:23:31.137158 31498 pending_rounds.cc:85] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 9
I20260709 12:23:31.137392 31498 pending_rounds.cc:107] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:23:31.137596 31498 raft_consensus.cc:2889] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:31.138187 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1834) took 1220 ms. Trace:
I20260709 12:23:30.742108 31491 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:31.138839 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1838) took 1219 ms. Trace:
I20260709 12:23:31.138404 31572 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:31.139192 31491 rpcz_store.cc:276] 0709 12:23:29.919351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.741463 (+822112us) service_pool.cc:224] Handling call
0709 12:23:30.741753 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.138587 (+396834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.138786 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:30.309450  3395 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:31.140482  3395 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:31.141724  3395 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.756290  3380 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:31.142967  3380 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:31.143978  3380 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.145541  3380 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:30.347904  3454 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:23:30.750530  3246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.008s
W20260709 12:23:31.147737  3246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.009s	sys 0.008s
I20260709 12:23:31.148543 31494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1819) took 1483 ms. Trace:
I20260709 12:23:31.148986 31494 rpcz_store.cc:276] 0709 12:23:29.665527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.666935 (+  1408us) service_pool.cc:224] Handling call
0709 12:23:29.667270 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.667634 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.667664 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.668164 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.982545 (+314381us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:29.982581 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.982660 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.148298 (+1165638us) raft_consensus.cc:1685] finished
0709 12:23:31.148322 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.148475 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1142,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":314005,"threads_started":1,"wal-append.queue_time_us":548898}
W20260709 12:23:30.764285 32111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.010s
W20260709 12:23:31.150754 32111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.003s	sys 0.010s
I20260709 12:23:30.766013  3177 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:31.151590  3177 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.154210  3177 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:30.769902  3047 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:30.782938 32077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.027s	sys 0.019s
W20260709 12:23:31.154969 32077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.028s	sys 0.020s
I20260709 12:23:31.155016 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1678) took 1280 ms. Trace:
I20260709 12:23:30.785595  3318 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.819553  3348 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:30.826323  3392 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:30.268635  3173 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:31.156394  3318 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.157157  3173 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:31.156479  3348 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.808851  3191 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:30.860723 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.159168 31423 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:31.159623 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1738) took 1259 ms. Trace:
W20260709 12:23:30.872135 31566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.009s	sys 0.003s
W20260709 12:23:31.160292 31566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.010s	sys 0.004s
I20260709 12:23:31.160121  3348 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.159905 31423 rpcz_store.cc:276] 0709 12:23:29.899881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.860399 (+960518us) service_pool.cc:224] Handling call
0709 12:23:31.159571 (+299172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:30.877702 31568 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:30.879551  3293 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.161720 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.162024 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58364 (request call id 1116) took 1224 ms. Trace:
I20260709 12:23:30.253150  3378 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.955323 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:31.155452 31496 rpcz_store.cc:276] 0709 12:23:29.874359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.268779 (+394420us) service_pool.cc:224] Handling call
0709 12:23:30.811869 (+543090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.152744 (+340875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.152780 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.152825 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.152866 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.154786 (+  1920us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54003bb854. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:31.154833 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.154956 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783395584}
I20260709 12:23:31.163477  3445 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:31.163151 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 207924us
W20260709 12:23:30.915580 31574 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
I20260709 12:23:31.165351 31574 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:31.165843 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1829) took 1094 ms. Trace:
I20260709 12:23:31.166117 31574 rpcz_store.cc:276] 0709 12:23:30.071651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.101513 (+ 29862us) service_pool.cc:224] Handling call
0709 12:23:31.165785 (+1064272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.167091 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.168074 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.168351 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:30.948184 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.002s	sys 0.002s
I20260709 12:23:31.169039 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:31.169309 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.002s	sys 0.017s
I20260709 12:23:31.169862 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1820) took 1123 ms. Trace:
I20260709 12:23:30.933140 31463 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.170143 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:30.897042 31537 leader_election.cc:400] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:31.170825 31537 leader_election.cc:403] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:31.170884 31493 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:31.171334 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 274462us
I20260709 12:23:31.173246  3392 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:30.978092 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 1839) took 1058 ms. Trace:
W20260709 12:23:30.897854 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.173991 31500 rpcz_store.cc:276] 0709 12:23:29.919617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.057980 (+138363us) service_pool.cc:224] Handling call
0709 12:23:30.977868 (+919888us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54002e5754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:30.978013 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317827968}
I20260709 12:23:31.174893  3431 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:31.177234 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 2990) took 1155 ms. Trace:
I20260709 12:23:31.177743 31422 rpcz_store.cc:276] 0709 12:23:30.022139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.241552 (+219413us) service_pool.cc:224] Handling call
0709 12:23:31.177017 (+935465us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54003edd54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.177173 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909376384}
I20260709 12:23:30.979117 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:30.885473 31567 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.815s	user 0.007s	sys 0.002s
I20260709 12:23:31.179149 31567 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:31.179706 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1818) took 1144 ms. Trace:
I20260709 12:23:31.180059 31567 rpcz_store.cc:276] 0709 12:23:30.035540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.036598 (+  1058us) service_pool.cc:224] Handling call
0709 12:23:31.179639 (+1143041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.181095  3415 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.181684  3415 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:30.973481 32114 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:30.254621  3010 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:31.184217 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 959) took 1087 ms. Trace:
I20260709 12:23:31.184803  3010 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.185825  3010 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:30.966172  3461 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.565s	user 0.005s	sys 0.000s
W20260709 12:23:30.892174  3376 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.000s	user 0.014s	sys 0.000s
W20260709 12:23:30.920485  3370 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260709 12:23:31.188602  3370 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:31.170471 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 237446us
I20260709 12:23:31.191284 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1828) took 1120 ms. Trace:
I20260709 12:23:31.191735 31571 rpcz_store.cc:276] 0709 12:23:30.071254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.224065 (+152811us) service_pool.cc:224] Handling call
0709 12:23:31.191115 (+967050us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400057154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.191213 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049612544}
I20260709 12:23:31.192175 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.192864 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.193638 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.193887 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.194833  3047 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:31.195725  3047 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:30.919552  3471 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.519s	user 0.006s	sys 0.000s
I20260709 12:23:31.196326  3047 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.197249 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 881) took 1020 ms. Trace:
I20260709 12:23:31.197588 32111 rpcz_store.cc:276] 0709 12:23:30.177209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.179148 (+  1939us) service_pool.cc:224] Handling call
0709 12:23:30.208026 (+ 28878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.214199 (+  6173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:30.214240 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.214809 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.918866 (+704057us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:31.151175 (+232309us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:31.151222 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.151296 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.196994 (+ 45698us) raft_consensus.cc:1685] finished
0709 12:23:31.197013 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.197195 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":684210,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1064409472,"thread_start_us":904705,"threads_started":1,"wal-append.queue_time_us":164066}
I20260709 12:23:31.170157 31570 rpcz_store.cc:276] 0709 12:23:30.046495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.046691 (+   196us) service_pool.cc:224] Handling call
0709 12:23:30.047058 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:30.047310 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:30.069495 (+ 22185us) log.cc:844] Serialized 14 byte log entry
0709 12:23:30.935762 (+866267us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:31.169587 (+233825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.169633 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:31.169674 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.169730 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.169816 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10892,"prepare.queue_time_us":17445,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":39,"raft.queue_time_us":16549,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":9170,"spinlock_wait_cycles":1154758016,"thread_start_us":1086968,"threads_started":2,"wal-append.queue_time_us":290900}
W20260709 12:23:30.963753  3465 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.600s	user 0.003s	sys 0.002s
W20260709 12:23:30.936352  3462 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.573s	user 0.002s	sys 0.002s
W20260709 12:23:30.890131  3361 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.003s
I20260709 12:23:30.901978  3467 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:30.875871  3477 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:31.184624 32113 rpcz_store.cc:276] 0709 12:23:30.097121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.097243 (+   122us) service_pool.cc:224] Handling call
0709 12:23:31.184019 (+1086776us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54003f98d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.184159 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292417920}
I20260709 12:23:31.201123  3361 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.201588  3477 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.202188 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:31.203660  3477 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.203959  3361 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:30.897292  3327 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.032611 32108 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:31.028643  3347 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:31.205793  3412 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.903055  3464 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:31.206310  3412 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.207024  3464 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.207582 32108 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:23:30.903657  3470 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:30.888288  3377 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
W20260709 12:23:31.046918 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 151116us
I20260709 12:23:31.213495 31389 leader_election.cc:400] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:31.214776 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:30.959802  3368 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:31.058830  3441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.013s	sys 0.032s
I20260709 12:23:31.066663  3413 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:31.066330  3458 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.931s	user 0.003s	sys 0.001s
W20260709 12:23:31.079824 31573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.002s	sys 0.000s
W20260709 12:23:31.223575 31573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.003s	sys 0.000s
I20260709 12:23:31.085345  3478 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:31.088007  3468 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.687s	user 0.000s	sys 0.003s
I20260709 12:23:31.088521  3486 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:31.086336  3463 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.723s	user 0.002s	sys 0.002s
I20260709 12:23:31.109297 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1734) took 1334 ms. Trace:
I20260709 12:23:31.111208 32107 raft_consensus.cc:2368] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7.
I20260709 12:23:31.111336  3405 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:29.786774 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:30.661350  3383 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.006s
I20260709 12:23:31.140312 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.158066  3173 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:30.855072  3181 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.235818  3473 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:23:31.217224  3470 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.287917  3318 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.252457  3383 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.294544 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 812) took 1513 ms. Trace:
I20260709 12:23:31.245532  3486 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.297267  3383 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.297636  3486 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.181061 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.288403 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1823) took 1235 ms. Trace:
I20260709 12:23:31.298494 31567 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:31.299504 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.298605 31565 rpcz_store.cc:276] 0709 12:23:30.052782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.052927 (+   145us) service_pool.cc:224] Handling call
0709 12:23:30.053249 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:30.053604 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:30.053643 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.063940 (+ 10297us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.236483 (+172543us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:30.236531 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.236591 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.085562 (+848971us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:31.288001 (+202439us) raft_consensus.cc:1685] finished
0709 12:23:31.288032 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.288321 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4405,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7644,"spinlock_wait_cycles":1142826752,"thread_start_us":135640,"threads_started":1,"wal-append.queue_time_us":261295}
I20260709 12:23:31.300747 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:30.882869  3260 consensus_meta.cc:287] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.647s	user 0.003s	sys 0.008s
I20260709 12:23:31.200742 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.201272  3467 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.162371 31568 rpcz_store.cc:276] 0709 12:23:29.938107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.939339 (+  1232us) service_pool.cc:224] Handling call
0709 12:23:31.161943 (+1222604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.204557  3327 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:30.916795 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.169039 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.308301 31574 raft_consensus.cc:2368] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
W20260709 12:23:31.179708 32106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.043s	sys 0.044s
W20260709 12:23:31.309113 32106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.044s	sys 0.044s
I20260709 12:23:31.138455 31498 rpcz_store.cc:276] 0709 12:23:29.917937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.726811 (+808874us) service_pool.cc:224] Handling call
0709 12:23:30.727122 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.137981 (+410859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.138140 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.310339 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.130503 31424 rpcz_store.cc:276] 0709 12:23:30.032802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.128557 (+1095755us) service_pool.cc:224] Handling call
0709 12:23:31.129984 (+  1427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.211829 31493 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:31.223213  3413 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:31.132620 31417 rpcz_store.cc:276] 0709 12:23:29.705178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.714034 (+  8856us) service_pool.cc:224] Handling call
0709 12:23:29.714372 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:29.714756 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.714785 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:29.715342 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 12:23:31.131332 (+1415990us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.131614 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.131839 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.131909 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.131950 (+    41us) raft_consensus.cc:1685] finished
0709 12:23:31.131962 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.132108 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5158,"prepare.run_cpu_time_us":231,"prepare.run_wall_time_us":230,"raft.queue_time_us":4485,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":157,"thread_start_us":1415628,"threads_started":1,"wal-append.queue_time_us":416231}
I20260709 12:23:31.216475 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.217165  3364 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:31.316236 31421 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1737) took 1540 ms (client timeout 1745 ms). Trace:
I20260709 12:23:31.210842  3246 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:31.217334  3191 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.219357  3401 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.206211  3347 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:31.325500 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 235999us
I20260709 12:23:31.327522 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.194582 31571 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:31.221989 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.236230 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.236725 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.211189  3353 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.238453 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:31.223052  3441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.013s	sys 0.033s
I20260709 12:23:31.246299 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.245952 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1731) took 1471 ms. Trace:
I20260709 12:23:31.251464 31463 leader_election.cc:400] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11.
I20260709 12:23:31.306799  3260 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.230698  3368 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.343451 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.344404 31417 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 6.
I20260709 12:23:31.345127 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1735) took 1569 ms. Trace:
I20260709 12:23:31.345557 31417 rpcz_store.cc:276] 0709 12:23:29.775586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.320062 (+1544476us) service_pool.cc:224] Handling call
0709 12:23:31.345046 (+ 24984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.348080 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.349684 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.296170 32109 rpcz_store.cc:276] 0709 12:23:29.780525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.780635 (+   110us) service_pool.cc:224] Handling call
0709 12:23:29.780941 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.782651 (+  1710us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:29.782980 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:23:30.071767 (+288787us) log.cc:844] Serialized 14 byte log entry
0709 12:23:30.072552 (+   785us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:30.084506 (+ 11954us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.084668 (+   162us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:30.084714 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:30.084800 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.779957 (+695157us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b18001fcea0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:31.056819 (+276862us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18001fcea0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116676522 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:31.065359 (+  8540us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:31.294109 (+228750us) raft_consensus.cc:1685] finished
0709 12:23:31.294140 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.294318 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134260,"prepare.queue_time_us":6876,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":34542,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":7982,"spinlock_wait_cycles":40309248,"thread_start_us":249388,"threads_started":1,"wal-append.queue_time_us":329070}
I20260709 12:23:31.243214 31318 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 1 to 9, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 9 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.300663 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.162465 31423 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:31.354526 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 744) took 1227 ms. Trace:
I20260709 12:23:31.355057 31423 rpcz_store.cc:276] 0709 12:23:30.128971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.161432 (+1032461us) service_pool.cc:224] Handling call
0709 12:23:31.354451 (+193019us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:31.275204 32107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 813) took 1493 ms (client timeout 1880 ms). Trace:
I20260709 12:23:31.301788 31499 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:31.242312 31416 rpcz_store.cc:276] 0709 12:23:29.775319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.780859 (+  5540us) service_pool.cc:224] Handling call
0709 12:23:31.109214 (+1328355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.302110 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:30.880491 31495 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.004s
I20260709 12:23:31.356813 31495 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:31.199725 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:31.288229 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.304759  3464 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.313030 31419 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:31.332527  3494 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:31.310964 31572 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:31.318418 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:31.364985 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.320353 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 817) took 1401 ms. Trace:
I20260709 12:23:31.365721 31570 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:31.365679 32106 rpcz_store.cc:276] 0709 12:23:29.919712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.980461 (+ 60749us) service_pool.cc:224] Handling call
0709 12:23:29.980815 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.981180 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.981207 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.993865 (+ 12658us) log.cc:844] Serialized 26 byte log entry
0709 12:23:30.965495 (+971630us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:31.309668 (+344173us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.309726 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.309811 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.309864 (+    53us) raft_consensus.cc:1685] finished
0709 12:23:31.309880 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.320285 (+ 10405us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8953,"raft.queue_time_us":2719,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3966,"spinlock_wait_cycles":1065265408,"thread_start_us":1270461,"threads_started":1,"wal-append.queue_time_us":374113}
W20260709 12:23:31.316684 31421 rpcz_store.cc:269] 0709 12:23:29.776095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.776549 (+   454us) service_pool.cc:224] Handling call
0709 12:23:31.316165 (+1539616us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:31.324162 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 255534us
I20260709 12:23:31.367911 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.368438 31571 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:31.361476 31318 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 9 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.368611 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.369498 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.365360 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1845) took 1116 ms. Trace:
I20260709 12:23:31.370184 31424 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:31.302740  3416 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:31.242030  3395 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.312053 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.377410 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.377777 31493 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:31.245290  3477 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:31.336462 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98125.9us
I20260709 12:23:31.337365 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1736) took 1561 ms. Trace:
I20260709 12:23:31.378708 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:31.275426  3248 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:31.275570  3428 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.294938  3370 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.339169 31463 leader_election.cc:403] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:31.295414 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1826) took 1234 ms. Trace:
W20260709 12:23:31.386343 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 142115us
I20260709 12:23:31.339078 31420 rpcz_store.cc:276] 0709 12:23:29.774536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.786531 (+ 11995us) service_pool.cc:224] Handling call
0709 12:23:31.245893 (+1459362us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:31.342549 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 96318.2us
I20260709 12:23:31.221086  3377 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.358740 32079 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.357283 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 812) took 1266 ms. Trace:
I20260709 12:23:31.348986 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:31.361114  3474 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:31.316653  3445 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.310650 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:31.357419 32107 rpcz_store.cc:269] 0709 12:23:29.781337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.781465 (+   128us) service_pool.cc:224] Handling call
0709 12:23:31.253150 (+1471685us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400631fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.275130 (+ 21980us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055635840}
I20260709 12:23:31.363088 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.363976 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.369984 31569 rpcz_store.cc:276] 0709 12:23:30.249076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.724482 (+475406us) service_pool.cc:224] Handling call
0709 12:23:31.365313 (+640831us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.371702 31570 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:31.245182  3177 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.224596 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.302487  2939 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:23:31.358026 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef100 after lost signal to thread 30274
I20260709 12:23:31.338039  3401 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.375973 32105 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:31.379087 31422 rpcz_store.cc:276] 0709 12:23:29.775820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.178535 (+1402715us) service_pool.cc:224] Handling call
0709 12:23:31.337280 (+158745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.380628  3392 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:31.384840 31415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 734) took 1667 ms (client timeout 1853 ms). Trace:
I20260709 12:23:31.385398 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.388700 31389 leader_election.cc:400] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:31.352573  3353 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:31.434962 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46399.9us
I20260709 12:23:31.415832 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.436214 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:31.388826 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.432644 31571 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:31.381206 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.392838 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.443899 32114 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 7.
I20260709 12:23:31.445030 32114 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:31.356622 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:31.390789 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.390635 31318 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:31.434324 31415 rpcz_store.cc:269] 0709 12:23:29.717794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:29.747748 (+ 29954us) service_pool.cc:224] Handling call
0709 12:23:31.369472 (+1621724us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400232154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.384781 (+ 15309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3710017408}
I20260709 12:23:31.242336  3478 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.391786 31495 rpcz_store.cc:276] 0709 12:23:30.091269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.222883 (+131614us) service_pool.cc:224] Handling call
0709 12:23:31.357222 (+1134339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.397953 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.381925  3426 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.395210  3469 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:31.368610  3482 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:31.332758  3246 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.325335  3364 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.382277  3419 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.386579 31566 rpcz_store.cc:276] 0709 12:23:30.062346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.231887 (+169541us) service_pool.cc:224] Handling call
0709 12:23:30.235224 (+  3337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:31.062362 (+827138us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b48001302d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:23:31.160757 (+ 98395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.160805 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:31.161338 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 12:23:31.209294 (+ 47956us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.234663 (+ 25369us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.293575 (+ 58912us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800181ae0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11d15b3c7 00007fc11976d9a7 00007fc11977d0bf 00007fc11977d038
0709 12:23:31.293845 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.295113 (+  1268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.295191 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.295234 (+    43us) raft_consensus.cc:1685] finished
0709 12:23:31.295244 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.295359 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15291,"prepare.queue_time_us":97463,"prepare.run_cpu_time_us":5640,"prepare.run_wall_time_us":22922,"raft.queue_time_us":17432,"raft.run_cpu_time_us":11478,"raft.run_wall_time_us":816115,"spinlock_wait_cycles":14656640,"thread_start_us":966141,"threads_started":2,"wal-append.queue_time_us":29407}
I20260709 12:23:31.433040 32110 raft_consensus.cc:2368] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:31.398748 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:31.448990 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7fc0 after lost signal to thread 31356
W20260709 12:23:31.488581 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa5c0 after lost signal to thread 31449
I20260709 12:23:31.451356 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.347342  3191 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.447194 31318 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 6 to 9, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.403746 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:31.489627 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1aa0 after lost signal to thread 31450
I20260709 12:23:31.385076  3472 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:31.454281 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 73424us
I20260709 12:23:31.458952 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:31.490746 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800392b60 after lost signal to thread 31524
I20260709 12:23:31.490906 31422 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:31.491096 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800261de0 after lost signal to thread 31525
I20260709 12:23:31.489274 31424 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:31.397768  3435 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:23:31.459697 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.396106  3491 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.394577  3464 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:31.462996 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.454403  3370 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.457000  3469 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.472441 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:31.472396 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 83150.1us
I20260709 12:23:31.483484 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.485975 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 733) took 1779 ms. Trace:
I20260709 12:23:31.512601 31416 rpcz_store.cc:276] 0709 12:23:29.706659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.461523 (+1754864us) service_pool.cc:224] Handling call
0709 12:23:31.485473 (+ 23950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.485645 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.485670 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.485712 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:31.485750 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.485805 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.485916 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.433516  3177 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.470852 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.492960 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 738) took 1420 ms. Trace:
I20260709 12:23:31.516670 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 737) took 1449 ms. Trace:
I20260709 12:23:31.517174 31421 rpcz_store.cc:276] 0709 12:23:30.072458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.449619 (+1377161us) service_pool.cc:224] Handling call
0709 12:23:31.516613 (+ 66994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.497087 31419 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:31.468529 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 883) took 1228 ms. Trace:
I20260709 12:23:31.518594 32105 rpcz_store.cc:276] 0709 12:23:30.240211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.240413 (+   202us) service_pool.cc:224] Handling call
0709 12:23:30.244222 (+  3809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.432840 (+1188618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.468263 (+ 35423us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540049e654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:31.468470 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2602433280}
I20260709 12:23:31.394840  3477 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:31.504395 32110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 957) took 1409 ms (client timeout 1545 ms). Trace:
I20260709 12:23:31.385700  3413 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.521425 31318 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 6 to 9, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 9 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.523138 31567 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:31.508353 31420 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:31.516507 31424 rpcz_store.cc:276] 0709 12:23:30.072783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.492241 (+1419458us) service_pool.cc:224] Handling call
0709 12:23:31.492517 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.492674 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.492698 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.492736 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:31.492770 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.492820 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.492912 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:31.494397 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3c60 after lost signal to thread 31599
I20260709 12:23:31.498920 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:31.520524 32110 rpcz_store.cc:269] 0709 12:23:30.095359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.095510 (+   151us) service_pool.cc:224] Handling call
0709 12:23:31.504151 (+1408641us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400520154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.504323 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2967975296}
W20260709 12:23:31.526079 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef540 after lost signal to thread 31600
I20260709 12:23:31.526131 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 742) took 1417 ms. Trace:
I20260709 12:23:31.526769 31417 rpcz_store.cc:276] 0709 12:23:30.108953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.502397 (+1393444us) service_pool.cc:224] Handling call
0709 12:23:31.525542 (+ 23145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.525735 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.525766 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.525831 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:31.525870 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.525955 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.526077 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.451025  3392 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:31.527593 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800414d00 after lost signal to thread 32138
W20260709 12:23:31.531900 31445 debug-util.cc:398] Leaking SignalData structure 0x7b080032bd80 after lost signal to thread 32139
W20260709 12:23:31.532425 31445 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff960 after lost signal to thread 3090
W20260709 12:23:31.532850 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800378840 after lost signal to thread 3206
W20260709 12:23:31.533396 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800199840 after lost signal to thread 3354
W20260709 12:23:31.533677 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800337140 after lost signal to thread 3366
W20260709 12:23:31.534013 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800388880 after lost signal to thread 3382
W20260709 12:23:31.534248 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800320b40 after lost signal to thread 3385
I20260709 12:23:31.456212  3437 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.537256 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 743) took 1414 ms. Trace:
I20260709 12:23:31.537696 31423 rpcz_store.cc:276] 0709 12:23:30.122750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.512394 (+1389644us) service_pool.cc:224] Handling call
0709 12:23:31.536726 (+ 24332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.536913 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.536939 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.536986 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.537020 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.537074 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.537170 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.528425 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2991) took 1499 ms. Trace:
I20260709 12:23:31.539287 31420 rpcz_store.cc:276] 0709 12:23:30.029159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.490199 (+1461040us) service_pool.cc:224] Handling call
0709 12:23:31.508161 (+ 17962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.528068 (+ 19907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.528335 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:31.492043  3472 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.486008  3318 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:31.394588  3428 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.540926 31422 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
W20260709 12:23:31.544484 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.546530 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800340dc0 after lost signal to thread 3388
I20260709 12:23:31.463104  3426 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.540387 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:31.561518 31415 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:31.513648  3469 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:31.537312 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:31.562168 31318 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.492937  3473 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:23:31.570914 31418 raft_consensus.cc:2368] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:31.550877 31421 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:23:31.564370 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800237f80 after lost signal to thread 3396
W20260709 12:23:31.571869 31445 debug-util.cc:398] Leaking SignalData structure 0x7b0800356140 after lost signal to thread 3399
W20260709 12:23:31.572377 31445 debug-util.cc:398] Leaking SignalData structure 0x7b080038eaa0 after lost signal to thread 3422
I20260709 12:23:31.576319 31318 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 7 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.532104  3352 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:31.568995 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.577499  3464 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:31.546751  3472 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:31.579869 31322 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 300) took 35606 ms (client timeout 15000 ms). Trace:
I20260709 12:23:31.562798  3370 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.564708  2939 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:31.567108 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 215346us
I20260709 12:23:31.581534  3347 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:31.573750 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 137598us
I20260709 12:23:31.635107 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.599016 31318 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 9 to 10, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.580780  3181 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.632232 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:31.639287 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.570065  3318 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.599599  3361 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.593237  3352 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:31.647289 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.649879 31495 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:31.627298  3370 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.632382  3470 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:31.632872  3327 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.658390 31318 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:31.667536 31495 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
W20260709 12:23:31.669999 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.635413  3490 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.658974 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:31.689602 31567 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:31.643134  3047 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:31.687654 31318 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 10, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:31.701910 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:31.702699 31495 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:31.645004  3467 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:31.593169  3500 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:23:31.708676 31318 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 6 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:31.704361 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 322853us
I20260709 12:23:31.657429  3377 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.683971  3370 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.712720 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:31.744304 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.718122 31567 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:31.726110 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.693810  2939 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.738009 31318 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:31.711266  3495 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.279s	user 0.002s	sys 0.009s
W20260709 12:23:31.601126 31322 rpcz_store.cc:269] 0709 12:22:55.965077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.985644 (+ 20567us) service_pool.cc:224] Handling call
0709 12:23:31.571761 (+35586117us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:27.643437 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:27.644003 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:27.644051 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:23:27.644068 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:27.644923 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:27.644999 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:27.645025 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:27.645788 (+   763us) tablet.cc:701] Row locks acquired
0709 12:23:27.645833 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:23:27.645988 (+   155us) write_op.cc:270] Start()
0709 12:23:27.646117 (+   129us) write_op.cc:276] Timestamp: P: 1783599807645926 usec, L: 0
0709 12:23:27.646135 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:23:27.722017 (+ 75882us) log.cc:844] Serialized 3322 byte log entry
0709 12:23:28.317693 (+595676us) op_driver.cc:464] REPLICATION: finished
0709 12:23:28.704040 (+386347us) write_op.cc:301] APPLY: starting
0709 12:23:28.803309 (+ 99269us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:29.541156 (+737847us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:29.565423 (+ 24267us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:29.573572 (+  8149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:29.573946 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:23:29.573992 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:29.574318 (+   326us) log.cc:844] Serialized 81 byte log entry
0709 12:23:29.734867 (+160549us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.735001 (+   134us) write_op.cc:454] Released schema lock
0709 12:23:29.735061 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:29.751087 (+ 16026us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:29.751138 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64121,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":295003,"apply.run_cpu_time_us":19931,"apply.run_wall_time_us":1087691,"cfile_cache_hit":30,"cfile_cache_hit_bytes":31395,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":163714,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":6,"lbm_reads_lt_1ms":4,"num_ops":8,"prepare.queue_time_us":597038,"prepare.run_cpu_time_us":4270,"prepare.run_wall_time_us":103434,"replication_time_us":646953,"thread_start_us":661329,"threads_started":3,"wal-append.queue_time_us":160508,"wal-append.run_cpu_time_us":2547,"wal-append.run_wall_time_us":1120499}]]}
W20260709 12:23:31.719095 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 84102us
I20260709 12:23:31.758065 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.700882  3047 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:31.737109  3497 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 12:23:31.768046 32108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.007s
I20260709 12:23:31.707089  3464 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:31.738451  3353 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.742815  3347 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:31.787173 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.773247 31318 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:31.781538 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 391534us
I20260709 12:23:31.716573  3401 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.717255  3368 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:31.773205 32108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.007s
I20260709 12:23:31.794044  3482 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.756542  3383 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:31.794836  3352 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.743247  3478 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.795620 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.703953  3490 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.796442  3464 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.797571 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:31.797887  3498 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:23:31.756138  2939 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.795258  3392 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.769078  3047 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:31.825482 31318 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 8, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 8 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.816797  3482 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.835651 31497 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.818864  3383 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:31.830257 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 197494us
I20260709 12:23:31.832789 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.784133  3246 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:31.824762  3415 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:23:31.826150  3368 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:31.798360  3496 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:23:31.817605  3508 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:31.798733  3437 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:31.836053 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49877.6us
I20260709 12:23:31.840946  3503 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.842357 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:31.825049  3364 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:31.850668 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 106476us
I20260709 12:23:31.856478 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.853477 31318 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:31.829164  3509 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.920971 31318 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.872072 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:31.923388 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51417.3us
I20260709 12:23:31.924067  3246 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:31.922345 31318 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 7 to 10, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:31.892051 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.861397  3415 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.872783  3503 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:31.901973  3431 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.001s
W20260709 12:23:31.860999  3380 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.003s
I20260709 12:23:31.951474 31318 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 6 to 7, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.841308  2939 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:31.909409 31418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1739) took 2009 ms (client timeout 2056 ms). Trace:
I20260709 12:23:31.855221  3352 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.855829  3383 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:31.953855 31418 rpcz_store.cc:269] 0709 12:23:29.900195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.470798 (+570603us) service_pool.cc:224] Handling call
0709 12:23:31.909197 (+1438399us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540010bb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:31.909349 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072155392}
I20260709 12:23:31.915789  3318 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.916930  3428 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.916471  3472 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:31.908978  3191 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.911856 31497 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:31.858362  3327 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:31.919181 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:31.950637 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.571s (SENT) [suppressed 15 similar messages]
I20260709 12:23:31.973636 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:31.956132 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 99723.1us
I20260709 12:23:31.929219  3415 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:31.975180  3523 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:23:31.977041  3526 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.884670  3508 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:31.959172 31318 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.979377 31318 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 9 to 10, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.951277  3431 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8.
I20260709 12:23:31.961040 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.963249 31387 leader_election.cc:400] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7.
I20260709 12:23:31.990929 31424 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:31.960983 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:31.861249  3426 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.978587  3508 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:31.983897 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 65059.6us
I20260709 12:23:31.963105  3437 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.985937  3472 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:31.985700  3482 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:31.981763 31318 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.000854 31318 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:31.987850  3490 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:31.988025 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:31.989374 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.005367 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.006922 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.007946 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.008872 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.009743 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:31.990873 31387 leader_election.cc:403] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:23:32.011219 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49369.5us
I20260709 12:23:32.012075 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:31.977195 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1837) took 1864 ms. Trace:
I20260709 12:23:31.991778 31422 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:31.951418  3503 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.958581  3401 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:32.014539 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:31.995800  3395 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 12:23:32.012668 31573 rpcz_store.cc:276] 0709 12:23:30.112474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:30.234106 (+121632us) service_pool.cc:224] Handling call
0709 12:23:30.234428 (+   322us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:31.235589 (+1001161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.235629 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:31.243785 (+  8156us) log.cc:844] Serialized 78 byte log entry
0709 12:23:31.767842 (+524057us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:31.796783 (+ 28941us) log.cc:844] Serialized 14 byte log entry
0709 12:23:31.796979 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.797043 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:31.976975 (+179932us) raft_consensus.cc:1685] finished
0709 12:23:31.976995 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:31.977140 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14694,"prepare.queue_time_us":29343,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":16230,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":15149,"thread_start_us":1410261,"threads_started":2,"wal-append.queue_time_us":537953}
I20260709 12:23:32.021750 31318 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 10 to 11, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 11 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:32.028216 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:31.997946  3526 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.029125 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.029321 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.030633 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.019263  3472 raft_consensus.cc:2764] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:31.998327  3487 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:23:32.035674 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.016911  3508 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.054656 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.078229 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.014910  3435 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.021278  3415 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:32.021051  3191 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:32.084834 31318 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 3 to 8, term changed from 9 to 11, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to <none>, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:32.000471  3437 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.025209  3181 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:32.087415 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 72928.7us
I20260709 12:23:32.023756  3531 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:32.030591  3426 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:32.095649 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 145037us
I20260709 12:23:32.041224  3395 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.102550  3370 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.094339 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.094950 31318 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:32.097350  3525 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:32.098183  3010 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.912s	user 0.014s	sys 0.000s
I20260709 12:23:32.103044  3500 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.079622  3509 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.113576 31424 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:32.120169 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.089983  3191 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:32.125876 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.119756 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.134881 31422 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:32.108525  3531 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:32.151638  3531 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:32.140255  3469 consensus_meta.cc:287] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.560s	user 0.001s	sys 0.009s
I20260709 12:23:32.154300 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.142566  3437 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.041088  3526 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.119251  3500 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.166455  3525 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:32.148411  3491 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.002s
I20260709 12:23:32.167989  3491 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11.
I20260709 12:23:32.174330 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1120) took 1043 ms. Trace:
I20260709 12:23:32.175137 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1119) took 1044 ms. Trace:
I20260709 12:23:32.175331  3445 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:32.175809  3445 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.175530 31565 rpcz_store.cc:276] 0709 12:23:31.130742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.405480 (+274738us) service_pool.cc:224] Handling call
0709 12:23:31.408596 (+  3116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.471278 (+ 62682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.471311 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.471369 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:31.471405 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.174931 (+703526us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54002503d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:32.174972 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.175083 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143715072}
I20260709 12:23:32.177367 31574 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:32.178004 31574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1123) took 1046 ms. Trace:
I20260709 12:23:32.149632  3191 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.135123  3327 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:32.179244  3327 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:32.179854  3327 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.181414  3526 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.174746 31569 rpcz_store.cc:276] 0709 12:23:31.131050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.404049 (+272999us) service_pool.cc:224] Handling call
0709 12:23:31.592360 (+188311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.592523 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.592546 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.592583 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:31.592612 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:31.592660 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.174149 (+581489us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400318b50. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:32.174273 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432277888}
I20260709 12:23:32.178289 31574 rpcz_store.cc:276] 0709 12:23:31.131782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.464972 (+333190us) service_pool.cc:224] Handling call
0709 12:23:32.177022 (+712050us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5800075f98. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663eeee 000000000036eb39 00007fc11e6b21e0 00007fc11e77b0c4 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:23:32.177178 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.177763 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.177950 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7890176}
I20260709 12:23:32.184687 32110 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:32.153923  3293 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.185370  2939 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.185760 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:32.167616 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.190936  3327 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.193012  3327 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.193883  3177 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.194329  3469 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.195076 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:32.196338  3361 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:32.196489  3469 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.197274 31572 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:32.198733 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:32.201817 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:32.186550 31420 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.201924 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.203336 31419 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.163918 32111 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:32.179219  3181 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 6. Current term is 7.
I20260709 12:23:32.205122 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.205601 31491 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:32.207250  3010 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:32.224654  3415 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.228514  3415 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.230165 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.209182  3260 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.213470 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.170465  3383 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.232422 31574 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.214294 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.207950  3413 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.230304 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.237051 31423 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:32.196949  3361 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:32.242462 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:32.223412 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63031.8us
I20260709 12:23:32.246203 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.232331  3412 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.249305 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.251870 31416 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.252058 31540 leader_election.cc:400] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:32.252563 31540 leader_election.cc:403] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:32.253729 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.253777 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.260684 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.239809  3010 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:32.245456  3487 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:32.291657  3412 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:32.292049 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.320092 31495 raft_consensus.cc:2368] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:32.292188 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.321105 31416 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.255182  3260 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.292713 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.323565 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.325858 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.326606 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.292850  3353 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:32.293326 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.298177 31421 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:32.298206 32113 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.299876 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.300282 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 887) took 1113 ms. Trace:
I20260709 12:23:32.329942 32111 rpcz_store.cc:276] 0709 12:23:31.189040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.199451 (+ 10411us) service_pool.cc:224] Handling call
0709 12:23:32.300144 (+1100693us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54004bd2d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:32.300231 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739969792}
I20260709 12:23:32.301100  3469 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.301559 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.301612 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.332579 31493 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:32.254549  3293 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:23:32.302865 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:32.334252 32114 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:32.303025 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.303861  3482 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.304425 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.337598 31499 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:32.304705 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.304760  3477 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.305318 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.309303 31424 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:32.338408 31567 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:32.309850 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.257342  3525 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:23:32.316443 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.310493 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 818) took 1143 ms. Trace:
I20260709 12:23:32.327200 31498 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:32.327387 32105 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:32.326570 31492 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.343083 31491 rpcz_store.cc:276] 0709 12:23:31.166915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.209906 (+ 42991us) service_pool.cc:224] Handling call
0709 12:23:32.310319 (+1100413us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54002e6154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:32.310437 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769812352}
I20260709 12:23:32.344806 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.237778  3047 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.328276 31495 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.328137 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.400529 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.324929 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.331136 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:32.401813 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 76937.7us
I20260709 12:23:32.302379  3415 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.335189 31565 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:32.335409 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.287663  3370 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.258236  3327 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:32.407655 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.340332 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.336931 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.408321 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.346926 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.374315 31422 raft_consensus.cc:2410] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:32.333379 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.406296 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.409727 31493 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:32.410897 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.412243 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.402622 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.415518 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.415982 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.416004 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.416699 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.416867  3444 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:32.417219 31568 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.417689 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.418994 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.420224 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.341830  3437 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:32.420848 31493 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:32.420933  3437 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.421502  3437 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:32.422654  3177 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:32.422958  3327 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:32.423110  3177 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.424090  3327 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.424985  3177 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.417505  3444 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.405072  3361 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.438218  3444 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.439146 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.440397 31568 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:32.441191  3191 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.442025  3477 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:32.442221  3478 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.467891 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.468842 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.445145  3047 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.447121  3526 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:32.447659 31417 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 7.
I20260709 12:23:32.400120  3520 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:32.482015 31569 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
W20260709 12:23:32.452057 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 111752us
I20260709 12:23:32.452447 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.456285 31416 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:32.483990 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.456781 31493 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:32.462311 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.329349  3353 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:32.413069 31565 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
W20260709 12:23:32.463713 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 121066us
I20260709 12:23:32.465617 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.514304 31500 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:32.514565 31568 raft_consensus.cc:2368] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:32.344264  3431 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:32.341300  3474 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.474608  3478 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.479911 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.479931 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1124) took 1347 ms. Trace:
W20260709 12:23:32.528472 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48655us
I20260709 12:23:32.528654 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.529511 31540 leader_election.cc:400] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:32.506495 31419 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:32.524873 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.525597 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:32.529808 31540 leader_election.cc:403] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:32.530803 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.531567 31419 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.531023 31566 rpcz_store.cc:276] 0709 12:23:31.132040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.474196 (+342156us) service_pool.cc:224] Handling call
0709 12:23:31.485083 (+ 10887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:31.585338 (+100255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:31.585367 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:31.585425 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:31.585460 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.479626 (+894166us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400057b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:32.479707 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:32.479864 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230099200}
I20260709 12:23:32.533063 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.344403  3469 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.543835 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.545099 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.487175 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.547693 31419 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:32.476263  3445 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.327121  3487 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:32.489213 31307 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0065979e5b9a477f8abf064563426291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:32.489753 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.557277 31567 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:32.535779  3010 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.558182 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.490612  3368 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:32.558836  3368 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:32.559722  3368 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.560022  3177 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.561053  3368 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.562757  3520 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:32.492606 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.493182  3517 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:32.493103  3437 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.495054 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.496022 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.569105 31492 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:32.569056 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73098.3us
I20260709 12:23:32.570037 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.570231 32109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:32.570938 32109 raft_consensus.cc:606] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:32.571218 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.494449  3515 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:23:32.505776  3509 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:32.508848 31497 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:32.555673  3352 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 12:23:32.572269 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:32.534322 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.578658 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.578714 31537 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.530594 31568 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:32.484998 31416 raft_consensus.cc:2368] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:32.537829 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.479476  3526 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.546196 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.484953 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.584873 31494 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.585562 32114 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:32.585654 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47909.6us
I20260709 12:23:32.548808  3539 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:32.548691 31419 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.553539 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.554351 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:32.519646  3353 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:32.563941 31307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 92378.3us
I20260709 12:23:32.598057 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.564064 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.564859 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.600785 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.606597 31567 raft_consensus.cc:2368] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
I20260709 12:23:32.607411 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.607609 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.503078 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:32.567603 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75075.5us
I20260709 12:23:32.608443 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.609072 31566 raft_consensus.cc:2368] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11.
I20260709 12:23:32.609022 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.609520 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:32.464685  3513 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:32.577627 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1843) took 2379 ms. Trace:
I20260709 12:23:32.603039 31418 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:32.570092 31500 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:32.613327 31423 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:32.535132  3531 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.535667  3417 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.614243 31572 rpcz_store.cc:276] 0709 12:23:30.197996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.379733 (+1181737us) service_pool.cc:224] Handling call
0709 12:23:31.394975 (+ 15242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.197642 (+802667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:32.577426 (+379784us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54001a6654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:32.577576 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844729600}
I20260709 12:23:32.611788 31565 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:32.563297  3520 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:32.612506 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.613327 31390 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:32.576689  3503 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.005s
I20260709 12:23:32.614213 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.615799 31495 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:32.583844  3473 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:32.574616  3191 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.629966 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.546952  3431 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.616267 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:32.578559  3428 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.592319  3177 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.613579  3477 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:32.629240 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.625373  3047 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:32.647481 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:32.648233 31568 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:32.592281  3526 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.597734  3426 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:32.623430  3441 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:32.611248  3401 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:32.603263  3435 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.636348 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:32.634292  2797 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:32.636374 31492 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:32.614861  3352 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:32.635646 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.658097 31571 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:32.660676 31416 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.661477 31567 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:32.664431 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.637934 31494 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:32.645078 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.620087 31423 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:32.628506  3248 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:32.652439 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.625180  3395 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:23:32.656471  3531 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.637398  3473 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:32.696552 31494 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:32.678728 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.679690  3248 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:32.680182 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.632135  3503 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.703212 31567 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:32.703382 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.711256 31566 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:32.670591  3401 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.657562  3047 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:32.681051  3426 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:32.713157 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:32.713855 31568 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:32.737152 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:32.743960 31415 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.712828 31566 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:32.723290  3401 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.717294  3412 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:32.752441 31568 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:32.732887  3417 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:32.753654 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.757917 31572 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:32.754086 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 140841us
I20260709 12:23:32.739174  3177 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:32.755456  3348 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.775272 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:32.776466 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.774595 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:32.779671 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.717419  3520 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.761407  3417 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:32.783968 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 197512us
I20260709 12:23:32.771888  3477 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:32.786240 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.768265  3478 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.785775 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:32.786206 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.789815 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:32.785306 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 202113us
I20260709 12:23:32.774376  3445 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:32.781965  3487 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.782758  3517 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:32.830651 31420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:32.832093 31420 raft_consensus.cc:606] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:32.812639 32105 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:32.763957  3412 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:32.834545  3548 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:23:32.835944  3412 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:32.773681  3177 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:32.771535  3513 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:32.839628 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:32.787274  3437 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.778237  3467 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:23:32.791246  3327 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:32.725768  3248 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.781625  3047 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.784861  3469 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.784521  3347 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:23:32.822368 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:32.827770 31572 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:32.780660  3482 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:23:32.845695 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:32.843087  3177 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:32.769658  3473 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:32.813412  3477 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:32.832924 31420 raft_consensus.cc:614] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:32.831483  3191 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.872924 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:32.890825 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 68540.1us
I20260709 12:23:32.893693 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:32.909981 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75874.9us
W20260709 12:23:32.960698 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.027745 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:33.034540 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 161729us
I20260709 12:23:33.052608 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:32.844918  3517 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.024098  3500 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.026065  3469 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.034536  3551 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.879225  3504 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.178s
I20260709 12:23:32.875841  3526 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.036722  3361 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:33.045706  3552 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:32.850193  3417 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:33.071601  3547 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:23:33.093868  3500 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.094578  3500 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.096343  2797 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:33.096748  2797 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.097560  3500 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.097510  2797 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.099005  2797 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:33.102079 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.106859  3559 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:33.107597  3559 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.110189  3559 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:33.111290  3544 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 12:23:33.112816  3542 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:23:33.070209  3503 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.118449  3417 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.832882  3426 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.052799  3509 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:23:33.130028 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.126857 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 107770us
I20260709 12:23:33.079584  3431 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:33.136773 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 243172us
I20260709 12:23:33.137850 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.140635 31540 leader_election.cc:400] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:33.143362 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.144798  3549 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:33.145362  3549 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:33.069893  3513 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.146252  3549 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:33.148963  3555 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:33.150760  3431 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:33.154660 32105 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:33.130247  3469 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.091188  3562 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:23:33.085338  3551 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.142567  3517 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.119920  3361 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.161816  3327 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:23:33.134729  3477 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:33.220757  3368 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 12:23:33.223450 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 751) took 1109 ms. Trace:
I20260709 12:23:33.224016 31422 rpcz_store.cc:276] 0709 12:23:32.113809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.214078 (+100269us) service_pool.cc:224] Handling call
0709 12:23:33.223250 (+1009172us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003ec954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.223390 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322601856}
I20260709 12:23:33.245584  3526 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.252154  3361 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.260321 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:33.261425 32113 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:33.271157 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.273025  3428 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.273545  3428 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.273962  3428 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.283804  3441 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.284466  3441 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.283617 31567 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:33.290707 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:33.296919 31540 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:33.298236 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.291662 32113 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:33.304719 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:33.343215 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:33.307778  3413 consensus_meta.cc:287] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.064s	user 0.009s	sys 0.004s
I20260709 12:23:33.351279 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:33.352445 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.355237 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:33.356202 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.365792 31566 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.344074 32113 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 7.
W20260709 12:23:33.337651  3525 consensus_meta.cc:287] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.004s
I20260709 12:23:33.309600  3419 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.368789 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.372474 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:33.361294 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 56686.9us
I20260709 12:23:33.311681  3551 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:33.368263 31495 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:33.376384 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:33.371032 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 116113us
W20260709 12:23:33.374423 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.377071 31571 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:33.373162 31574 raft_consensus.cc:2376] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13. Re-sending same reply.
I20260709 12:23:33.379845 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.343447  2939 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.374456 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:33.384322 31574 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:33.391057 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.392056 31500 raft_consensus.cc:2368] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:23:33.393085 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.393792 31500 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:33.368052  3417 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.395162 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.325063  3327 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:23:33.404281 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.405238 31496 raft_consensus.cc:2368] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:33.397639 31498 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:33.406828 31571 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:33.397939 31540 leader_election.cc:400] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:23:33.399538 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.408603 31540 leader_election.cc:403] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:23:33.382110  3526 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.416039 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:33.383575  3525 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10.
I20260709 12:23:33.382267  3517 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:33.418298 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.419148 31497 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:33.419148 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.414623 31491 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:33.395226 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:33.423825 31540 leader_election.cc:400] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:33.424278 31540 leader_election.cc:403] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:23:33.395939  3248 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:33.426476 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:33.395998  3370 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.432040 31416 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:33.433048  3566 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:33.434794 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:33.435266 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:33.436286 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:33.437951 31422 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:33.443362  3464 raft_consensus.cc:993] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:33.443955  3464 raft_consensus.cc:1081] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:33.429945  3248 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.448061  3248 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:33.425460  3353 consensus_meta.cc:287] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.002s
I20260709 12:23:33.448746  3353 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.428880  3412 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:23:33.412789  3417 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.484743 31569 raft_consensus.cc:2376] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11. Re-sending same reply.
I20260709 12:23:33.464902  3470 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.450909  3353 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:33.417392  3551 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9.
I20260709 12:23:33.492918 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.497128  3525 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.497702  3525 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:33.499297  3569 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:23:33.492498  3574 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:23:33.453259  3517 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.500804 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 2997) took 1540 ms. Trace:
I20260709 12:23:33.501207  3517 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.481422  3348 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:33.501269 31415 rpcz_store.cc:276] 0709 12:23:31.960009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:31.960124 (+   115us) service_pool.cc:224] Handling call
0709 12:23:31.977851 (+ 17727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.750743 (+772892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.500469 (+749726us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54003516d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:33.500710 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750105856}
I20260709 12:23:33.502363  3348 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:33.502828  3348 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:33.465152  3562 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:33.425110  3526 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.487092  3470 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.504709  3470 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.464951  3370 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:33.507002  3573 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 12:23:33.426898  3419 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:33.507711  3419 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.508131  3419 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:33.509598 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.513248 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:33.514652 32113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:33.515342 32113 raft_consensus.cc:606] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.515673 32113 raft_consensus.cc:614] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:33.516620  3520 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.517120  3520 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.518996  3444 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.519385  3444 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:33.519747  3444 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.523200 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 747) took 1410 ms. Trace:
I20260709 12:23:33.523698 31417 rpcz_store.cc:276] 0709 12:23:32.112806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.112955 (+   149us) service_pool.cc:224] Handling call
0709 12:23:33.522979 (+1410024us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b54004489d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.523127 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208177536}
I20260709 12:23:33.524928  3435 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:33.525375  3435 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:33.525683  3576 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.526182  3576 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:33.527570 32106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 973) took 1343 ms (client timeout 1545 ms). Trace:
W20260709 12:23:33.527943 32106 rpcz_store.cc:269] 0709 12:23:32.184612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.198424 (+ 13812us) service_pool.cc:224] Handling call
0709 12:23:33.527380 (+1328956us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400520154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.527515 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277119872}
I20260709 12:23:33.525056 31421 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:33.526302  3435 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.530753  3435 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:33.530449  3531 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:33.533532  3531 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:33.534596  3531 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.535606  3531 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:33.537858 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:33.538980 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:33.539029 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:33.540095 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.542150  3383 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.547616  2939 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.548177  2939 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.559439 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2805) took 1126 ms. Trace:
I20260709 12:23:33.559983 31565 rpcz_store.cc:276] 0709 12:23:32.432615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.607083 (+174468us) service_pool.cc:224] Handling call
0709 12:23:33.559158 (+952075us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b5400057154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.559342 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8077184}
I20260709 12:23:33.565097 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 839) took 1227 ms. Trace:
I20260709 12:23:33.565626 32114 rpcz_store.cc:276] 0709 12:23:32.337548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.337651 (+   103us) service_pool.cc:224] Handling call
0709 12:23:32.337909 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:32.603638 (+265729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.564798 (+961160us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400242a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:33.565023 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551592192}
W20260709 12:23:33.567723 31573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1850) took 1232 ms (client timeout 1501 ms). Trace:
W20260709 12:23:33.568236 31573 rpcz_store.cc:269] 0709 12:23:32.335353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.335519 (+   166us) service_pool.cc:224] Handling call
0709 12:23:33.567529 (+1232010us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400262fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.567658 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729875712}
W20260709 12:23:33.581122 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.608711 31492 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:33.611035 31492 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:23:33.652678 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 139514us
I20260709 12:23:33.653589 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:33.661103 31417 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:23:33.662542 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 243466us
I20260709 12:23:33.663969 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:33.664799 31417 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:33.667799 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:33.670007 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:33.670717 31421 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:33.657083 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.676364 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.677024 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.690294 31417 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:33.698598 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:33.701342 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:33.711881 31415 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:33.711975 31570 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:33.655572  3518 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:33.718743 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55395.3us
I20260709 12:23:33.723006 31389 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.720781 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1857) took 1383 ms. Trace:
I20260709 12:23:33.724164 31570 rpcz_store.cc:276] 0709 12:23:32.337325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.418714 (+ 81389us) service_pool.cc:224] Handling call
0709 12:23:33.720565 (+1301851us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400260cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:33.720704 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373328256}
I20260709 12:23:33.727586 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.729372 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.720945 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:33.671921  3417 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:33.731344 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.731310 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.734656 31497 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:33.736948 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:33.737520 31415 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.738897  3412 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:33.740276  3181 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:33.740947  3529 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:33.701790  2939 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.741508  3529 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.742524  3529 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.741562  3370 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.748190  3509 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:33.748442  3526 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.748967  3509 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.751526  3181 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.752825  3181 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.702766  3467 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.756028  3509 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.757380 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.757215  3248 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.758351  2939 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.759078  2939 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:33.759558  2939 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:33.760421  2939 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.761974 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.769678 31417 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:33.769227 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.770749 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:33.723858  3480 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:33.795190  3401 consensus_meta.cc:287] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.030s	user 0.012s	sys 0.008s
I20260709 12:23:33.732404  3508 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.795842  3401 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.735526  3428 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:33.798936 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.775317  3352 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:33.779491  3348 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.775490  3383 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:23:33.781463  3248 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.775188  3370 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:33.804471  3383 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:33.713615  3010 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:23:33.804775 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:33.777139 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:33.786060  3576 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.805757 32113 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:33.787204  3520 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:33.804848  3383 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:33.804499  3348 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.807149  3383 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:33.808981 31463 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.545s (SENT)
I20260709 12:23:33.795085  3480 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:33.810140  3428 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:33.786965 31570 pending_rounds.cc:85] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:33.810871 31570 pending_rounds.cc:107] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:23:33.810411  3480 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.811337 31570 raft_consensus.cc:2889] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:33.772905  3526 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:33.799033 31418 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:33.772420  3474 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.812323  3526 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:33.823345 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.823915 31491 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.809056  3383 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:33.789894  3441 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.003s
I20260709 12:23:33.713634  3473 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:23:33.815517 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.834915 31492 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:33.821046 31566 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:33.827500 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:33.836802 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:33.838553 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 70328.3us
I20260709 12:23:33.848843 31491 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:33.851099 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:33.860489 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:33.865079 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:33.865923 31498 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:33.874593 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.877267 31500 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:33.880031 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:33.798569  3401 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:33.880870 31566 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
W20260709 12:23:33.886237 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46810.4us
I20260709 12:23:33.824905  3525 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:33.898874 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.022s	sys 0.021s
W20260709 12:23:33.899235 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.022s	sys 0.021s
I20260709 12:23:33.882436  3431 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.837988  3482 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:33.881846  3426 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:33.948944 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54830.1us
I20260709 12:23:33.895080 31566 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:33.955312 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.958209 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:33.931258 31415 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:33.931968 31492 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
W20260709 12:23:33.899557 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 503184us
I20260709 12:23:33.837994  3550 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:33.961072 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:33.833961  3441 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:33.945825  3482 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.008091 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:34.021167 31566 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:33.963060 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:33.977923 31491 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:34.000435 31567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.031s
I20260709 12:23:33.898162  3248 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
W20260709 12:23:33.982221 31572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.013s	sys 0.027s
W20260709 12:23:34.031510 31572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.028s
I20260709 12:23:34.031915  3248 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.032299  3248 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:34.033085  3293 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:34.033399 31567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.011s	sys 0.031s
I20260709 12:23:33.947968  3431 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.033632  3293 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.034065  3431 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.035213  3191 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:34.035939  3191 consensus_queue.cc:1243] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.036423  3191 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:34.036737  3191 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:34.037572  3191 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.033105  3248 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.038859  3191 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.039685  3248 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.034875 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2791) took 1695 ms. Trace:
I20260709 12:23:34.043141 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1150) took 1154 ms. Trace:
I20260709 12:23:34.043704  3401 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.044390  3401 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.001524  3426 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:34.019800  3482 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:34.066453 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 103507us
I20260709 12:23:34.018918  3562 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:34.046392 31572 rpcz_store.cc:276] 0709 12:23:32.888388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.028556 (+140168us) service_pool.cc:224] Handling call
0709 12:23:33.055697 (+ 27141us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:33.060455 (+  4758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.060505 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:33.086521 (+ 26016us) log.cc:844] Serialized 52 byte log entry
0709 12:23:33.404420 (+317899us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:34.031867 (+627447us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.032974 (+  1107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.042895 (+  9921us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.042944 (+    49us) raft_consensus.cc:1685] finished
0709 12:23:34.042956 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.043090 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4229,"raft.queue_time_us":71370,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":3477,"thread_start_us":847723,"threads_started":2,"wal-append.queue_time_us":571335}
I20260709 12:23:33.997789  3361 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:23:34.072305 31465 leader_election.cc:400] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:34.089216 31465 leader_election.cc:403] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:34.090461 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.042905 31567 rpcz_store.cc:276] 0709 12:23:32.339050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:32.751016 (+411966us) service_pool.cc:224] Handling call
0709 12:23:33.283176 (+532160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.283473 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:33.402419 (+118946us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.034014 (+631595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.034065 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.034114 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.034175 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.034726 (+   551us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001964d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:34.034824 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"spinlock_wait_cycles":1197376384,"thread_start_us":631031,"threads_started":1}
I20260709 12:23:34.028441  3526 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.094158 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:34.096571 31493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.012s	sys 0.017s
I20260709 12:23:34.098970 31572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:23:34.100188 31572 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:34.100664 31572 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.072726  3413 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:34.104115  3370 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.071857  3431 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.087822  3477 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.093858  3368 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:34.091619  3562 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:34.122440 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.097362  3578 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.129874  3562 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.135823  3441 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:34.119426  3413 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:34.141933  3444 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.622s	user 0.019s	sys 0.004s
I20260709 12:23:34.148622 31498 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:34.149778 31492 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:34.147218 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:34.178320 31573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.014s	sys 0.007s
W20260709 12:23:34.178849 31573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.014s	sys 0.007s
I20260709 12:23:34.160542  3370 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.177899  3531 consensus_meta.cc:287] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.006s
W20260709 12:23:34.194379 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 301150us
I20260709 12:23:34.198540 31418 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 12. Ops: []
I20260709 12:23:34.198489 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.208994 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.200806 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.210227 31419 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:34.170979  3348 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:23:34.214028 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.212505 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.160667  3444 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.170794  3441 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:23:34.216701 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:34.215513 31419 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:34.222452 31421 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:34.193735  3361 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:34.226938 31495 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.019s
W20260709 12:23:34.227283 31495 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.014s	sys 0.019s
I20260709 12:23:34.228119 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.261672 31417 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:34.265053 31307 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0065979e5b9a477f8abf064563426291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:34.267560 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.268198 32113 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.268213 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.269277 32114 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.211866  3477 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:34.277758 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:34.280757 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.173144  3426 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.191826  3370 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.224545  3526 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:34.292984 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.288918  3419 consensus_meta.cc:287] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.006s
I20260709 12:23:34.295552  3352 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.304919 31419 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.271080  3361 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.324626  3482 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.327135  3361 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:34.300962  3526 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.304250  3419 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.291114  3477 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.302457  3517 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.335342 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:34.338228 31572 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:34.349784 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 255682us
I20260709 12:23:34.351056 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:34.363966  3482 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.367338 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.368530 32114 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.371511 31572 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.373857 31387 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:34.376616 31574 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14.
I20260709 12:23:34.308979  3352 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.342818  3513 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.379529  3473 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:34.404389 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1873) took 1050 ms. Trace:
I20260709 12:23:34.380023  3431 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:34.457248 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.002s	sys 0.019s
W20260709 12:23:34.464380 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.002s	sys 0.019s
W20260709 12:23:34.465085 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 744238us
W20260709 12:23:34.439231 31570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.014s	sys 0.018s
W20260709 12:23:34.466248 31570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.014s	sys 0.021s
I20260709 12:23:34.371160  3517 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.432402  3531 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.457854  3473 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:34.489949  3590 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:23:34.504463 32113 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:34.486114 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:34.506194 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 228516us
I20260709 12:23:34.512733 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:34.483913  3431 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.403986  3513 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.489775  3444 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:34.510468 32114 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:34.508458  3531 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.533027  3531 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:34.540442 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:34.541275 31493 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.563365 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1874) took 1208 ms. Trace:
I20260709 12:23:34.567207 31569 rpcz_store.cc:276] 0709 12:23:33.354627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.540837 (+186210us) service_pool.cc:224] Handling call
0709 12:23:33.656384 (+115547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.656632 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:34.118446 (+461814us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.562897 (+444451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.562968 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:34.563027 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.563113 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.563287 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":559483,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5353,"raft.queue_time_us":655,"thread_start_us":846271,"threads_started":2}
I20260709 12:23:34.573295 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:34.508078  3603 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:23:34.521409  3431 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.541706  3576 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.601938 31493 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
W20260709 12:23:34.611792 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 260821us
I20260709 12:23:34.583072  3419 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:34.585335  3614 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:34.618155 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.616016 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:34.616503 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 188349us
I20260709 12:23:34.590788  3477 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:34.591394  3526 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.646319 31418 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:34.647145 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:34.640156 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 154113us
I20260709 12:23:34.619444 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:34.614814  3293 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.649844 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.659531 31465 leader_election.cc:400] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
I20260709 12:23:34.660058 31465 leader_election.cc:403] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:23:34.661409 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45465.6us
I20260709 12:23:34.662179 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:34.662374 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:34.663038 31416 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.666656 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:34.649139  3368 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:34.650434  3482 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.674189 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1884) took 1313 ms. Trace:
I20260709 12:23:34.660055  3477 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:34.606700  3473 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.703683  3364 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.704195  3364 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.667955  3602 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:34.683468 31570 rpcz_store.cc:276] 0709 12:23:33.361184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.786429 (+425245us) service_pool.cc:224] Handling call
0709 12:23:33.786780 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.811889 (+ 25109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.811919 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.812330 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.467760 (+655430us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.467803 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.467867 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.673968 (+206101us) raft_consensus.cc:1685] finished
0709 12:23:34.673993 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.674120 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":655150,"threads_started":1,"wal-append.queue_time_us":795728}
I20260709 12:23:34.685256  3431 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:34.686597  3248 consensus_meta.cc:287] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 12:23:34.656032  3010 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:23:34.691244  3383 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.857s	user 0.011s	sys 0.001s
W20260709 12:23:34.696331  3592 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.197s	user 0.002s	sys 0.001s
I20260709 12:23:34.696914  3628 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:34.675760 31465 leader_election.cc:400] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11.
W20260709 12:23:34.744278 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 68642.2us
I20260709 12:23:34.745322 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.682109  3621 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:34.698787  3368 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.672624  3526 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:34.751014  3526 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.751430  3526 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:34.699820  3470 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 1.195s	user 0.019s	sys 0.010s
I20260709 12:23:34.700052  3599 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:34.700749  3619 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:34.701243  3482 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.703274  3477 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
I20260709 12:23:34.424238 31568 rpcz_store.cc:276] 0709 12:23:33.354321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.540753 (+186432us) service_pool.cc:224] Handling call
0709 12:23:33.540979 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.541167 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:34.019498 (+478331us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.403775 (+384277us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.403983 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.404041 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.404104 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.404185 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.404314 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39635,"prepare.queue_time_us":661700,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1482,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13703,"spinlock_wait_cycles":39177472,"thread_start_us":837543,"threads_started":2}
I20260709 12:23:34.764523 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:34.764632 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.709354 31569 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:34.672624 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:34.713935 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 201556us
I20260709 12:23:34.716053 31416 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
W20260709 12:23:34.765987 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 93697.4us
I20260709 12:23:34.729408 32114 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:34.737944 31540 leader_election.cc:400] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:34.767757 31540 leader_election.cc:403] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:34.738498 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.739806 32113 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:34.769757 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:34.742543 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.749599 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.698827  3401 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.674616  3352 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.757306 31494 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:23:34.775228 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:34.721005  3602 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:34.776935 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.777596 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:34.778471 31569 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.779249 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.779866 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.778291 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:34.780627 32114 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:34.772325 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.732918  3293 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.762888  3470 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.773561  3619 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:34.774121  3623 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.727581  3513 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.775895 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.786433 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:34.786986 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:34.754310  3621 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.794258 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.804316 31493 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:34.804546 31498 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:34.798460 31415 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:34.753548  3383 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.799738 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.801091 32113 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:23:34.796263 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.807229 31465 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.824293 32111 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.824635 31566 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.825820 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:34.796612  3550 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:23:34.776921  3628 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.777112  3629 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:34.821205  3477 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:34.828161  3413 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:34.787838  3614 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:34.810364  3618 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.831104  3632 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:34.843099 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:34.853000 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.853644 32111 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:34.853960 31494 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:34.831722 31569 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:34.837212 31495 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:34.854969 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.837581 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.855257 31496 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:34.838205 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.782459  3426 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.787355  3602 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.839879 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.787329  3480 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:23:34.837280 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:34.826449  3517 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.796620  3445 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:34.776713  3627 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.787707  3352 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:34.876725 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 100367us
I20260709 12:23:34.829824  3482 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.796810  3599 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:34.855513 32109 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.855998 32113 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
W20260709 12:23:34.856534 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 85101.6us
I20260709 12:23:34.898612 32109 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:34.810999  3621 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:34.796736  3531 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:23:34.861718 32110 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:34.796846  3401 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:34.864246 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.907545 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.844693  3383 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.908380 31495 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:34.878908  3364 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.863402 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.912668 31500 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:34.896729  3431 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.851444  3628 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.803071  3293 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.848357  3619 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:34.872867  3601 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 12:23:34.874347  3589 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.419s	user 0.001s	sys 0.001s
I20260709 12:23:34.875418 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:34.909196  3401 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:34.875902  3629 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:34.821298  3513 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:34.937505  3629 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:34.937937  3629 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.880584 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:34.883095 31569 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:34.808841  3623 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.906720 32109 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.910820 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.941897 32109 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.864456 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.943923 31496 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:34.866463 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:34.947312  3618 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.947466  3623 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:34.948311 31419 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
W20260709 12:23:34.948410 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82056.6us
I20260709 12:23:34.922785  3619 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:34.949761  3619 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:34.953851 32109 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:34.927775 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:34.875658 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1161) took 1138 ms. Trace:
I20260709 12:23:34.960361 31567 rpcz_store.cc:276] 0709 12:23:33.737624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.196304 (+458680us) service_pool.cc:224] Handling call
0709 12:23:34.217024 (+ 20720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.217516 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.217561 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.225714 (+  8153us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.559953 (+334239us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.560014 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.560116 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.875437 (+315321us) raft_consensus.cc:1685] finished
0709 12:23:34.875459 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.875597 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":778,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4872,"thread_start_us":266961,"threads_started":1,"wal-append.queue_time_us":482077}
I20260709 12:23:34.909461  3383 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:34.900324  3517 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:23:34.963030  3383 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.964316  3383 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.965464  3293 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.933828  3470 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.931476  3599 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:34.935210  3634 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:23:34.955240  3588 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.440s	user 0.001s	sys 0.001s
W20260709 12:23:34.956995  3606 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
W20260709 12:23:34.968981  3611 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 12:23:34.943426  3627 consensus_queue.cc:1175] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8553a13b444649b9a19e5488aabaf1c5" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:34.970595 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1883) took 1609 ms. Trace:
I20260709 12:23:34.970997 31571 rpcz_store.cc:276] 0709 12:23:33.360825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.652698 (+291873us) service_pool.cc:224] Handling call
0709 12:23:33.653270 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.667288 (+ 14018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.667327 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.681966 (+ 14639us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.216783 (+534817us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:34.216829 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.216898 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.920798 (+703900us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:34.970316 (+ 49518us) raft_consensus.cc:1685] finished
0709 12:23:34.970341 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.970537 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16195,"raft.queue_time_us":17857,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":22763,"spinlock_wait_cycles":120531328,"thread_start_us":474143,"threads_started":1,"wal-append.queue_time_us":738844}
I20260709 12:23:34.972570 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1882) took 1612 ms. Trace:
W20260709 12:23:34.975111  3612 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.279s	user 0.000s	sys 0.002s
W20260709 12:23:34.919313 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95468.8us
I20260709 12:23:34.976220  3628 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:34.977738 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:34.973192 31571 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:34.978335 31495 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.979696 31571 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:34.980736  3526 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:34.983031 31497 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:34.984086 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.923575  3431 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:34.984701 31496 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:34.985711 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:34.973075 31573 rpcz_store.cc:276] 0709 12:23:33.360469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.573297 (+212828us) service_pool.cc:224] Handling call
0709 12:23:33.573613 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.574290 (+   677us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:34.179218 (+604928us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.505728 (+326510us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.520035 (+ 14307us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.520293 (+   258us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:34.520329 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.520395 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.968428 (+448033us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:34.972305 (+  3877us) raft_consensus.cc:1685] finished
0709 12:23:34.972402 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.972516 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637993,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":4170,"raft.queue_time_us":1742,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":11219,"spinlock_wait_cycles":49536256,"thread_start_us":898726,"threads_started":2,"wal-append.queue_time_us":488107}
I20260709 12:23:34.981030 31571 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:23:34.958386 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1162) took 1220 ms. Trace:
I20260709 12:23:34.987890 31565 rpcz_store.cc:276] 0709 12:23:33.737908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.325825 (+587917us) service_pool.cc:224] Handling call
0709 12:23:34.326123 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.432097 (+105974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.432143 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.432200 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:34.432246 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.958071 (+525825us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400318b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:34.958133 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.958304 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243133184}
I20260709 12:23:34.989670 31571 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.998741 31495 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:34.986617 31496 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
W20260709 12:23:34.977663  3625 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 12:23:35.004799 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 124298us
W20260709 12:23:35.012315 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 84659.1us
I20260709 12:23:35.013283 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.014125 31417 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:35.013724 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.015377 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.015798 31417 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:35.016069 31571 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:35.016892 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.017568 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:34.919665  3614 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.018288 31565 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:34.986250  3401 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.017915 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:35.024331 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.024492 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.025110 31416 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:35.025740 31573 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:35.026887 31417 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.023644 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:34.987372  3526 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.039249 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.012391  3623 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:35.043633  3652 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.035521 31571 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:35.061053 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.047327  3531 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.055171 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:35.057226 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.052516 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.054428 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.051052 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.093050 31573 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:35.062335 31417 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:35.020537  3517 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:35.050829 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 83829.8us
I20260709 12:23:35.082355 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.027014  3638 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.100075 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.101410 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.017129  3470 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:23:35.102231 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:35.111090 31421 raft_consensus.cc:606] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.111668 31421 raft_consensus.cc:614] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:35.102588 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.105732 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.049325  3642 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.116186 31420 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:35.119146  3508 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:35.120952  3428 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:35.063912  3480 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:35.096365  3585 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:23:35.143028 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.148530 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.149655 31565 raft_consensus.cc:2368] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
I20260709 12:23:35.101825  3623 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.156914 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.160403 31565 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:35.143195  3550 consensus_queue.cc:1243] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:35.163538 31573 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:35.163951 31573 pending_rounds.cc:85] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 6
W20260709 12:23:35.163527 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141840us
I20260709 12:23:35.164217 31573 pending_rounds.cc:107] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:23:35.164470 31573 raft_consensus.cc:2889] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:35.062709  3652 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.164961 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.165906 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.183120 31421 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:35.107050  3474 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:23:35.184209 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.094600  3531 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.186528 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.189914 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.193148 31465 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.122539  3621 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.126258  3602 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.171031  3470 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:35.137971  3638 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.206703 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.147537  3480 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.210314 31465 leader_election.cc:400] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12.
I20260709 12:23:35.187342  3614 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.185463  3650 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.144727  3642 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.195923  3383 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.234572 32112 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:35.199746  3578 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:35.199297  3618 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.236610 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.202387  3525 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.232892  3649 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.238195  3562 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:23:35.212824  3526 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.204386  3508 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:35.240726 31571 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:35.235270  3348 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.208331  3517 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:23:35.243027 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46122.9us
I20260709 12:23:35.241217  3525 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.239259  3650 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.202319  3482 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:23:35.202625  3441 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:23:35.259478 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.237978  3614 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.243139  3413 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.243620  3578 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:35.261739  3657 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:35.204595  3470 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:35.247767  3644 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.246176  3508 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.244395  3658 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:35.258116  3550 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.287432  3642 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.288625  3480 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.289786  3368 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.249783  3348 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.261780  3525 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.285041  3426 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
I20260709 12:23:35.298115 32113 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:35.295087 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.318480 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.318876 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.319963 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.257936  3513 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:35.264688  3652 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.301118 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:35.300642 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 103534us
I20260709 12:23:35.303053 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.246873  3383 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:35.249040  3477 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:23:35.266096  3638 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.205401  3629 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.304859 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.305523 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:35.293555 31307 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0065979e5b9a477f8abf064563426291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:35.295629  3659 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:23:35.297384 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.314659  3470 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.299268  3508 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:35.324369 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.244872  3649 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.303722  3437 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.304152  3644 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.353595 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.326359  3632 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.355047 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.355177 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.355793 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.378021 31424 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:35.357208 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.315941  2939 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.387077  2939 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.389631  2939 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.391321  3470 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.391049  3667 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:35.391950  3578 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.396781  3413 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.397514  3531 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.352907 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:35.316452  3658 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:35.325174  3368 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.354627 31423 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:35.398885  3621 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.308000  3550 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.399578  3658 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.401584  3550 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.324313  3513 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:35.402904 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.402649  3513 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.378072 31416 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
W20260709 12:23:35.356994 31307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63488.1us
I20260709 12:23:35.381762 31421 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:35.371687  3437 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.384104  3629 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.386003 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.326766  3191 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.343152  3630 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:35.409214 31493 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
W20260709 12:23:35.408593 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55765.8us
I20260709 12:23:35.418241 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.368407  3383 consensus_queue.cc:1243] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:35.376996  3632 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.406899  3437 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.432688 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.435081 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.435335 31569 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:35.359208  3517 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:23:35.397516  3413 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.424225  3191 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.424852  3602 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:35.438898  3671 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:35.438952  3348 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.440321  3662 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:35.440766  3662 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.441092  3662 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.447073 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.448297 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.449074 31493 raft_consensus.cc:2410] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:23:35.449107 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 859) took 1173 ms. Trace:
I20260709 12:23:35.449611 32105 rpcz_store.cc:276] 0709 12:23:34.275362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.275520 (+   158us) service_pool.cc:224] Handling call
0709 12:23:34.275910 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.326393 (+ 50483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.326427 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.326467 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:34.326504 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.448891 (+1122387us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54006be9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:35.448936 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.449052 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115654016}
I20260709 12:23:35.451313  3632 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.455044 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:35.457088  3619 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.006s
I20260709 12:23:35.457499  3619 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.459635  3477 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.460206  3477 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.460877  3617 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:35.461275  3617 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:35.461469 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.462121  3665 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:35.462291  3477 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.475294 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.462432  3668 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:35.462800  3642 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.463788  3531 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:35.467667 31574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1871) took 2114 ms (client timeout 1982 ms). Trace:
I20260709 12:23:35.468087  3644 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.469394 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1160) took 1732 ms. Trace:
I20260709 12:23:35.469523  3649 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.471305  3650 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.426842  3652 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:35.472378 31492 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:35.498096 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.428918  3630 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:35.428941  3526 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:23:35.473798 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.470388  3614 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.462584  3665 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.477550 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.474637 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.482501 32106 raft_consensus.cc:2393] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:35.485716 31574 rpcz_store.cc:269] 0709 12:23:33.353716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.509335 (+155619us) service_pool.cc:224] Handling call
0709 12:23:35.467463 (+1958128us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54002517d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:35.467598 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992014592}
I20260709 12:23:35.487071 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.514999 31495 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:35.515170 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.515750 31574 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:35.490455 31566 rpcz_store.cc:276] 0709 12:23:33.737323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.175863 (+438540us) service_pool.cc:224] Handling call
0709 12:23:34.176188 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.830968 (+654780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.469171 (+638203us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002508d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:35.469340 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490854144}
I20260709 12:23:35.516901 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.517870 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.518232 31566 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:35.492372 31389 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.982s (SENT)
I20260709 12:23:35.493474 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.431447  3666 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.520226 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:35.491957 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 128911us
I20260709 12:23:35.466451  3437 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.489982  3531 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.507889 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.509888 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.518983 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.519161 32110 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:35.518999 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:35.521701 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 86956.3us
I20260709 12:23:35.520277 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.514133  3665 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:35.539070 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:35.544119 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:35.507375  3652 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:35.512933  3413 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.488761  3642 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.513404  3660 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.521431  3614 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:35.507414  3348 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:35.521744  3467 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.571784  3652 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.531858  3666 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.584367  3370 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.584609  3666 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.524168  3445 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:23:35.576961  3614 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.585191  3445 consensus_queue.cc:1243] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:35.585400  3614 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:35.585726  3445 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:35.586052  3445 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:35.586905  3513 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.586875  3445 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.546518  3477 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.571314 31498 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:35.575328 31495 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:35.561847 31569 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:35.577421 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55075.6us
I20260709 12:23:35.590878 31387 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.552385  3191 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.582880  3642 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:35.589200 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 96868.4us
I20260709 12:23:35.575577 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:35.594776 31494 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.545378  3531 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.568352  3437 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.578159  3413 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.599655  3437 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:35.561792  3613 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.862s	user 0.000s	sys 0.007s
I20260709 12:23:35.601464 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1779) took 1402 ms. Trace:
I20260709 12:23:35.526517  3401 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.601799  3482 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:35.602411  3605 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.915s	user 0.001s	sys 0.003s
I20260709 12:23:35.602869 31568 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:35.603556  3401 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.601804 31422 rpcz_store.cc:276] 0709 12:23:34.198727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.199638 (+   911us) service_pool.cc:224] Handling call
0709 12:23:34.199966 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.200332 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.200379 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.211729 (+ 11350us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.499433 (+287704us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:34.499496 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.499585 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.561155 (+1061570us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:35.601177 (+ 40022us) raft_consensus.cc:1685] finished
0709 12:23:35.601198 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.601403 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8526,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4390,"spinlock_wait_cycles":65685888,"thread_start_us":228693,"threads_started":1,"wal-append.queue_time_us":424048}
I20260709 12:23:35.605973  3437 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:35.607085  3619 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:35.550609  3602 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.607494  3437 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:35.607924  3437 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:35.608771  3437 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.599749  3413 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.611963  3413 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.612490 31567 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:35.612848 31567 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:35.613546 31567 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.614404 31567 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.615106  3352 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:35.615497  3352 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:35.616225  3352 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.616740  3525 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:35.618450  3604 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.918s	user 0.002s	sys 0.000s
I20260709 12:23:35.599097 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.619412 31571 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:35.617187  3352 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:35.639374 31491 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:35.588158  3445 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.590286  3477 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.593174  3348 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:35.642390  3477 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.594484  3508 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.588709  3660 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.654414 31494 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:35.554298  3630 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.666268 31390 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.661608 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.628443  3632 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.659212  3482 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:23:35.658483  3525 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.682533 31567 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:23:35.683981  3598 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:35.684338  3624 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.899s	user 0.003s	sys 0.003s
I20260709 12:23:35.702466  3508 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.681674  3562 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:35.704452  3632 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.694113  3531 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.709227  3531 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.690158  3614 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.713101  3660 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.726462  3562 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:35.731514  3562 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:35.734001 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 213816us
W20260709 12:23:35.734956 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 190876us
I20260709 12:23:35.738375 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.739490 31491 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:35.740159 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:35.740973 31498 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.741727 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.741945 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:35.745837 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.746667 31494 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:35.738801 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.738301 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.749503 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.749691 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:35.750764 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.693943 31567 pending_rounds.cc:85] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 8
I20260709 12:23:35.752614 31567 pending_rounds.cc:107] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:35.752907 31567 raft_consensus.cc:2889] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:35.753500 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1894) took 1022 ms. Trace:
I20260709 12:23:35.753840 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1885) took 1849 ms. Trace:
I20260709 12:23:35.753778 31567 rpcz_store.cc:276] 0709 12:23:34.731382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.961694 (+230312us) service_pool.cc:224] Handling call
0709 12:23:34.962016 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.612403 (+650387us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540017c620. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196dadc0 00007fc1197651c0 00007fc119766231 00007fc119762d8f 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c
0709 12:23:35.753295 (+140892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.753454 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463354112}
I20260709 12:23:35.755043 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.755713 31567 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.758425 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:35.763643 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.765396 31493 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:35.722700  3623 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:35.775105 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.776701 31567 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:35.761711 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.778261 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.779243 31495 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:35.780408 31567 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:35.776002  3191 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.754545 31572 rpcz_store.cc:276] 0709 12:23:33.905301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.372731 (+467430us) service_pool.cc:224] Handling call
0709 12:23:34.373054 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.373560 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.373603 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.375979 (+  2376us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.602965 (+226986us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:34.618634 (+ 15669us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.649642 (+ 31008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.649781 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.558380 (+908599us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:35.734454 (+176074us) raft_consensus.cc:1685] finished
0709 12:23:35.753578 (+ 19124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.753749 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1135,"prepare.queue_time_us":7846,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":32535,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":23348,"spinlock_wait_cycles":74497280,"thread_start_us":171372,"threads_started":1,"wal-append.queue_time_us":293922}
W20260709 12:23:35.785835 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.786473 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.786734  3652 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:35.787313 31566 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:35.787322  3652 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:35.791139 31421 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:35.734115  3470 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.802173  3470 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.802599  3470 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:35.791947 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.805902 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.809080 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.809273 32111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:35.809916 32111 raft_consensus.cc:606] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.811172 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.812312 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.724712  3508 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:35.792403 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:35.817466 31492 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.798447 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:35.800555  3444 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:35.801235  3663 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:35.795056 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.814638 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.829514 32105 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:35.815460 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:35.816229 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:35.808301 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:35.822335 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 156160us
I20260709 12:23:35.831746 32106 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12.
W20260709 12:23:35.778538  3435 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:35.833690 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.780344  3618 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:35.773207  3619 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:35.774151  3632 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:35.835217 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.838903 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:35.839459 31494 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:35.841009 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:35.844901 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:35.791702  3652 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:35.839939  3630 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:35.817523  3650 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:35.856329 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.861819 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:35.868636 31492 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:35.848565  3662 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.880304  3191 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:35.880383  3664 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.883538  3191 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.884003  3191 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:35.888170  3640 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.904s	user 0.002s	sys 0.000s
I20260709 12:23:35.863240  3632 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:35.840181  3550 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.891582  3632 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.891607  3550 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:35.893769  3550 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.894474 31574 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:23:35.894649  3662 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:35.895797 31566 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:35.897684 31566 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:35.878914 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:35.859934  3480 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:35.902155 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1167) took 1723 ms. Trace:
I20260709 12:23:35.902583 31570 rpcz_store.cc:276] 0709 12:23:34.179068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.722703 (+543635us) service_pool.cc:224] Handling call
0709 12:23:34.723549 (+   846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:34.734022 (+ 10473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.734067 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.744460 (+ 10393us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.881336 (+136876us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:34.881389 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.881480 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:35.887625 (+1006145us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:35.901866 (+ 14241us) raft_consensus.cc:1685] finished
0709 12:23:35.901895 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:35.902095 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9854,"raft.queue_time_us":10438,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12147,"spinlock_wait_cycles":34585984,"thread_start_us":77854,"threads_started":1,"wal-append.queue_time_us":156141}
I20260709 12:23:35.879583 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.907902 32110 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:23:35.913328 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:35.858430  3630 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:35.919091 31498 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:35.827834  3508 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:35.966926 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 131826us
W20260709 12:23:35.972379 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135543us
I20260709 12:23:35.973089 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:35.922209  3652 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:35.978891 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97607.7us
I20260709 12:23:35.925920  3413 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:35.977705 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:35.928220  3630 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:35.984687 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.978520  3428 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:23:35.986112  3614 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:36.019447  3576 raft_consensus.cc:993] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:23:36.046380  3602 raft_consensus.cc:1081] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:23:36.043037  3652 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:36.052644  3652 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.056509 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:36.010536  3260 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:36.064716 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1168) took 1573 ms. Trace:
I20260709 12:23:36.065230 31568 rpcz_store.cc:276] 0709 12:23:34.491708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.781449 (+289741us) service_pool.cc:224] Handling call
0709 12:23:34.781780 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.603232 (+821452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.064429 (+461197us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400057654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:36.064644 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887905024}
I20260709 12:23:36.068549  3431 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.073669 31567 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:36.073565 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:35.978958  3348 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.981343  3361 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:35.928298 31495 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:36.092260 31568 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:36.016985  3473 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:36.010645  3413 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:36.042068 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1724) took 1256 ms. Trace:
I20260709 12:23:36.094915 31497 rpcz_store.cc:276] 0709 12:23:34.786058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.786184 (+   126us) service_pool.cc:224] Handling call
0709 12:23:36.041841 (+1255657us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400362254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:36.041998 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424397568}
I20260709 12:23:36.077890 31567 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:36.078752  3600 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 1.604s	user 0.004s	sys 0.000s
W20260709 12:23:36.083963 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.949962 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.092132  3361 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.112540 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:36.116552 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:36.126068 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:36.129380 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:36.139191 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 152663us
W20260709 12:23:36.116523  3665 consensus_meta.cc:287] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:23:36.144434 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:36.145376 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:36.151762 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.133193  3361 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.134857  3662 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:36.132431  3370 raft_consensus.cc:2764] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:23:36.157311 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.154793 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.160032 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.160526  3508 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.169396 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 908) took 1387 ms. Trace:
I20260709 12:23:36.175979 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.140657  3664 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:36.179181 32112 rpcz_store.cc:276] 0709 12:23:34.781722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.781819 (+    97us) service_pool.cc:224] Handling call
0709 12:23:34.782064 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.237721 (+455657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.169144 (+931423us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400720e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:36.169321 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040070016}
I20260709 12:23:36.182606 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:36.177320 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.183506 31423 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:36.185546  3614 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:36.185778  3619 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:36.187070  3619 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:36.187515  3619 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:36.134560  3513 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:23:36.188494  3619 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.195775 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:36.158330  3662 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:36.199522 31419 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:36.200874  3690 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:23:36.203883  3513 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:36.205854  3191 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.210511  3617 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.222450 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.259672 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:36.222090  3513 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:36.219241  3662 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:36.314131 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:36.315634  3477 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.003s
I20260709 12:23:36.154794  3665 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.317755 31570 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:23:36.330734 31420 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.329139 31423 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:36.322008  3619 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.189436  3413 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.326960  3480 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:36.349071  3370 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:36.369253  3191 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:36.378538 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:36.379278 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:36.379571  3470 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 12:23:36.349690  3526 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:23:36.389003 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:36.390587 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:36.391732 31494 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:36.381464 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:36.361510  3480 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:36.337750  3599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.013s	sys 0.013s
I20260709 12:23:36.339825  3477 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.398607 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:36.399715  3191 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:36.400086 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:36.394768  3470 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:36.405652  3610 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.724s	user 0.001s	sys 0.010s
I20260709 12:23:36.404439  3646 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:36.407267  3470 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.408054  3480 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:36.400394  3191 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:36.409299  3191 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.411010  3665 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.389570  3370 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.367728  3513 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.413028  3513 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:36.413625 31494 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:36.397110  3599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.014s	sys 0.014s
I20260709 12:23:36.414398  3370 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:36.418068 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 431103us
I20260709 12:23:36.363596  3361 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.463888 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:36.466176  3477 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.472834  3630 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.409320  3437 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:36.474962  3630 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:36.478608 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:36.479168 32105 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:36.479998 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:36.490739 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:36.512069 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.525830  3652 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.477240  3010 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:36.535440 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:36.537803 32112 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:36.526449  3652 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.527794  3665 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:36.560111 32114 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:36.600296  3361 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:36.602890  3652 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:36.604831  3665 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:36.607709  3665 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:36.607997  3702 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:23:36.617475 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:36.619591 32112 raft_consensus.cc:2393] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:36.568645 32080 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:36.626590 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58118us
I20260709 12:23:36.685616 32114 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:23:36.650921  3705 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:36.618875  3662 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.657181  3361 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:23:36.773015  3705 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.779179  3260 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:36.779744  3260 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:36.780764  3260 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.782699  3260 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:36.776716  3705 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:36.836513  3705 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:36.838502  3662 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:36.872305  3619 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.003s
I20260709 12:23:37.053860 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:37.054980 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.056787 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:37.057911 31416 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:37.054250 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:37.061408 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:37.062976 31422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.008s	sys 0.010s
W20260709 12:23:37.063582 31422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.008s	sys 0.010s
I20260709 12:23:37.067641 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:37.072402 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:37.078624 31417 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:37.083539 31491 raft_consensus.cc:2410] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:37.085886 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:37.088482 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:37.095553 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:37.097149 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:37.114931 31419 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.899s	user 0.016s	sys 0.000s
I20260709 12:23:37.115595 31419 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:37.119886 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:37.122840 31566 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.014s	sys 0.021s
W20260709 12:23:37.123358 31566 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.014s	sys 0.021s
W20260709 12:23:37.153767 31420 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.000s
I20260709 12:23:37.154443 31420 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:37.207733  3619 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:37.208498  3619 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.208988  3619 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.217094  3413 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.191638 31423 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:37.218044  3413 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.218791  3413 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:37.266705 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.277884  3665 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.278308  3726 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.278380 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1917) took 1536 ms. Trace:
W20260709 12:23:37.277940 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.006s
I20260709 12:23:37.288813  3513 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.289716  3513 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.293713  3513 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:37.294812 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.295243  3723 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.339375 31415 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:37.279102  3726 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.341805 31424 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:37.343609  3726 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:37.346875 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.002s	sys 0.006s
I20260709 12:23:37.350135  3719 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:37.346927 31537 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.024s	sys 0.061s
W20260709 12:23:37.353607 31537 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.025s	sys 0.062s
W20260709 12:23:37.354213 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 833917us
W20260709 12:23:37.351756 32080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.002s	sys 0.006s
W20260709 12:23:37.355019 32080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.003s	sys 0.006s
I20260709 12:23:37.357136 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:37.351279  3260 consensus_meta.cc:287] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
I20260709 12:23:37.358924 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.352578  3721 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.352293  3705 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.361074  3721 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.361461  3705 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.353755  3719 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.364514  3721 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.378378 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.381409  3719 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.338800  3723 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.382982  3724 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.383903  3724 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.385084  3723 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.385692  3723 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.386070  3724 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.383152 32106 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:37.278807  3727 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.402769 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.405666 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.416002  3727 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.398404  3726 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:37.420948 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:37.422915  3726 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:37.406006 32107 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:37.353407  3665 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.386312  3723 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.388427  3413 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.424227 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:37.456665  3723 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.456849  3665 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:37.427901 31537 leader_election.cc:336] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.614s (SENT)
I20260709 12:23:37.418567  3727 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.279150 31566 rpcz_store.cc:276] 0709 12:23:35.741861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.900067 (+158206us) service_pool.cc:224] Handling call
0709 12:23:35.900383 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.908242 (+  7859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.908271 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.908741 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:23:36.101165 (+192424us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b48001302d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11e68caa1 00007fc11e683b37 00007fc11e6839ca 00007fc11e77b26f 00007fc11e77af37 00007fc11e78f55c 00007fc11e78f508 00007fc11e78f488 00007fc11e78f443 00007fc11e78e6ec 00007fc11d6b8a96
0709 12:23:36.324320 (+223155us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:37.123889 (+799569us) log.cc:844] Serialized 14 byte log entry
0709 12:23:37.276542 (+152653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.277835 (+  1293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.277924 (+    89us) raft_consensus.cc:1685] finished
0709 12:23:37.278035 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.278237 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27707,"prepare.queue_time_us":56152,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":175444,"raft.run_cpu_time_us":1199,"raft.run_wall_time_us":186261,"spinlock_wait_cycles":5080320,"thread_start_us":1219413,"threads_started":3,"wal-append.queue_time_us":465741}
W20260709 12:23:37.459111 31537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.700s (SENT) [suppressed 9 similar messages]
I20260709 12:23:37.459244  3705 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:37.461057 31537 leader_election.cc:336] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.696s (SENT)
I20260709 12:23:37.461609  3727 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.468292  3727 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.463512 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.469317 32107 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:37.465585 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:37.462073 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.464625 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.449754  3724 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:23:37.474689  3727 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.483696  3730 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.485702  3730 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.489988  3730 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.487622  3665 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.494391  3665 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.496079 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:37.496935 31568 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:37.497198  3665 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.492849 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:37.498328 31570 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:37.472054 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:37.493276 31537 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:37.490393 31573 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:37.482386  3714 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.921s	user 0.019s	sys 0.056s
I20260709 12:23:37.531540 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:37.531998 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:37.532650 31574 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:37.534024 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:37.534839  3733 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:37.535240  3719 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.536188  3719 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.537966  3705 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.539964  3721 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:37.542889  3260 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:37.543432  3260 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:37.544646 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 72730.4us
I20260709 12:23:37.544885  3260 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:37.548468 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55343.4us
I20260709 12:23:37.551878 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:37.546260 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:37.554736  3480 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.532809 31567 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.555894 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:37.550515 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.556738  3480 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.574694  3734 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.575548  3734 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.577080  3720 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:37.577740  3732 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.578400  3720 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:37.579008  3720 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:37.578467  3732 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.579945  3733 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.581197  3732 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.582222  3260 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.583838 31496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48102
I20260709 12:23:37.584601 31496 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:37.584973 31496 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.587430 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1183) took 2107 ms. Trace:
I20260709 12:23:37.587911 31571 rpcz_store.cc:276] 0709 12:23:35.480252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.569485 (+ 89233us) service_pool.cc:224] Handling call
0709 12:23:35.569768 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.630766 (+ 60998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.586912 (+1956146us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b54002634d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:37.587225 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113676672}
I20260709 12:23:37.588456 31494 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:37.590637  3719 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.592475 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:37.593262 31495 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.509600  3619 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.596653  3619 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:37.601425 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 51000.5us
I20260709 12:23:37.602140  3426 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.602312 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.556623  3705 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.603237  3726 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.604254  3726 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:37.606132  3733 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:37.597767  3480 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.598299 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1750) took 1213 ms. Trace:
I20260709 12:23:37.599004  3435 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.599803  3645 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:37.631140  3480 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.631894  3480 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.631170  3730 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.632975  3730 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.633903 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1175) took 2568 ms. Trace:
I20260709 12:23:37.606459 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:37.634255  3480 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.635804 31495 raft_consensus.cc:2410] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:23:37.625746 31491 rpcz_store.cc:276] 0709 12:23:36.376790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.379067 (+  2277us) service_pool.cc:224] Handling call
0709 12:23:37.590486 (+1211419us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54002e7f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:37.590651 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602784000}
I20260709 12:23:37.606539  3733 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:37.606869  3426 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.607194  3705 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.635789 31567 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:37.643782  3728 raft_consensus.cc:2764] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:23:37.650740 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44408.2us
I20260709 12:23:37.638446  3619 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.634300 31565 rpcz_store.cc:276] 0709 12:23:35.065834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.161292 (+ 95458us) service_pool.cc:224] Handling call
0709 12:23:35.161520 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.282049 (+120529us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:35.308470 (+ 26421us) log.cc:844] Serialized 14 byte log entry
0709 12:23:35.436567 (+128097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:35.436634 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:35.436694 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.633351 (+2196657us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54003dbdd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:37.633425 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.633698 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2964,"prepare.queue_time_us":25161,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":60718,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":211,"spinlock_wait_cycles":108064128,"thread_start_us":192608,"threads_started":2,"wal-append.queue_time_us":196040,"wal-append.run_cpu_time_us":1205,"wal-append.run_wall_time_us":1049250}
I20260709 12:23:37.667392  3730 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.650592  3734 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.669137 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.639791  3645 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.659166  3435 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.688756  3435 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.689213  3435 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.686159  3619 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.691509  3619 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.692065  3705 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.692647  3705 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.694834  3705 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.697283  3723 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.697829  3723 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.699010 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.699995  3723 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.700394 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.700809 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.701151 32113 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:37.698069 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.701442  3727 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.701797  3293 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.702080 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.702327  3293 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.702863 32109 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:37.704355  3293 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.707038  3529 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.672308 31496 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.707159  3413 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.720902 31498 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:37.722031  3617 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.722846  3628 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:37.723441  3628 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.725355  3735 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.725759  3628 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.726445  3529 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.726898 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.726917  3191 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.711225  3619 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.725975  3735 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.740253  3413 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.741112  3619 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.741972  3191 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.718173  3734 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.743512 31496 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.725762  3655 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.719780  3732 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.734078  3723 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.717808  3426 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.760619  3437 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.761510  3437 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.766184  3437 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.760617  3727 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.766765  3578 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.739137  3645 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.771653  3723 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.772214  3639 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:37.788362 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:37.792802 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 174683us
I20260709 12:23:37.751629  3734 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.767722  3578 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.753613  3732 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:37.841531 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 208492us
I20260709 12:23:37.842260 32109 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:37.799367  3628 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:37.838284  3293 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:37.851809 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 182832us
I20260709 12:23:37.837505  3726 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.798803  3655 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.858886  3628 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:37.860234 31416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1801) took 1701 ms (client timeout 2136 ms). Trace:
W20260709 12:23:37.860740 31416 rpcz_store.cc:269] 0709 12:23:36.158450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.175728 (+ 17278us) service_pool.cc:224] Handling call
0709 12:23:37.859997 (+1684269us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540010de54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:37.860131 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017537920}
I20260709 12:23:37.861402  3628 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.861959  3628 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.863909  3720 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.864774 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.865303  3720 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.866009 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.866643 32106 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:37.867938 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.872499  3650 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.873051 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.873075  3650 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:37.873731 32108 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.880607 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:37.882958 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 156331us
I20260709 12:23:37.891359 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.880934 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.896091  3741 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:23:37.880623  3726 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.896688  3645 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.898486  3726 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:37.898540 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.900321 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.900514  2939 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:37.901398  2939 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.902940 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:37.903373  3413 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:37.906754 31390 connection.cc:256] RPC call timeout handler was delayed by -1.3366701249997277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:23:37.906937  3723 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.907792  3723 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.908057  3639 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.908355  3723 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.908828  2939 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.908771  3639 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.909555  2939 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.911247  3639 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.911327  3735 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.912034  3619 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.912420  2939 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.915092  3191 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.916091  3529 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.857898  3743 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:37.916800 32109 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:37.907830 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.918648  3578 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.919368 31496 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:37.921706 31495 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:37.917402  3426 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:37.923692 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45512.6us
I20260709 12:23:37.916170  3734 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.917052  3743 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.925841 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:37.927371 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:37.940244 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.942515 32109 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:37.945492 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 43545us
I20260709 12:23:37.947397  3734 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.947513 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.948395 32109 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:37.948071  3734 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.949118 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:37.950380 32105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 885) took 1825 ms. Trace:
I20260709 12:23:37.950942 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.950826 32105 rpcz_store.cc:276] 0709 12:23:36.124635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:36.128053 (+  3418us) service_pool.cc:224] Handling call
0709 12:23:36.128430 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:36.479601 (+351171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:37.949818 (+1470217us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400112954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:37.950175 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806054272}
I20260709 12:23:37.951992 32114 raft_consensus.cc:2410] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:23:37.954121 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.957424 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:37.961006  3435 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.961968 31492 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:37.963215 32112 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:37.963624  3435 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.862552  3628 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:37.923123 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:37.951248 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:37.968613 32106 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:37.966760 32108 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:23:37.971688 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 176497us
W20260709 12:23:37.974036 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96976.8us
W20260709 12:23:37.974606 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51552.6us
I20260709 12:23:37.974080 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:37.978430 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:37.988262 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:37.988559  3742 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:37.989055 31420 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:37.989266  3742 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:37.989833 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:37.991101  3747 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:37.991696  3747 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.992060  3628 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.988158  3729 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:37.994127  3747 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.993894  3729 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:37.994488  3752 raft_consensus.cc:2764] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:37.982028  3705 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.995458  3705 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.995828  3705 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.996440  3729 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:37.972340  3728 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:37.998945  3728 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.999366  3728 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:38.002791 32110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 922) took 2146 ms (client timeout 1614 ms). Trace:
W20260709 12:23:38.003201 32110 rpcz_store.cc:269] 0709 12:23:35.807594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.810873 (+  3279us) service_pool.cc:224] Handling call
0709 12:23:37.953613 (+2142740us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b540049d9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:37.954012 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129911680}
I20260709 12:23:38.005095  3435 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.005807  3435 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.006852  3665 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:38.008172  3665 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.009065  3435 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.009651  3435 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:37.943377  3191 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:37.994258 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.015393 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.016600 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.015846 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.022092 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.022698 31415 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:37.985875 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.013604 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.014389 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.023768 31496 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:38.012163 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.016243 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.015690 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.023828 31493 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:38.014978 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.046993 32110 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.052215 31494 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:38.052582  3645 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:38.053078  3645 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.053306 32106 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:38.053489  3645 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:38.032752 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.054338 31423 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.055335 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.056486 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.057541 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.058867 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.059711 31418 raft_consensus.cc:2410] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:23:38.060415 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.061022 31418 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.047670  3628 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.061677  3628 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.063673  3753 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.064383  3753 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.010346  3435 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.010813  3578 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:38.010797  3743 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:37.990518  3742 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.010615  3665 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.081249 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.082952 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.083670 31493 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:38.084403 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.085443 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.088953  3753 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.017421  3655 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.090919  3517 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.091121  3655 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:38.091483  3517 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.091825  3655 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.093674  3517 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.093914  3655 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.094067  3705 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.095173 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 1910) took 2355 ms. Trace:
I20260709 12:23:38.067379 31420 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:38.068025 31495 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:38.057605 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.052093 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:38.082422 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.066774  3734 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.047834  3752 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:38.074623 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88806.6us
I20260709 12:23:38.075027 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:38.066298  3692 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:38.095614 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:38.099598 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 109226us
I20260709 12:23:38.096869 31498 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
W20260709 12:23:38.100063 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 131237us
I20260709 12:23:38.124560 31496 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:38.121882 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 96366.6us
I20260709 12:23:38.128043 31415 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:38.129516 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.131119 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.132589  3752 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.133550 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.134799  3752 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.137946 31418 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:38.100214  3727 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:38.139413  3692 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:38.139895  3692 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:38.139813  3727 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.141142  3692 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.142195  3627 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:38.142105  3727 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.129245  3578 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:38.143054 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.144011  3467 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.143934  3652 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:38.144711  3467 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:38.146152 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.143761  3578 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.148125 31493 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:38.148303 31418 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:38.155110 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.156081 31420 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:38.162959 31423 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:23:38.163829 31421 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:38.128993  3426 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:38.165963 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.167150 31492 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:23:38.166543 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43756.4us
I20260709 12:23:38.095516 31569 rpcz_store.cc:276] 0709 12:23:35.739998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.834431 (+ 94433us) service_pool.cc:224] Handling call
0709 12:23:35.843586 (+  9155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:35.881058 (+ 37472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:35.881088 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:35.889371 (+  8283us) log.cc:844] Serialized 26 byte log entry
0709 12:23:37.721065 (+1831694us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18003b9f20. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:23:37.856171 (+135106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:37.858589 (+  2418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.085382 (+226793us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b5400057154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:38.085433 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:38.094841 (+  9408us) raft_consensus.cc:1685] finished
0709 12:23:38.094859 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:38.095011 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899,"raft.queue_time_us":1377,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":120023296,"thread_start_us":114312,"threads_started":1,"wal-append.queue_time_us":2094974}
I20260709 12:23:38.169461 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.172042 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.170398 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:38.169924 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.169302 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.176613 32106 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:38.161597  3628 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.178063 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.178507 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.178960 31424 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:38.179306 31420 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.179380 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:38.173844 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.180238 31424 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:38.181492 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:38.178531 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.183166 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.183619  3467 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:38.178815 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:38.184345 32113 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:38.184299 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.185206 31415 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.178115 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.185935 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.186818  3755 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.187528  3628 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:38.187834  3692 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.188086  3628 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:38.190879  3628 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.188412  3260 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:38.182855  3743 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:23:38.179472 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.186901  3752 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.174549 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:38.209344 31491 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.142637  3627 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:38.198395  3260 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:38.200969 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.215672 32114 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:38.199021 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.230216 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.183166  3435 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.214637  3627 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:38.165993  3426 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.249429 31499 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:38.217882  3260 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:38.263451 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75534.8us
I20260709 12:23:38.261705 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.267482 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.268206 31419 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
W20260709 12:23:38.271178 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.276994 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.277612 32114 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:38.280457 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.280696 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.281103 31496 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:38.269469  3515 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:23:38.283258  3751 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:23:38.284022 31307 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0065979e5b9a477f8abf064563426291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:38.290532 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.291337 31572 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.294234 31568 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:23:38.287326 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.295061 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.303054 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.430953 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.431304 31419 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.432224 31424 raft_consensus.cc:2393] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:38.343921 31498 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:38.300922 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.351243 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1735) took 2879 ms. Trace:
I20260709 12:23:38.431012 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.436798 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:38.323729 32111 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:38.269634  3727 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:38.269765  3724 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.295681 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:38.434506 31499 rpcz_store.cc:276] 0709 12:23:35.471432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.472629 (+  1197us) service_pool.cc:224] Handling call
0709 12:23:35.472893 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:38.260914 (+2788021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:38.350917 (+ 90003us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400012a54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:38.351168 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6305189248}
I20260709 12:23:38.455744 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:38.322481 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45140.1us
I20260709 12:23:38.452315 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:38.461087 31491 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:38.455534 31420 raft_consensus.cc:2376] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9. Re-sending same reply.
I20260709 12:23:38.258561  3435 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:38.467056 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.464301 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.468483 31415 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:38.262138  3728 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:38.346163  3698 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.787s	user 0.006s	sys 0.042s
I20260709 12:23:38.473749 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.469844 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.327535  3723 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.478940 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.479205 31493 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:38.300103  3426 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.481583 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.322275  3751 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:38.495739 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.481787 31422 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
W20260709 12:23:38.484265 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 389087us
I20260709 12:23:38.479539 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:38.322063  3675 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.458936  3727 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.482999 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.488657 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.483763 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.480970 32110 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
W20260709 12:23:38.508641 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47337.4us
I20260709 12:23:38.495550 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.349360  3732 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.466284  3293 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.318327  3645 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:38.508023 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55848.6us
W20260709 12:23:38.495028  3650 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.006s
I20260709 12:23:38.469668  3734 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.515254 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.470383  3435 consensus_queue.cc:1243] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:38.496248  3751 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:38.518965 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.508955 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.520080 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:38.519527 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.466631  3724 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.520726 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.519583 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.295977  3482 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.199s
W20260709 12:23:38.540264 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.523674  3723 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:38.529629 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.530097 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.520413 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.531594 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.533859  3517 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:38.534047 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.534152  3762 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.521212  3743 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:38.539036 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.567576 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:38.534651  3755 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:38.558214 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 94084us
I20260709 12:23:38.517681  3727 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:38.582949 31493 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:38.328915  3733 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.561654 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:38.561610 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:38.534045 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 84125.6us
I20260709 12:23:38.562870 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:38.565403 31566 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.507654  3617 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:38.527663 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44742.8us
I20260709 12:23:38.583937 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:38.585273 31423 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:38.519308  3293 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.591272 31569 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.557293  3753 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.597389 31572 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:23:38.534529  3735 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:38.568668  3723 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.600704 31422 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:38.527292  3732 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:23:38.531013  3734 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.583626  3619 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:38.530005  3650 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.586071  3755 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.519239  3675 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.606230 31568 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:23:38.590958  3437 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:38.619726 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.620003 31571 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:38.621124  3675 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.621564  3437 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:38.622061  3437 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.622529 31420 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:38.606433 31565 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.625277  3728 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.627374  3645 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.606720  3428 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.629295  3428 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.631419  3428 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.633464 31570 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:38.633595  3724 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.634593 31418 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:38.557402  3768 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:23:38.636003  3768 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:38.636823  3768 consensus_queue.cc:1243] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:38.637379  3751 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.639004  3751 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.604746  3619 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.640014  3619 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.637373  3768 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:38.641528  3768 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:38.615201  3755 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.646139  3655 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:38.609764 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.647270 31569 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.615711  3733 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:38.617512  3734 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.606146  3641 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:38.651532  3641 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:38.652496  3641 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.653990  3641 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.601522  3753 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.660998  3753 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.630470  3650 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:38.642458  3768 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.666254  3705 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.619053 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.619192 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.604638  3617 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.667734 31574 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:38.667747 31566 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:38.619438 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.668902 31568 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:38.669112  3617 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.646543  3655 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:38.666577  3768 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.601178  3752 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:38.670311  3752 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:38.670362  3655 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.605230  3723 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.618639 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.679277  3293 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:38.675556 31572 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:38.680267  3260 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.680714 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.680979 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.681293 31570 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:38.681658 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.681881 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.682267 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.682847 31572 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:38.683059 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.683651 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:38.691129 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.694013 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.600776  3762 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.706761 31565 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:38.710160 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.703465  3617 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.711601 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.712229  3617 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.714268 31419 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:38.712297  3737 consensus_queue.cc:1175] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 12 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: [11.10-11.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:38.717893  3617 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.711205 31572 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
W20260709 12:23:38.719702 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 152235us
I20260709 12:23:38.722469 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:38.722270 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129434us
I20260709 12:23:38.671489  3752 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.342706  3760 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Committing config change with OpId 10.7: config changed from index 2 to 7, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:38.728816 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:38.731555 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 143531us
I20260709 12:23:38.733367 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.718593  3619 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.736912  3619 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.737178  3743 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.738411  3260 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.732620  3729 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:23:38.741163 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.741838 31568 raft_consensus.cc:2368] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13.
I20260709 12:23:38.742707  3778 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.743086 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.743347  3778 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.743752 31571 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:38.744619 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.745306 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.745730  3778 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.745843 31571 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.749311 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.732997 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.691219  3627 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.759079 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.759600 31571 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:38.765625 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.766360 31572 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:38.766422 31574 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:38.745864 31493 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:38.755385 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:38.779002 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 182077us
I20260709 12:23:38.766086 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:38.727888  3655 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.793782 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:38.791713 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:38.792264 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 59339us
I20260709 12:23:38.799906 31569 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.801411 31565 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:38.803328 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:38.752424  3764 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.161s	user 0.002s	sys 0.001s
I20260709 12:23:38.806329 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.825060 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:38.803753 31570 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:38.755560  3467 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:38.733203  3617 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.755721  3769 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:38.829457 31572 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.763055  3729 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:38.828099 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.764504  3762 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.835695  3617 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.839357 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.840682 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.842473  3617 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.842607 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.801326  3768 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:38.848985  3768 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.844619 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.834534  3769 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.849962 31493 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:38.750608  3723 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.803366  3482 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:38.849459  3768 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.850503  3755 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.859912  3769 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.865835  3627 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.867034  3733 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.867596  3733 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.868068 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:38.869601  3733 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.870247  3762 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.871057  3762 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:38.871444 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:38.846107  3729 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:38.871836 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:38.872812 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.872633  3729 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:38.876690 31493 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.850832 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.879962 31573 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:38.852700 31390 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:38.854043  3761 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:23:38.846798 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:38.885285 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.752108  3437 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.829942  3467 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:38.880167 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74301.7us
I20260709 12:23:38.880682 31495 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:38.870445 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:38.829938 32112 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
W20260709 12:23:38.898286 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.902449  3628 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.881147  3729 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.924693 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:38.901043 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:38.863644  3482 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:38.912055 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:38.895259  3467 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.902087 31498 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.890251  3783 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:38.925763 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:38.926611 31500 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:38.927577  3743 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:38.928364  3437 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:38.928294 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75674.9us
I20260709 12:23:38.928987 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:38.928859  3778 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:38.888206  3641 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:38.929590  3780 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:38.929917  3723 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.931257  3721 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:38.931521  3727 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.871878  3762 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:38.890515  3627 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:38.983592  3762 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:38.983731  3627 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.984202  3627 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.985035  3727 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.950963  3743 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:38.985765  3743 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.990975 31567 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 9: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:38.982342  3721 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:38.992416  3721 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.992774  3769 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.992957  3627 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:38.993687  3721 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:38.970989  3755 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.926285  3752 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:23:38.948336  3482 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.995222  3627 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:38.971261 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:38.974202  3783 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:38.996953  3783 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:38.979596 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67671.4us
I20260709 12:23:38.997931 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:38.999022 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.000087 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:39.001144 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:38.980175 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90557.2us
W20260709 12:23:38.969426 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.978211 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.002480  3482 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.003135 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.003873 31418 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:39.004607  3723 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.005141  3723 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.005481  3723 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.984539  3762 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.011515  3762 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:39.011368 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 62208.1us
I20260709 12:23:39.012969 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.013979  3628 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.014384  3628 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:39.014770  3628 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.015125  3578 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.015568  3578 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.015960  3578 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.951727 31499 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:38.982362  3778 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.022886  3755 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.023072  3778 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:39.023734  3778 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.023437  3628 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.024245  3778 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.897043  3733 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:23:39.004698  3482 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:39.025589 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:38.977939 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49020.2us
I20260709 12:23:39.026804  3628 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:38.996851  3737 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:39.023375  3755 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.031141  3755 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:38.973860  3768 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.040263 31389 leader_election.cc:400] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13.
I20260709 12:23:39.040627 31389 leader_election.cc:403] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.041878 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:39.044181 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:39.044855 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73699.4us
I20260709 12:23:39.031133  3737 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:23:39.050446 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 126286us
I20260709 12:23:39.050694 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:38.983093  3641 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:39.052457 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.057952  3735 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.058233  3769 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.059298  3737 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.047417  3752 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.048905  3617 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.063503 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.065066  3752 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.071061  3628 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:39.071782  3752 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.071959  3628 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:39.067513  3435 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:39.073004  3628 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.048458  3753 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:23:39.067850 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.068259 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.079972  3733 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.080402  3733 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.080772  3733 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.084007  3768 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.048300  3619 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:23:39.087532  3743 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.055176  3641 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.086167  3467 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:39.099572 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49461.5us
I20260709 12:23:39.101809 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.103708 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:39.091127  3437 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13.
I20260709 12:23:39.108659  3619 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.110440  3482 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:39.110888  3482 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:39.117504  3732 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.111248  3482 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.097275  3578 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.127660 31390 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.131145  3735 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:39.132886 31492 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:39.133973 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.136742 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:39.139613  3435 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.140349  3467 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.143610  3723 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.147022  3428 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:39.147404  3428 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:39.148264  3428 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.148972 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:39.124650  3732 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.150847  3732 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.151624  3768 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:39.152384  3768 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.152766  3768 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.153136  3768 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.150101 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:39.159147  3627 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.161166  3755 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.162261 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:39.163391  3723 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:39.164489 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:39.164991 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.172617 31498 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:39.110226  3752 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.181607 31495 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:39.182794 31497 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:39.184707 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66808.3us
I20260709 12:23:39.189654  3783 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.191450  3733 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.177646  3627 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.177146  3759 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:39.197647 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.205852 31494 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:39.206893  3721 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.206801  3437 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:39.254254 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.212136  3428 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.223982  3578 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.229486 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:39.229053 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:39.237982 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.227077 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.258219 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.258458  3778 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.259020 32113 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:39.259083  3435 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:39.259860  3435 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:39.259979 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.260713  3778 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.246603 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.232015 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.265151 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.267812 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.268537 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.269187 32109 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:39.258473 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.269768  3783 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.269820 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.226209  3769 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:39.270817  3260 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:39.271323  3769 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:39.271757  3769 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:39.272650  3769 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.263505  3721 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.275317 31415 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:39.276444  3721 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.265125  3437 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:39.228013  3641 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.270326 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.277031  3437 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:39.278973 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.279197  3641 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:39.278878  3437 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.279789 31417 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:39.280121  3437 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.283129  3755 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.283025 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.283525 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.225942  3752 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.292397 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.293740 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.310233 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.310592 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.311218 31418 raft_consensus.cc:2376] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13. Re-sending same reply.
I20260709 12:23:39.311576 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.312202 31422 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:39.313326 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.316354 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.256265  3628 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:39.322109 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.320694 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.324070 31417 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:39.326025 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.326764 31416 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:39.314934  3426 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:23:39.328575  3426 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:39.311888  3435 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.329339  3482 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.329882  3435 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.330463  3435 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.285193  3743 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.331275  3628 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.333021  3732 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.333410  3628 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:39.334908 31491 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:39.312011  3727 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:39.335638  3727 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.336066  3727 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.340024 32110 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:39.341892 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:39.342506 31574 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:39.335649 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.343919 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.344514 31422 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:39.346230 31421 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:39.359062 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.359062 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.369343 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.385092 32113 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:39.386116 31417 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:39.392697  3774 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:39.359220  3628 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:39.406940 32110 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:39.413138 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 128285us
I20260709 12:23:39.414332 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.414183 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.400305  3732 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.461995 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.462771 31418 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.413113  3741 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.485253 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.486011 31494 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:39.479875 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.227605  3675 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:23:39.482275 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.488271 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.489146 32113 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:39.495764 31424 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:23:39.496163 32112 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:23:39.409750  3628 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.496135 31424 pending_rounds.cc:85] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 9
I20260709 12:23:39.427625  3768 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.498942 31424 pending_rounds.cc:107] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:23:39.514822 31424 raft_consensus.cc:2889] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:39.522811 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108728us
I20260709 12:23:39.523547 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:39.524032 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:39.527801 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.530103 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.513509  3806 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.516671  3733 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.532943 32112 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:39.518956  3794 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.571156 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74901.9us
I20260709 12:23:39.573413 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:39.577575 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.578583 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.534214  3482 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:39.587384 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.588490 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.589069 31418 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.393625  3774 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.495043  3741 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.600597 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:39.601827 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.604282 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.602789 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.605091 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.606868 31424 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 8: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:39.607753 31492 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:39.608084 31498 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:39.568536  3435 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.615483 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.633556 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.635452 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.636027 31420 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.637095 31495 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:39.639461 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:39.640334 31493 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:39.637130 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.642220 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:39.642526  3805 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:39.642876 31496 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:39.603183  3733 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:39.648453 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:39.652822 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.583997  3751 consensus_queue.cc:1059] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:23:39.582134  3760 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:23:39.637223 31418 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
W20260709 12:23:39.661931  3802 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:39.662331  3755 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.649055 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:39.666697 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.667735 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:39.668593  3783 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:39.670799  3783 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:39.581974  3759 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:23:39.575752  3794 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.654831  3743 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:39.691687 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 168217us
I20260709 12:23:39.692588 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.694742 31420 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:39.644555  3810 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:39.658746  3752 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:39.655640  3733 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:39.687435  3804 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:23:39.614861  3806 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.703536 32106 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:39.704735 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:39.705041 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.726856 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.671743  3751 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:39.726092 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.704109 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.724776 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.668953  3578 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:23:39.693753  3627 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.728987  3779 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.747371  3779 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.748332 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:39.748870 32109 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.749522  3779 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:39.755076  3628 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:39.755774  3628 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:39.756206  3628 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.756659  3628 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.744055  3760 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:39.703392  3807 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.705726  3810 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:39.761997 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.728965  3733 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:39.671721  3783 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.764475 32108 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:39.693450  3755 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:23:39.738456  3751 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:39.745426  3768 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:39.797995 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71965.9us
W20260709 12:23:39.798329 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107351us
I20260709 12:23:39.773551  3810 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:39.801132 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:39.799161 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:39.802770 32107 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:39.770870  3760 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.786199 32109 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:39.760912  3260 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:39.805214  3768 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.812304  3435 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.821250  3821 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.822117  3823 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:39.824007  3791 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:39.805047  3807 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:39.824429  3791 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:39.824676  3807 consensus_queue.cc:1243] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:39.825341  3807 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:39.825875  3807 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:39.825388  3791 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:39.827013  3798 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.333s	user 0.000s	sys 0.003s
I20260709 12:23:39.828838  3741 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:39.828948 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.807318  3760 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:39.819233  3768 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:39.811532  3808 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 12:23:39.812219  3811 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:23:39.812549  3737 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:23:39.819504 32107 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:23:39.811596  3578 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:39.812515  3782 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:39.810042  3755 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:23:39.876109 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44487.7us
W20260709 12:23:39.876713 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.811677  3801 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:39.699038 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:39.880457 31498 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:39.810617 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:39.890045 31494 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:39.891116 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:39.935607 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.935829 31566 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:39.894903 32105 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:39.936290 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.730993  3752 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.899081 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.806705 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:39.901298 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 174162us
I20260709 12:23:39.938045 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:39.941771 31420 raft_consensus.cc:2368] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:23:39.913563  3768 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:39.938832 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:39.947218 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 145885us
I20260709 12:23:39.950183 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:39.920732  3791 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:39.959750 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 160650us
I20260709 12:23:39.960878 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.932001  3578 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.976791 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.979458 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:39.945466  3752 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:39.939252  3755 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:39.810935  3751 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.973516 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.939407  3782 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:39.981640 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:39.972062  3741 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:39.978118  3578 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:39.981122  3778 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:39.952286  3759 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:23:39.984050  3735 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:39.992324  3755 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.952440  3628 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:39.974859  3792 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:23:39.939965  3807 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:39.996519  3741 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.998569  3774 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.041234 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:40.035882  3727 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.008s
I20260709 12:23:40.028559  3794 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.020569  3822 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:23:40.030009  3827 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.044448  3741 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:40.037930  3806 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.071066  3755 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:40.117674  3825 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:23:40.122326 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e166c1cb41f04d55a85e6c0d7966e32e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:40.124166  3820 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:23:40.128147  3793 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.704s	user 0.002s	sys 0.000s
I20260709 12:23:40.072018  3774 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.071854  3801 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.070005  3735 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:40.156955 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.069038  3829 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:40.107824  3437 consensus_meta.cc:287] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.827s	user 0.013s	sys 0.004s
W20260709 12:23:40.209120 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 398600us
W20260709 12:23:40.211862 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 170707us
I20260709 12:23:40.213976 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.215260  3826 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:40.215579 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 240072us
I20260709 12:23:40.216514 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.218459 32080 leader_election.cc:400] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:23:40.218887 32080 leader_election.cc:403] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:40.219993  3830 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.220587  3830 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:40.221194  3832 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:23:40.221630  3830 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.228408 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.236898 31463 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.239085 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.240557  3628 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.241214  3628 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:40.249634  3723 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:40.252952 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:40.253335 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.254870 31540 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.235536  3774 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.257725  3774 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:40.251119  3778 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:40.260030  3801 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.265265 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.098764  3727 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.270851 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.272312 31422 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:40.274290 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 1991) took 1106 ms. Trace:
I20260709 12:23:40.274941 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.274726 31491 rpcz_store.cc:276] 0709 12:23:39.164052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.164773 (+   721us) service_pool.cc:224] Handling call
0709 12:23:39.165015 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.335286 (+170271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.270235 (+934949us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400360e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:40.270407 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390195968}
I20260709 12:23:40.278756  3783 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.279506  3783 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:40.272898  3806 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:40.289716  3839 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.084s	user 0.002s	sys 0.000s
I20260709 12:23:40.295236  3735 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.300962  3751 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:40.305392  3733 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 12:23:40.305912  3733 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:40.308846 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:40.311808  3743 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.001s
I20260709 12:23:40.312290  3743 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:40.268735  3826 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:40.273614  3832 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:40.331387 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 392640us
I20260709 12:23:40.333103 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:40.326613  3826 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:40.340914  3751 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.332002  3832 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.342308  3751 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:40.346005 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.348394  3655 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.348896  3655 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.349259  3832 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.318223  3752 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:40.353703 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.351964 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.356108  3655 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.356940  3752 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:40.351668 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 372381us
I20260709 12:23:40.367479 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.341409  3826 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:40.327643  3831 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:23:40.371045 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:40.345464  3513 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:40.373744 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98883us
I20260709 12:23:40.377378 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.361181  3823 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.376073  3822 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:40.391686 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 152648us
I20260709 12:23:40.374779  3513 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:40.392534  3795 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.378037  3426 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:40.373198  3833 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.380043 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:40.397337 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.386693  3801 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.411175  3426 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:40.422499  3426 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.423635  3769 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.412184  3513 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.413349  3578 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.415094  3727 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:40.394968  3751 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.418624  3467 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:40.375264  3743 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:23:40.441283 31491 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.386351  3437 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:23:40.444621 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 64621us
I20260709 12:23:40.450599 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.456239 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.426239  3822 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:40.461872 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.439440  3723 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:40.439975  3467 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:40.448519  3513 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:40.444355  3823 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:40.466179 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.473148 31498 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:40.475703  3844 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.476596  3813 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.478847  3578 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.479406  3467 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.480978 31491 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:40.485762  3840 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:40.486356  3840 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:40.487908  3467 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.491667 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.493124 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:40.500429 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.407725  3795 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.502743 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.473439  3733 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:40.506857 31498 raft_consensus.cc:2368] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:23:40.507565 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.510129  3847 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:40.499320  3844 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.498764  3801 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:40.519167 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:40.519740 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.520356 31498 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:40.522004 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:40.520821 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 110360us
I20260709 12:23:40.556944 31499 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:40.563519 31420 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:40.499432  3813 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:23:40.565799 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.512389  3752 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.570176 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.582579 31566 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.583447 31496 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:23:40.583487 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.585522 31495 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:40.588927 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.548586  3578 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:40.547967  3733 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.592509 31568 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.570323  3426 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.571595 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.595827  3840 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.596323  3849 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:40.596954 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.572381 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.597537 31567 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 8.
I20260709 12:23:40.598369 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.598433 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.599074 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:40.599354 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.599582 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.599867 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.600194 31566 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
W20260709 12:23:40.600284  3760 consensus_meta.cc:287] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260709 12:23:40.600473 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.600847 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.600760  3760 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.601686 31572 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.601557 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.602723 31569 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:40.602834 31419 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:40.574777 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.574724 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.604605 31417 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:40.590610  3768 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.004s
I20260709 12:23:40.576040 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.607561 31420 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.577086 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.521430  3778 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:23:40.620007  3795 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.620886  3848 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:23:40.623085 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.624046  3741 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.624575 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.625555  3807 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:40.625918 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.626375  3741 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.575618 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.608533 31424 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.609828  3426 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:40.615360  3797 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.121s	user 0.004s	sys 0.004s
I20260709 12:23:40.560689  3822 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.593693  3733 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.646224 31500 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:40.626801  3768 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.594812 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:40.627592 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.631806 31569 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.632721 31565 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:40.582342  3823 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.637622  3782 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:40.640128  3810 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.000s
I20260709 12:23:40.641587 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:40.642812 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.592567  3578 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:40.646996 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 3076) took 1165 ms. Trace:
I20260709 12:23:40.667404 31574 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:40.668080 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.667296 31422 rpcz_store.cc:276] 0709 12:23:39.481921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.482047 (+   126us) service_pool.cc:224] Handling call
0709 12:23:40.646820 (+1164773us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54003b0e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:40.646943 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726456192}
I20260709 12:23:40.645629  3675 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.594710  3847 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:40.657599 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.677755 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.658653 31573 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:23:40.672896 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.673777 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.648217  3733 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.679706 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.634876 31420 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:40.637666  3801 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.666584  3778 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:40.693451 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.694437 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.673094  3578 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:40.694943 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.697531 31569 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.701727 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:40.703624 31421 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:40.651764  3826 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.704489 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.704567 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.707278 31569 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:40.707417 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.705412 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.708437 31565 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:40.708797 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.691406  3806 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.695938  3760 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.713086 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.721227 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.714919 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.684401  3675 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.725701 31569 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.726553 31572 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.730319 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.726905 31568 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:40.711236  3794 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.675843  3810 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.732820 31573 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.735363 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.735883 31491 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:40.703104  3778 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.742547 31565 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:40.725229  3752 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.746531 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.746626 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.749858 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.742977 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.751034 32109 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:40.731886  3751 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:40.759094 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.758882 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.761409 31566 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:40.727286  3830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.013s
I20260709 12:23:40.754667 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.760118 31574 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.763381 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.763463 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.765136 31571 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:40.767088 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:40.772375 31424 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:40.772591  3844 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.763895  3752 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.739471  3847 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.778980 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.781030 31571 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:40.781910  3741 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:40.782110 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.783375 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.781124  3849 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.783536  3831 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:40.784082  3844 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:40.784623  3831 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:40.785216  3778 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.785271  3831 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:40.765091  3830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.006s	sys 0.014s
I20260709 12:23:40.785820  3831 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:40.786100 31540 leader_election.cc:400] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:23:40.737346  3794 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.789439 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:40.794343 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.798667  3794 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.801219  3840 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.801998  3732 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.803082 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.804981 31423 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:40.806277 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.808025  3675 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.808259 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:40.810856  3768 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:40.811650  3844 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:40.807914 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.817598 31565 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:40.810864  3778 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.819594 31465 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:40.812580  3741 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:40.823300 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.824649 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.824903 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:40.825484 31569 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:40.810949  3849 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.827832  3840 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.837324  3831 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.826932  3741 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:40.838768  3852 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:23:40.840193  3426 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.878466 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:40.840703  3655 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:40.841476 31423 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:40.882040 32106 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:40.841323  3794 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:40.841635  3826 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.842015 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:40.889436 31418 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:40.842260 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 914) took 1144 ms. Trace:
W20260709 12:23:40.842794 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 468243us
I20260709 12:23:40.891263 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.861491  3830 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:40.831090  3513 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:40.845386  3810 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:40.846158 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:40.900494 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54404.5us
I20260709 12:23:40.818859  3751 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.849210 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.857708 31565 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:40.880343  3828 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.864275 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:40.824980  3844 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:40.876196 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:40.879081 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:40.886466 32105 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:40.864796  3778 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:40.893276 31417 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:40.842931 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:40.896394 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:40.898109 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:40.859551 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:40.919173 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 70038.8us
I20260709 12:23:40.932550 31565 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:23:40.959342 31566 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:40.919704  3513 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.863893  3482 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:23:40.935190  3791 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:40.903028  3751 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:40.927024  3810 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:40.916687 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:40.942591 31569 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:40.926072 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.923939  3260 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:40.897023  3768 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.952549 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.931986 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 918) took 1035 ms. Trace:
I20260709 12:23:40.889894 32114 rpcz_store.cc:276] 0709 12:23:39.697764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.697910 (+   146us) service_pool.cc:224] Handling call
0709 12:23:39.732762 (+ 34852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:39.733024 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:23:39.936853 (+203829us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.361405 (+424552us) log.cc:844] Serialized 14 byte log entry
0709 12:23:40.841744 (+480339us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18004b73c0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:23:40.841905 (+   161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:40.841958 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:40.842015 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:40.842080 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:40.842189 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15645,"prepare.queue_time_us":288215,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":482179,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":4240,"spinlock_wait_cycles":10172032,"thread_start_us":555284,"threads_started":2,"wal-append.queue_time_us":461123}
I20260709 12:23:40.936072 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:40.987466 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51485.2us
I20260709 12:23:40.942667 31574 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:40.929075 31570 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:40.960047 31494 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:40.988541 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62557.3us
W20260709 12:23:40.960779 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 101334us
I20260709 12:23:40.989727 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.904258  3831 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:40.959085 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:40.980391 31566 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:40.982161 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.982407 31492 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:23:41.001811 31496 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:40.982802 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:40.989832 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:40.961239 31424 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:40.981488  3844 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.984210  3751 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:40.984750  3260 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.000075 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:41.006013 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.006486 31499 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.006860 31494 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:40.985477 32109 rpcz_store.cc:276] 0709 12:23:39.896598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.959767 (+ 63169us) service_pool.cc:224] Handling call
0709 12:23:40.931806 (+972039us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54005dc5d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:40.931911 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741315328}
I20260709 12:23:41.001710 31498 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:40.958299  3836 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.013199 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:40.966967  3840 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:40.942162  3578 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:40.954655  3828 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.016324 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:41.030321 31570 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:40.983881  3843 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.942503  3830 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:40.980913  3791 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:40.983649  3826 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.008518  3515 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:41.012328  3847 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:40.978514  3655 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:23:41.012220  3260 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.044653  3732 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:41.033661  3849 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.067981  3849 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.067759 32111 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 2 to 7, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:41.070343  3849 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.014760  3840 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:41.009034  3853 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.009058  3435 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:41.044133 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.160972 31499 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:41.161552 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 117593us
I20260709 12:23:41.016001  3513 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:41.035324  3848 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:41.033730  3727 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.212035  3727 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.217226  3782 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.217955  3795 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:41.218413  3795 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.219251  3795 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.220592  3795 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.222175  3755 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.071081  3752 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.072922  3578 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.224435 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.033676  3482 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:23:41.225235 31572 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:41.225608  3482 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:41.026989  3827 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.074741  3826 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.226146 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.226008  3741 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.227094  3741 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.063854  3515 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.079304  3844 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.028021  3794 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:23:41.228229  3515 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.091212  3733 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.230958  3755 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.232257  3733 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:41.232503 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.233348  3780 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:41.233709  3780 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.234500  3780 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.067749  3732 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:41.236315  3732 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.055603  3843 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.238480  3727 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.031090  3836 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:41.163226 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 156859us
W20260709 12:23:41.170979 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 177898us
I20260709 12:23:41.164427  3807 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.160414  3840 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.273289  3807 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.168792  3723 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.176126  3828 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.159358  3737 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.159574  3829 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:41.180842  3830 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.159341  3792 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.185290  3751 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.186436  3759 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:41.275276 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.275358  3737 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.276893  3792 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.277868 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:41.278836  3829 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.281266  3655 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.281729  3751 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.282511  3759 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.283556  3759 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.284758  3759 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.186924 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.160770  3435 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:41.286954 31568 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:41.287323  3435 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.200073 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:41.202906  3791 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.205153  3721 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:41.290221  3721 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:41.290583  3721 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:41.291474  3721 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.292968 31568 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:23:41.294955  3435 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.295904  3829 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:41.296406 31318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 301) took 18492 ms (client timeout 15000 ms). Trace:
I20260709 12:23:41.296840  3791 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:41.297206  3737 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.298477  3792 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.299909  3755 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.209479  3778 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:41.210757  3849 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:23:41.081907 31496 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:41.155381 31573 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:41.054234  3823 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.226027  3482 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.247151 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:41.259038  3867 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 12:23:41.259369  3675 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:41.260308  3760 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:41.263226  3801 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.264003 32106 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
W20260709 12:23:41.265888  3868 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
I20260709 12:23:41.266510  3467 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:41.233174 31567 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:41.233139 31566 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:41.340155 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.340858 31566 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:41.341687 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.302017 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.342624 31494 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 7.
I20260709 12:23:41.343940 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.303165 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:41.305258  3723 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.305680 31495 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:41.305827 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.306141  3437 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.306819 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:41.310732 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.307897 31390 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:41.345654 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 339842us
I20260709 12:23:41.354470 31565 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:41.358345 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:41.359421 32109 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:41.378226 32110 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:23:41.372721 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65041.2us
I20260709 12:23:41.380548 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.370971 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.386466 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:41.341221  3675 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.387781 31573 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:41.390949 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:41.388375 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.341068  3760 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.380189 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:41.396371 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:41.400143 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.401851 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.401957 31422 raft_consensus.cc:1240] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:41.402441 31494 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:41.385665 32105 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:41.319840  3737 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:23:41.410996 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:41.390690 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.412356 31496 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:41.412768 31498 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:41.413800 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:41.354067  3723 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.351378  3801 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.399034 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.403268 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.415757 31419 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:41.418062 31420 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:41.296782 31318 rpcz_store.cc:269] 0709 12:23:22.803559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.804827 (+  1268us) service_pool.cc:224] Handling call
0709 12:23:23.208068 (+403241us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:41.296188 (+18088120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:32.787633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:33.070057 (+282424us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:33.073414 (+  3357us) write_op.cc:435] Acquired schema lock
0709 12:23:33.075433 (+  2019us) tablet.cc:662] Decoding operations
0709 12:23:33.234114 (+158681us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:33.234232 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:33.234275 (+    43us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:23:33.680460 (+446185us) tablet.cc:701] Row locks acquired
0709 12:23:33.689206 (+  8746us) write_op.cc:260] PREPARE: finished
0709 12:23:33.724395 (+ 35189us) write_op.cc:270] Start()
0709 12:23:33.776250 (+ 51855us) write_op.cc:276] Timestamp: P: 1783599813724307 usec, L: 0
0709 12:23:33.814291 (+ 38041us) op_driver.cc:348] REPLICATION: starting
0709 12:23:33.944350 (+130059us) log.cc:844] Serialized 10410 byte log entry
0709 12:23:36.070237 (+2125887us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:36.489827 (+419590us) op_driver.cc:464] REPLICATION: finished
0709 12:23:36.804990 (+315163us) write_op.cc:301] APPLY: starting
0709 12:23:36.805098 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:37.014110 (+209012us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:37.014144 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:38.145851 (+1131707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:38.146383 (+   532us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:23:38.174452 (+ 28069us) write_op.cc:312] APPLY: finished
0709 12:23:38.207578 (+ 33126us) log.cc:844] Serialized 228 byte log entry
0709 12:23:38.588777 (+381199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.634961 (+ 46184us) write_op.cc:454] Released schema lock
0709 12:23:38.635091 (+   130us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:38.635807 (+   716us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.635845 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":804137,"reported_tablets":48,"spinlock_wait_cycles":119573760,"child_traces":[["op",{"apply.queue_time_us":311565,"apply.run_cpu_time_us":97990,"apply.run_wall_time_us":1830737,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112963,"num_ops":26,"prepare.queue_time_us":376332,"prepare.run_cpu_time_us":47701,"prepare.run_wall_time_us":1661824,"raft.queue_time_us":259006,"raft.run_cpu_time_us":10076,"raft.run_wall_time_us":373015,"replication_time_us":2649717,"spinlock_wait_cycles":180230912,"thread_start_us":1540560,"threads_started":5,"wal-append.queue_time_us":993299,"wal-append.run_cpu_time_us":24675,"wal-append.run_wall_time_us":4100951}]]}
I20260709 12:23:41.404189 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.419207 31417 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:41.416862  3760 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.405838 31495 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:23:41.420099 31495 pending_rounds.cc:85] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 10
I20260709 12:23:41.420347 31495 pending_rounds.cc:107] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:41.420572 31495 raft_consensus.cc:2889] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:41.416885  3807 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.406456 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:41.416780 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.420593  3760 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.422791 32107 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:23:41.405704 31422 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:23:41.407050 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.407434  3517 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:41.390731  3655 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.393888  3482 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.439884 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:41.408659 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.371255  3467 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.409439 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:41.449011 31415 raft_consensus.cc:2376] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13. Re-sending same reply.
I20260709 12:23:41.449324 31423 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:41.347702  3823 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.393409 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.456002 32113 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
W20260709 12:23:41.424980 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.431408 31492 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:41.406929 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.341243  3426 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:23:41.380650  3751 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.436611  3737 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.446939 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 174395us
W20260709 12:23:41.437377 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.450618 31572 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:41.455446 31491 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:41.458775 32106 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:41.440413 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.370792  3437 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.457824 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:41.463624 31493 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:41.416144  3848 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:23:41.464941  3513 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:23:41.465199  3737 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.466780  3829 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:41.467382  3737 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.467834  3829 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:41.468278  3829 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:41.469257  3829 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.455312  3675 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.471964  3675 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.472429  3437 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.474327 32113 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:41.474877  3827 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:41.436661  3517 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.469815 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.475808  3517 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.476434  3829 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:41.476895 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.465586  3848 consensus_queue.cc:1243] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:41.437016  3755 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:41.448280  3752 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:41.509828  3426 consensus_queue.cc:1243] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:41.511816 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:41.517601 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.483009  3792 consensus_queue.cc:1175] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 7 } }
I20260709 12:23:41.448424  3655 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.446156  3260 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:41.519315 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.483664  3826 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.508225  3705 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.436776 31317 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:41.530987  3879 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.531510  3879 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.531929 31317 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 9, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 9 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:41.533653  3879 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.534626 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.535354  3723 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.537022  3849 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.533895 31317 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:41.523913 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.518657  3755 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.557315  3755 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.562209 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:41.562950 31416 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.562999 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.563406 31416 raft_consensus.cc:614] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:41.564989 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.565649 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.464975  3840 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.556972  3823 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.572470 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:41.573460 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.574321 31418 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:41.508770  3737 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:41.575486 31493 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:41.524348  3822 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:41.524636  3752 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:41.606303 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.607326 31495 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:41.608793 31496 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:41.579607 31500 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:23:41.611795 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 142050us
I20260709 12:23:41.569950  3848 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.574086  3879 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:41.580968 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.581571 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:41.625588 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44693.1us
I20260709 12:23:41.608443  3823 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:41.629266 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47762.5us
I20260709 12:23:41.611907  3705 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.631625  3759 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:41.643951 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 132203us
I20260709 12:23:41.646184 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.632668  3840 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.646824 32110 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:41.579926  3723 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:23:41.633894 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.623792  3822 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:41.634478  3887 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:41.635335 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:41.635866  3780 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.616642 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.611274  3876 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:41.641942 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.632702  3847 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:41.623389  3879 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.540333 31317 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 11, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 11 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.648900 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.649096 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:41.657618 32108 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:41.651895 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.630124  3426 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:41.650889 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:41.656661 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.658439 32106 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:41.644949  3823 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:41.655128  3759 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.649358  3827 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:41.635772  3752 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.659906 31495 raft_consensus.cc:2410] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:23:41.660009 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.664932  3887 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:41.669019 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.625303  3848 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.672643 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.673537 31423 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:41.660315 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.676120 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.676887 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
W20260709 12:23:41.677067 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 60529us
I20260709 12:23:41.678105 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.679809 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.679785 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.681109 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.682024 31422 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:41.683259 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.687901  3892 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.689457  3843 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:41.692027 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:41.692993  3892 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:41.693329  3892 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.693635  3892 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.695762 31571 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:41.695873 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.696149 31571 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:41.696909 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.661578  3822 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.672019  3887 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:41.701982  3887 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.703472  3887 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:41.647921  3872 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:23:41.707604 31317 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 11, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 11 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.708523 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:41.709116 31423 raft_consensus.cc:606] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.709442 31423 raft_consensus.cc:614] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:41.662994  3655 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.710767  3847 consensus_queue.cc:1243] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:41.658756  3741 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:41.712476 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.713806 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:41.709578 31317 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 7, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 7 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.715909 31415 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:41.659267  3426 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:41.711524 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:41.721097 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.696911 31571 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.659432  3879 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.725184 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:41.736786 31493 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:41.736891 31573 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 9.
I20260709 12:23:41.724897 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.662063  3838 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:41.726631 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.728272  3891 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:41.664041  3260 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.728902  3801 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.728579  3827 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.729287  3849 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:41.725018  3844 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:23:41.733265  3892 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:41.759299 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:41.742473 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 62759us
I20260709 12:23:41.749503 32108 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:41.711467  3741 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.753562 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.799315 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.721585  3847 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:41.783483 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.725018  3426 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:41.809753 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.811211 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:41.663568  3759 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.750414  3872 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.662670  3823 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.816582  3849 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:41.817656  3517 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.801199  3741 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.812635  3260 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.816624 31566 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:41.802074  3870 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:23:41.660125  3876 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.820784 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:41.829193 31417 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.821506 31420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:41.753047  3723 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:41.743124  3838 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:41.750633  3891 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.751858  3890 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:41.823606 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 105138us
I20260709 12:23:41.823693 31415 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:41.830113 31420 raft_consensus.cc:606] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:41.849742 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 105788us
I20260709 12:23:41.850147 31420 raft_consensus.cc:614] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:41.851897 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.848987  3743 consensus_queue.cc:1059] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:41.854578  3848 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:41.830894  3260 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.857059  3260 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.857774  3752 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:41.858258  3752 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.858654  3752 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:41.858773 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.827966  3892 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:41.863749 31493 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:41.864233  3849 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:41.864995 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:41.865962 31493 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:41.865411  3849 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.890599 31416 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:41.870807 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:41.875272 31463 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.892591 31420 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:41.879333 31417 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:41.894125  3848 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:41.832334  3791 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.835706  3838 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:41.903890 31423 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:41.904634 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.851747  3888 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.851610  3890 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:41.906477 31493 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:41.835575  3891 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:41.911340 31493 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:41.916402 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.827898  3872 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:41.920403 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45276.1us
I20260709 12:23:41.921277 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.896273  3900 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:41.911240  3847 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.912676  3890 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:41.905833  3791 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:41.936076 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:41.935530 31493 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:41.934579  3899 raft_consensus.cc:2764] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:23:41.959033  3885 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:23:41.959421  3847 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:41.965123 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.965665 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.965857 32109 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:41.966355 32110 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:41.970585 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:41.971084 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:41.971782 31493 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:41.975456 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:41.976785  3829 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.977270  3829 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:41.975528 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 919) took 1108 ms. Trace:
I20260709 12:23:41.980679  3705 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:41.979568 32111 rpcz_store.cc:276] 0709 12:23:40.867402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.867541 (+   139us) service_pool.cc:224] Handling call
0709 12:23:40.867817 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.067592 (+199775us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:41.302635 (+235043us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.608828 (+306193us) log.cc:844] Serialized 14 byte log entry
0709 12:23:41.609104 (+   276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:41.609166 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:41.609218 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:41.962964 (+353746us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18004b7420. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:23:41.975280 (+ 12316us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54008a02d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:41.975342 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:41.975474 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2916,"prepare.queue_time_us":35599,"raft.queue_time_us":4767,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":29334,"spinlock_wait_cycles":481332224,"thread_start_us":266017,"threads_started":1,"wal-append.queue_time_us":305524}
I20260709 12:23:41.865463 31317 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: leader changed from <none> to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:41.983157  3897 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:23:41.984047 31317 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 9, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:41.985889 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.986629 31570 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:41.987010 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:41.956441  3900 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:23:41.989998 31570 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:41.991853 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.993268 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:41.995039 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:41.912263  3888 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.936201  3801 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:41.997749 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:41.987215  3752 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:41.997813 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.000133 31574 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:42.001075 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:42.025190 31570 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:42.026191 31573 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:42.035476  3741 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:42.038028 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.023250  3655 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.028740  3428 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:23:42.042896  3905 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.037966  3741 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.044013  3814 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 12:23:42.048820 31537 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:42.056150  3876 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:42.057243 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.059295 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:42.060299 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:42.061422 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:42.066828 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:42.074962 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:42.105908 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.077066 31499 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:42.110477 31415 raft_consensus.cc:2393] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:41.986397 31317 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:42.131206  3906 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:42.134619  3898 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.127226  3914 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:42.155956  3898 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.141489 31419 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:42.129859  3890 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.159950  3838 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.160499  3898 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.160739  3890 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.150821  3752 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.152012  3741 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.162927 31420 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:42.162977  3741 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.167281 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.168735 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:42.167764  3741 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.176832  3891 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.063483  3737 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.178431 32107 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: [14.13-16.14]
I20260709 12:23:42.073834  3769 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:42.067870  3905 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.156584  3914 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.135141  3894 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:23:42.179632 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:42.181432  3914 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:42.158126  3843 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.170569  3752 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:42.171293  3721 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:42.153074  3872 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.063586  3899 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.077206  3801 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:42.150256  3879 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.162544  3838 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.255759 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:42.293828 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:42.198086  3894 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:42.195549  3895 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:42.185084  3905 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.196103  3769 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:42.156715 31317 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 4 to 8, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 9 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:42.395933 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:42.317287 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:42.397181 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.299916  3737 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:42.346364 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 52601.7us
I20260709 12:23:42.198376  3843 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.405162 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:42.374650  3894 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.396136  3727 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.510746  3727 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.513371  3727 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.396502  3741 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.427587  3879 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.435292  3843 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.440196  3917 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.444203  3891 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.452766  3905 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.455078 31317 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.464357  3705 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:42.466168 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.514150  3894 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:42.251026  3899 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.374357  3872 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:42.554597 31304 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e166c1cb41f04d55a85e6c0d7966e32e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:42.553328  3727 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.508392  3737 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:42.552611  3426 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 12:23:42.471308  3769 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.579284  3751 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:42.604097 31304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49552.1us
I20260709 12:23:42.569310  3741 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.623878  3467 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.604096  3705 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.608032  3727 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:42.584645  3911 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:23:42.576670  3905 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:42.637766  3905 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.633373 31565 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:42.615823  3751 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.617471  3914 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.558434  3768 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.610034  3737 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.576898  3917 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:42.656658 31572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58364 (request call id 1235) took 1479 ms (client timeout 1954 ms). Trace:
I20260709 12:23:42.656886  3831 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.657474  3831 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.658025 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 2022) took 1250 ms. Trace:
I20260709 12:23:42.658267  3917 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.658501 31496 rpcz_store.cc:276] 0709 12:23:41.407148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.413010 (+  5862us) service_pool.cc:224] Handling call
0709 12:23:41.413276 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.609169 (+195893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.657765 (+1048596us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400363654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:42.657965 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449228032}
W20260709 12:23:42.657152 31572 rpcz_store.cc:269] 0709 12:23:41.177068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.225911 (+ 48843us) service_pool.cc:224] Handling call
0709 12:23:42.656458 (+1430547us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400318b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:42.656570 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382977792}
I20260709 12:23:42.664510  3705 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.666404 32112 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8.
I20260709 12:23:42.631851  3426 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.669893  3751 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:42.673890  3923 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:23:42.678189 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:42.678835 31572 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:42.659950  3831 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.665597  3905 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.667294  3872 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:42.684108 31566 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:42.697369 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:42.702569  3919 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.703238  3919 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.703711  3733 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:42.704138  3733 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:42.705060  3733 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.705617  3919 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.706123  3733 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:42.710412  3914 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.635262 31317 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:42.718465  3426 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.723639  3727 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.726315  3899 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:42.727269 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.727906 31317 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:42.729282  3741 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.730013 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1022) took 1084 ms. Trace:
I20260709 12:23:42.725452  3888 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.737123 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.737735 32113 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:42.737848  3737 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:42.728629 31491 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1803) took 1426 ms (client timeout 1623 ms). Trace:
I20260709 12:23:42.738992 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:42.739560 32111 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:42.739013 31491 rpcz_store.cc:269] 0709 12:23:41.302455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.302563 (+   108us) service_pool.cc:224] Handling call
0709 12:23:42.728422 (+1425859us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540007f3d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:42.728568 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246939520}
I20260709 12:23:42.738611 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.748366 32111 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:42.751672 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.752991 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.754016 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.754521 32108 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:42.752969 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.755791 32111 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:42.756343 31572 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:42.729691 31317 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 11, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 11 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:42.764941 32107 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:42.730394 32114 rpcz_store.cc:276] 0709 12:23:41.645206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.645465 (+   259us) service_pool.cc:224] Handling call
0709 12:23:41.653120 (+  7655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.653908 (+   788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.653945 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.656958 (+  3013us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.180869 (+523911us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b1800449c20. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:23:42.555237 (+374368us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:42.555280 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.555352 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.673248 (+117896us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:42.722950 (+ 49702us) raft_consensus.cc:1685] finished
0709 12:23:42.729810 (+  6860us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.729954 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365,"raft.queue_time_us":2137,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15477,"spinlock_wait_cycles":124817024,"thread_start_us":365926,"threads_started":1,"wal-append.queue_time_us":713861}
I20260709 12:23:42.755224  3894 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.774453 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 903) took 1039 ms. Trace:
W20260709 12:23:42.783783 31387 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.045s (SENT) [suppressed 14 similar messages]
I20260709 12:23:42.779465 31498 rpcz_store.cc:276] 0709 12:23:41.734651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.814395 (+ 79744us) service_pool.cc:224] Handling call
0709 12:23:41.814756 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.829098 (+ 14342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:41.829125 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:42.735486 (+906361us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b2c0000e5c8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:23:42.735929 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.767709 (+ 31780us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:42.767743 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.767803 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:42.772324 (+  4521us) raft_consensus.cc:1685] finished
0709 12:23:42.772347 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.774394 (+  2047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13985,"raft.queue_time_us":44758,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":5439360,"thread_start_us":31465,"threads_started":1,"wal-append.queue_time_us":32806}
I20260709 12:23:42.787685  3889 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:42.802655  3927 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.811517  3895 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:42.812095  3895 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:42.815949  3437 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:42.816402  3437 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:42.817332  3437 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.818364  3437 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:42.803714  3889 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:42.835819 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.807672  3840 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:42.849110  3517 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.852507 31317 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 11, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:42.856426 31571 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:42.862003 31417 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:42.863158 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.863274  3794 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:42.863775 31417 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:42.863953 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:42.864705 31569 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:42.864960 31417 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:42.870016 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.003s	sys 0.019s
W20260709 12:23:42.876147 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.003s	sys 0.019s
W20260709 12:23:42.876461 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 800539us
I20260709 12:23:42.865963 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.877128 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:42.877385 31422 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:42.876374 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:42.885586 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:42.875499 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.866335 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.878329 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:42.878297 31417 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:42.871565 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1807) took 1307 ms. Trace:
I20260709 12:23:42.888861 31499 rpcz_store.cc:276] 0709 12:23:41.564220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.564334 (+   114us) service_pool.cc:224] Handling call
0709 12:23:41.569557 (+  5223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.109854 (+540297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.871314 (+761460us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54002e7f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:42.871500 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166662528}
I20260709 12:23:42.889936 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.893538 31417 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:42.892976 31571 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:23:42.894456 31571 pending_rounds.cc:85] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:42.895212 31571 pending_rounds.cc:107] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:23:42.895969 31415 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:42.895805 31571 raft_consensus.cc:2889] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:42.897188 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.887539 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:42.822261  3927 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:42.899201 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.899163  3741 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:42.902021  3435 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:23:42.902667 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2902) took 1234 ms. Trace:
I20260709 12:23:42.902418  3741 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.903198  3727 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.903836  3727 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.904721  3741 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.905663  3426 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.905759  3727 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.906271  3727 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.906181  3426 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.907797  3732 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:42.908154  3732 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:42.908372  3426 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.909030  3732 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.909722 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 895) took 1522 ms. Trace:
I20260709 12:23:42.910189  3732 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:42.910044 31497 rpcz_store.cc:276] 0709 12:23:41.387707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.387829 (+   122us) service_pool.cc:224] Handling call
0709 12:23:42.728571 (+1340742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.728742 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.728768 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.728808 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:42.728845 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.728898 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:42.909554 (+180656us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540007f3d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:42.909664 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3040676224}
I20260709 12:23:42.910807  3769 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:42.900559 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:42.912197 31571 rpcz_store.cc:276] 0709 12:23:41.668225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.668430 (+   205us) service_pool.cc:224] Handling call
0709 12:23:41.695612 (+ 27182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.855992 (+1160380us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b58006047d0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196bf0aa 00007fc119741447 00007fc119759fe7 00007fc11975b7de 00007fc119765b49 00007fc119766416 00007fc119762d8f 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4
0709 12:23:42.901845 (+ 45853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.902615 (+   770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023874432}
I20260709 12:23:42.854312 31317 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 9, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 9 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:42.914800  3769 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.915242  3769 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:42.925793 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.926738 31417 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:42.927695 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.928505 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:42.929203 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.929807 31422 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:42.879101  3733 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:42.930744 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:42.928740 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.931272 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:42.899279  3768 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:42.942103  3807 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.942705  3807 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.944976  3807 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:42.899539  3848 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:42.946391  3894 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.946817  3909 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:42.947837  3909 consensus_queue.cc:1243] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:42.948449  3909 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:42.948885  3909 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:42.938782 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:42.952363 31422 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:42.931792  3919 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:42.930498  3889 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.941378  3794 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.869343  3778 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 12:23:42.932087 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.930045  3705 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:42.842690  3840 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.954892 31569 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:42.941447  3822 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.906417  3895 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.957649 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 808) took 1284 ms. Trace:
I20260709 12:23:42.957466  3794 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.958021  3836 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.958199  3889 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:42.972481  3822 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.983422 31572 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:42.983560  3822 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.929030  3741 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.928910  3426 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.960894 31566 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:42.986156 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:42.962350 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:42.987442 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:42.874339  3828 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:23:42.963078 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:42.963428 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:42.931120  3829 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:42.937702  3849 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:42.973898 31416 rpcz_store.cc:276] 0709 12:23:41.671562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.671913 (+   351us) service_pool.cc:224] Handling call
0709 12:23:41.686554 (+ 14641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.891088 (+204534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.951744 (+1060656us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003511d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:42.955815 (+  4071us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468438784}
I20260709 12:23:42.953485  3890 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:42.976007 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:42.994396 31568 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:42.976742 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:42.990940  3733 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:42.977741  3894 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:42.995590  3894 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.997195  3840 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.997895  3894 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:42.963114  3919 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.979311 32110 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:42.984802 32105 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:23:42.984896 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.001029 32107 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.004428  3769 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.004909  3733 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.005671 32111 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:42.979290  3705 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:42.993176  3426 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:42.950418  3909 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:42.974239 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.010934 32114 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:42.990302 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:43.019723 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:43.020844  3768 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:43.021200 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:42.978493 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.022305 31569 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:43.023125  3801 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:43.023614  3801 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.023866  3426 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.023978  3801 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.024521  3426 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:43.025321  3426 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.025672  3426 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:43.026010  3426 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:42.988688  3741 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.026870  3806 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:43.028275 32105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
W20260709 12:23:43.028975 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54807.3us
I20260709 12:23:43.000514  3919 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.029000 32105 raft_consensus.cc:606] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:43.029654 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.030055 32105 raft_consensus.cc:614] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:43.031915 32106 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:43.028293 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.033334 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.033845 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.034868  3840 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:42.994431  3849 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:42.927594  3727 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.036537 32107 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:43.036598 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.014331  3890 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:43.038656 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.035338  3733 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:43.035689  3806 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:43.006625  3769 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.041667  3872 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.054289 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:43.056108 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.056113 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.056902 31416 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.039314  3840 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.044554  3849 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.036931  3778 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.037417  3768 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:43.043107  3822 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:43.044490  3909 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:43.034996  3927 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.052873  3828 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:43.076498 32107 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:43.075637 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.077841 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.077893 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.081166 32108 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:43.081360 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.053524  3733 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.053742  3806 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.077319 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.081940 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:43.056685  3872 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.082286 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.042867  3919 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:23:43.009063  3705 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.083334  3733 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.119629  3830 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.086407  3806 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.087721 32108 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:43.071368  3778 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.089098 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.071425  3768 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.083204  3769 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:43.094722 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.094813  3437 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.095068  3936 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:23:43.044561  3578 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:43.096024  3741 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.096530 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:43.098989 31416 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:43.133405 31423 raft_consensus.cc:606] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:43.069676  3840 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.108266  3899 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:43.115917  3832 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:43.116361 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.116498  3927 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.121456 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.127847 32114 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:43.127661  3260 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.128504  3778 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.144073 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.075953  3737 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:43.149109  3737 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:43.151262  3915 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.708s	user 0.008s	sys 0.003s
I20260709 12:23:43.152618 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 899) took 1428 ms. Trace:
I20260709 12:23:43.153877  3733 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.080446  3828 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.154969  3828 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.156890 32113 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:43.130265 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.158666  3888 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:43.158926  3741 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:43.101363  3807 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:43.132010  3437 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.160173  3260 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.132211  3769 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.138018  3890 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.134964  3806 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.163385  3482 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.142999  3924 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.166033  3924 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.166332 32110 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:43.167881 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.168134 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.168285  3924 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.168709 32108 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:43.170240 32108 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:43.173380  3927 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.102051  3517 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.175091  3517 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.175738  3927 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.177150  3517 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:43.178216 32112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 972) took 1814 ms (client timeout 1549 ms). Trace:
I20260709 12:23:43.122756  3919 consensus_queue.cc:1243] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:43.146034 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.129161  3768 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:43.163389  3769 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.120167  3830 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.148334 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.190507 32114 raft_consensus.cc:2410] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:23:43.104198  3872 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:43.196560 32139 heartbeater.cc:646] Failed to heartbeat to 127.29.143.254:45911 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.143.254:45911 timed out after 15.000s (SENT)
I20260709 12:23:43.199993  3927 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.130651  3848 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:23:43.200459  3927 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.200839  3927 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.200014 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:43.168843 32111 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.104543  3822 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.181360 31568 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:43.144534  3832 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.141445  3895 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:43.223199 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.153098 31495 rpcz_store.cc:276] 0709 12:23:41.723888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.724082 (+   194us) service_pool.cc:224] Handling call
0709 12:23:41.728563 (+  4481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:41.904669 (+176106us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:41.904702 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:41.910338 (+  5636us) log.cc:844] Serialized 26 byte log entry
0709 12:23:42.191811 (+281473us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:42.191888 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:42.192004 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:43.106646 (+914642us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:43.152223 (+ 45577us) raft_consensus.cc:1685] finished
0709 12:23:43.152257 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.152543 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13557,"raft.queue_time_us":128740,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":147801088,"thread_start_us":418828,"threads_started":2,"wal-append.queue_time_us":371511}
I20260709 12:23:43.141137  3899 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.191342  3437 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:43.210953 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 64476.5us
W20260709 12:23:43.178633 32112 rpcz_store.cc:269] 0709 12:23:41.363503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.363632 (+   129us) service_pool.cc:224] Handling call
0709 12:23:43.178015 (+1814383us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400631fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:43.178119 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789029248}
I20260709 12:23:43.213279 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.237854 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.215292 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1855) took 1810 ms. Trace:
I20260709 12:23:43.220024 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.239898 31568 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:43.152025  3737 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.226805 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:43.227414 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.224891  3888 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.229430  3517 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:43.225034  3924 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:43.233956 32111 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:43.238569 31418 rpcz_store.cc:276] 0709 12:23:41.405096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:41.414741 (+  9645us) service_pool.cc:224] Handling call
0709 12:23:41.414995 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:41.575410 (+160415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.214989 (+1639579us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003ed354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:43.215214 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359937920}
W20260709 12:23:43.253134 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.261114 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.258167 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.260130 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.266513 32079 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.293704 31573 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 10: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:43.292714 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 254112us
I20260709 12:23:43.223713  3578 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:43.304785  3578 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.306785  3260 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.307053  3578 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.309839 31573 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:43.310928 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.311160 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.311532 31567 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
I20260709 12:23:43.311965 31573 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:43.237177  3899 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.237897  3830 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.238391  3743 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.240149  3889 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.314805 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.302354 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.243377  3437 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.330466 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.295246  3827 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.295032  3895 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:43.302827  3732 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.313197  3836 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.236728  3822 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.339569  3467 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:43.337476  3437 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.296164  3888 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:43.351409 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 250207us
I20260709 12:23:43.301234  3517 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:43.393013 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 155320us
I20260709 12:23:43.354081  3900 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:43.390228 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:43.314141  3924 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.337607  3917 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:43.338130  3894 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.326550  3260 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:23:43.340215  3732 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:43.422958  3732 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.425452  3426 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.425637  3899 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.359128  3467 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.426885  3467 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.427060 31574 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:23:43.364018  3655 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:43.362267  3836 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:43.389752  3923 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:43.388893  3848 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.403219 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:43.338466  3889 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.403890 31566 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:43.392709  3733 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.340380  3827 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.399609  3917 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.433499  3917 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.434459  3827 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.435711  3927 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.436661  3872 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.437824  3927 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.437708  3848 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.395917  3847 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:23:43.439265  3437 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.351364  3895 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.439790  3848 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.440979  3917 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.441382  3895 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.442150 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.442740 31568 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.443646 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.444020  3426 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.395812  3900 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.444371 31565 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:43.445138  3900 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.446113  3900 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.393757  3919 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.407675 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.410418 31572 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:43.413031  3517 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.413600  3768 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.415844  3822 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.417872  3828 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.406150  3801 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.419039 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:43.419276  3944 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:23:43.441314  3437 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:23:43.495460 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.496292  3437 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.497165  3437 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.464591  3467 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.499539  3849 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.504038  3872 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.504876  3917 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.506346  3467 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.514146  3951 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:43.514736  3951 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:43.515829  3951 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.430056 31569 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:23:43.335628  3743 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.443691  3778 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.406417  3888 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.437835 32105 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:43.405158  3832 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.452574 31568 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:43.454396  3899 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.442771  3836 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.456913  3655 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:43.458909 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.457831 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 244631us
I20260709 12:23:43.392055  3890 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:43.529563 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.442763  3924 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.496374 31572 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:43.420472 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.540891 32107 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:43.522595 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.521747 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.530562 31499 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:43.532616 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.542809 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.540930 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 120563us
I20260709 12:23:43.543808 31496 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.544749 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.545102 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.545455 31496 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:43.536186 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.536250 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.548218 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.548096 31389 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.605s (SENT)
I20260709 12:23:43.548583 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.549382 31497 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:43.431882  3894 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.456988  3732 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.502439  3849 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.545754 32108 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:43.535198 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.551697 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.564767 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.551975 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.565320 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.565775 31492 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:43.565941 31499 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:43.552026 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.554503 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.555301 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.548758 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:43.560838 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.458539  3919 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.570986 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.567168 31496 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.567194 32109 raft_consensus.cc:2376] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 8. Re-sending same reply.
I20260709 12:23:43.552842 31494 raft_consensus.cc:2368] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
I20260709 12:23:43.567767 31495 raft_consensus.cc:2410] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:23:43.568646 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.573410 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.574313 32113 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:43.574373 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.543233  3888 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.581095 31499 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:43.530922  3822 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:43.530140  3946 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:43.569710 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.603505 32108 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:43.603313  3822 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.604424 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.553947  3755 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:43.576254 31493 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:43.605016  3949 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.549964  3900 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:43.605587 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.605911  3900 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:43.606372 31493 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.606873 31569 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:43.606838  3888 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.607532  3829 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:43.607934  3829 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:43.530692  3840 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.608775  3829 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.609781  3829 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:43.610415  3840 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.611155 31498 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.613732  3768 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.614161 31498 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:43.575034 31500 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.581589 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.615419 32109 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:43.615703 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.616181 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.616374  3743 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.616673 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.617157 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:43.604969  3755 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:43.624615 31493 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:23:43.625270 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 65503.5us
I20260709 12:23:43.588605 31496 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:43.589473 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.626135 31492 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.626231 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:43.591323 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.627480 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.552203  3655 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:43.594818 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.605559  3949 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.580255 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.633343 31498 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:43.633713 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 53540.9us
I20260709 12:23:43.633929 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.634369 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:43.634495 31568 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:43.635265 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.606340  3900 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:43.580971 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:43.542888  3951 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.614779  3791 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.629186 31491 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.629761  3946 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.630102  3953 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:43.639928 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:43.641399 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 247313us
W20260709 12:23:43.642230 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.631672 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 328155us
I20260709 12:23:43.631608 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.643229 31571 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:43.644099 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.645057 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.604945 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.646499 32113 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:43.649394 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.618363  3755 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.650393 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.652406 31568 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:43.633104  3743 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:43.660449 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.661497 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.656872 31465 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.657861 31492 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:43.633652  3437 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.639185  3949 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.662189 31497 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:43.640597  3826 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.665148 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.630760  3895 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:23:43.647087  3848 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:43.688524 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.683815 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.667030 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.649791  3889 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.695067 31493 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:43.696065 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.669183 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.698272 31572 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:43.735589 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.736277 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67182.7us
W20260709 12:23:43.736297 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 94227.9us
I20260709 12:23:43.737073 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.736299 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:43.737697 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:43.656132  3778 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.640798  3655 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.691777  3849 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:43.691574  3826 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.697604  3953 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:43.667307  3755 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.661751  3924 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:23:43.748126 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.766242 31493 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.749608 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.749863 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 189019us
I20260709 12:23:43.750720 31465 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:43.744782 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 203492us
I20260709 12:23:43.696846  3828 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:43.751983 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:43.749307  3482 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.001s
I20260709 12:23:43.804322 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.805127 31492 raft_consensus.cc:2368] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:43.740312  3848 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.743554  3889 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:43.760028 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:43.780807 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:43.808126 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57480.9us
I20260709 12:23:43.748762  3791 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:43.697172  3437 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:23:43.687155  3952 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 12:23:43.815920 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.816861 31498 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [10.6-13.7]
I20260709 12:23:43.818671 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.819402 31572 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 8: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:43.756817  3826 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.816278 31417 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:43.830075 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.822373 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.831025 31498 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:43.832312 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.833273 31574 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:43.824276 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:43.834863 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.835605 31574 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:43.835753 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.836562 31572 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:43.836645 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.837679 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:43.838536 31572 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:43.840351 31572 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:23:43.841037 31572 pending_rounds.cc:85] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 8
I20260709 12:23:43.840232 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.843472 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.844478 31572 pending_rounds.cc:107] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:23:43.845070 31572 raft_consensus.cc:2889] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:43.848181 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.849804 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.759855  3849 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:43.759788  3956 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:43.853477 31496 raft_consensus.cc:1217] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Deduplicated request from leader. Original: 11.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:23:43.851197 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.811491  3822 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.813117  3889 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.857168  3927 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.815332  3791 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:43.820441  3743 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:43.858227 31496 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:43.814663  3963 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.867115 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99242.9us
I20260709 12:23:43.867211 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:43.857646  3958 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:23:43.826225  3953 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:43.886238  3953 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.886719  3953 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.886956 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:43.887454 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.888820  3847 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:43.889310  3847 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.863081 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:43.890180  3847 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.891613  3737 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.892081  3814 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:43.893473  3814 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:43.893846  3814 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:43.894371  3437 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.864645  3952 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:43.806710  3960 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:23:43.895085  3952 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.894973  3437 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.895568  3952 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.896032  3960 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:43.896643  3960 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.897022  3960 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.897318  3437 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.898334  3791 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.899120  3848 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.899674  3791 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.861059  3962 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:23:43.828338  3946 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:43.904323 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.905133  3655 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.905776  3892 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:43.906410  3892 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.908646  3892 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.864846  3743 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.894708  3814 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:43.910171  3743 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.910889  3814 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.911136  3849 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.843384  3894 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.858255  3899 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:43.868446  3732 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.914940  3899 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.915396  3899 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.917559  3960 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:43.864590  3927 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.864471  3889 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:43.892248 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:43.919214  3927 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.922511  3768 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:43.923022  3768 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:43.923449  3768 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:43.902734  3963 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.829470  3482 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:23:43.927080  3889 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.928623  3963 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.830382  3888 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:43.866385 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 114529us
I20260709 12:23:43.930617 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.931844 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:43.932973  3426 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:43.934651 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49765.5us
I20260709 12:23:43.936024 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:43.936236 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.938642 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.939495 31493 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:43.941702 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:43.942214 31493 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:23:43.943444 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:43.935279 31570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1249) took 1052 ms. Trace:
I20260709 12:23:43.945996 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:43.946600 31418 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:43.945243 31570 rpcz_store.cc:276] 0709 12:23:42.882735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.883018 (+   283us) service_pool.cc:224] Handling call
0709 12:23:42.917876 (+ 34858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:42.953699 (+ 35823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:42.953732 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:42.953769 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:42.953810 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.935062 (+981252us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54001ce654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:43.935104 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:43.935227 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81942784}
I20260709 12:23:43.944949  3733 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:43.955695  3733 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:43.956133  3733 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.956537  3733 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:43.949743  3655 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:43.957435  3655 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:43.960254 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:43.961740 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.962875 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:43.963269 31572 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:43.948611  3894 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.971174  3894 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.972944  3741 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.973489  3894 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:43.958877  3578 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:43.976560  3954 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:43.981045 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.958318  3655 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.973505  3741 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:43.991596  3655 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:43.995654 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 65117us
I20260709 12:23:43.997161 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:43.998412 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.001794 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.002580 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.003422 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.005240 32112 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:44.008272 32109 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:23:44.009747 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.013741 31493 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:44.001997 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.007157 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.015121 32113 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:44.010612 31423 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:44.006443 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.004334 32110 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:44.020311 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.020550 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.020943 31424 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.021597 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.026865  3889 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.021410 31421 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:44.032608  3426 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:44.034794  3961 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.035393  3961 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.038988  3961 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.036230  3953 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.044819  3733 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.045296 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:43.946521  3437 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:23:44.046950  3953 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.047722  3721 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:44.048712  3721 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:44.049831  3721 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.052816  3900 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.053880 31566 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.042232  3768 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.054804 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.055415 31421 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:44.056658 31570 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:43.995007  3963 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:44.059893 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.062176 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.064765 31421 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:43.998114  3828 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:44.057379 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:44.077912 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.071034 31424 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:44.013046  3482 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:44.086512 31423 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:44.023284  3962 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:44.066227 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.091027 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.098140 31415 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:44.065344  3963 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.003372  3968 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:44.115353 31566 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:44.096266 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.116139 32111 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:44.107648  3900 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.108831 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:44.123625 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 180243us
I20260709 12:23:44.125008 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.126633 31540 leader_election.cc:400] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:44.128427 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.108879  3949 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:44.112250  3957 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.352s	user 0.003s	sys 0.000s
I20260709 12:23:44.113169  3727 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.113481 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 984) took 1137 ms. Trace:
I20260709 12:23:44.144073 32106 rpcz_store.cc:276] 0709 12:23:42.976130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.976502 (+   372us) service_pool.cc:224] Handling call
0709 12:23:44.113329 (+1136827us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b540049d9d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:44.113429 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60962560}
I20260709 12:23:44.147620 31573 raft_consensus.cc:2410] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:23:44.152136 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.158553 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.161789 31415 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:44.120074  3836 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 12:23:44.142449  3794 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.098073 31421 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:44.118520  3963 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.094595 31424 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:44.167279 31418 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:44.169560 31424 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:44.159070  3914 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:44.116652 31423 raft_consensus.cc:2410] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:44.129727 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:43.998740  3826 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.178141  3949 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.178886  3826 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.180138  3968 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:44.181473  3968 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.183255  3727 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:44.183786  3482 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.184470  3482 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.187991 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:44.188700 32106 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.189154 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 824) took 1262 ms. Trace:
I20260709 12:23:44.189568 31417 rpcz_store.cc:276] 0709 12:23:42.926519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:42.928513 (+  1994us) service_pool.cc:224] Handling call
0709 12:23:44.188983 (+1260470us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54003e9c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:44.189095 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009988992}
I20260709 12:23:44.117009  3961 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:23:44.193538  3914 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:44.194144  3914 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.195494  3952 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.198259  3952 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.163026 31568 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:44.115466 31416 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:44.160010  3848 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:44.201357  3848 consensus_queue.cc:1243] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:44.201944  3848 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:44.202316  3848 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:44.203370  3848 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.204692  3848 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:44.206264  3959 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
W20260709 12:23:44.167758  3829 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.007s
I20260709 12:23:44.116601  3828 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:44.229898 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.231801 32114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1041) took 1042 ms. Trace:
I20260709 12:23:44.232249 32114 rpcz_store.cc:276] 0709 12:23:43.189706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.191389 (+  1683us) service_pool.cc:224] Handling call
0709 12:23:43.286982 (+ 95593us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:43.300535 (+ 13553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:43.300581 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:43.367151 (+ 66570us) log.cc:844] Serialized 52 byte log entry
0709 12:23:43.554000 (+186849us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:43.554041 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:43.554102 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:44.111550 (+557448us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:44.231453 (+119903us) raft_consensus.cc:1685] finished
0709 12:23:44.231480 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:44.231728 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12211,"raft.queue_time_us":12997,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2480,"spinlock_wait_cycles":98821888,"thread_start_us":143021,"threads_started":1,"wal-append.queue_time_us":265728}
I20260709 12:23:44.240926 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.251394  3741 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.169160  3836 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.254195  3836 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.255021 32108 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:44.259749  3768 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.260497  3743 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:44.210915  3951 consensus_meta.cc:287] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
I20260709 12:23:44.174543  3733 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:44.169749 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 156810us
I20260709 12:23:44.093094 31419 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:44.267421 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.160779  3426 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:44.175529 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45890.9us
I20260709 12:23:44.168959  3969 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:23:44.166940  3953 raft_consensus.cc:993] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:44.207861 32080 leader_election.cc:400] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
I20260709 12:23:44.164436 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.286465 32080 leader_election.cc:403] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.287120 31573 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
I20260709 12:23:44.288497 32079 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
I20260709 12:23:44.288936 32079 leader_election.cc:403] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.212096 31415 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:44.226434 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.289772 31568 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:44.291311 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.291917 31493 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.292223 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.113593  3927 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.279783 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.293998 31494 raft_consensus.cc:2368] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
W20260709 12:23:44.282145 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.288341 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.228685 32107 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:44.219355 32106 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:44.297688 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.298840 31573 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:44.297946 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 90228.9us
I20260709 12:23:44.307094 31568 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:23:44.299423 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.309058 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.311834 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.314868 31415 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.317279 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:44.284168  3941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.053s	sys 0.038s
I20260709 12:23:44.266593  3482 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.330773 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.272526  3426 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.334028  3848 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:44.336042 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.336544  3737 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:44.337340 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.338549 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.351428 31572 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.353116  3482 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.353525  3482 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.353880  3482 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:44.340160 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.355095 31565 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.325951  3836 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.327294  3948 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:44.344911  3941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.053s	sys 0.038s
I20260709 12:23:44.334488 31540 leader_election.cc:400] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
W20260709 12:23:44.290532  3260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.024s	sys 0.027s
I20260709 12:23:44.385047 31540 leader_election.cc:403] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:44.350980 31492 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:44.309106  3721 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
W20260709 12:23:44.378082 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 96384.4us
I20260709 12:23:44.265628  3899 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.348320  3426 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.327099  3951 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:44.398051 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:23:44.398770 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64432.7us
I20260709 12:23:44.305781 31493 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:44.381759 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.344982  3961 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:44.340806 31415 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:44.344584  3517 raft_consensus.cc:1081] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:44.345116  3768 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:44.385473 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.370460  3849 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.408073 31572 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:44.408666 31415 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:44.290583  3890 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:23:44.431793 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.433329  3768 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:44.434481  3768 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.437013 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.437848 31416 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
W20260709 12:23:44.394989  3260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.024s	sys 0.027s
I20260709 12:23:44.376629 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:44.405602 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:44.409929 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.408501 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:44.441956 31498 raft_consensus.cc:2368] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13.
I20260709 12:23:44.406831  3829 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.447934 31416 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:44.445608 31565 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.455693 31465 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.456890 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.380280  3743 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.459575 31422 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:44.407517  3961 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.463223  3894 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:44.470671  3840 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:44.429788  3733 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:44.472443 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.474010 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.474545 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.483117 31423 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:44.484151 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.475270 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.477811 31565 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:44.442806  3890 consensus_queue.cc:1243] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:44.431361  3948 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:44.498524 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.482627 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.499414 31424 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:44.499686 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.490336 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.495473 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:44.499820 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.496203 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:44.496819 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.498199 31416 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:44.500550 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.502022 31424 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.494843 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:44.502794 32105 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:44.503111 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.458634  3847 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:44.507270 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:44.481040  3978 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.003s
I20260709 12:23:44.468626  3962 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:44.380493  3828 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.482098  3961 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.532933 31500 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:44.517031 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.527069 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.528684 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:44.535974 31416 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:44.536441 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:44.537185 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.508358 31417 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:44.539178 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.443099  3849 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.529583 31424 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:44.497630  3806 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.460383  3829 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.507222  3943 raft_consensus.cc:2764] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:44.541355 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.544664 31417 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:44.545035 32114 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:44.545138 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.542984 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.546151 31422 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.540359 31416 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.550609 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:44.554126 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.531122  3733 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.557173 31424 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:44.531971  3847 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:44.507619  3578 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:23:44.560266 31424 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:44.561172 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 60707.1us
I20260709 12:23:44.568393 31420 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:44.570474 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:44.582507 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.582337 32114 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.571827 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.586534 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.587136 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.588090 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.586614 32110 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:44.589296 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.589794 31491 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:44.589852 31493 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:44.590117 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.591223 31494 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:23:44.592245 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.592777 31416 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:44.592875 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.553951  3727 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:44.599426 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:44.611312 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.584052 31424 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.568903  3954 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.608063  3778 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.569326  3741 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:44.600896  3727 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.659708 31424 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:44.608215  3914 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.560689  3806 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.601898  3963 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.560127  3900 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:44.604972 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:44.624889  3984 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:44.627475 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 1044) took 1046 ms. Trace:
I20260709 12:23:44.559547  3733 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.669423 32108 rpcz_store.cc:276] 0709 12:23:43.581193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.604170 (+ 22977us) service_pool.cc:224] Handling call
0709 12:23:44.627277 (+1023107us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54005799d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:44.627417 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494533504}
I20260709 12:23:44.654592  3840 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:44.682485 31423 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:44.632915 31422 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:44.584460  3943 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.666723  3963 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.602752  3848 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:44.628711  3826 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:44.652611 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:44.741071 31495 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:44.741335 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 88879.9us
I20260709 12:23:44.740958  3840 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.660648  3778 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.742661 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.659124  3741 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.743759  4007 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:44.744143  3741 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.678781  3894 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:44.745203  3894 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.741001  3578 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:44.634742  3919 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.634289 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.747184  3769 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:44.748091 31499 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:44.692566  3950 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.947s	user 0.003s	sys 0.000s
I20260709 12:23:44.692950 31424 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:44.694077  4005 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:44.696323 31494 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:44.697476  3801 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.697757 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:44.698175 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 321642us
I20260709 12:23:44.698725  3951 raft_consensus.cc:2764] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:23:44.699262 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 199507us
I20260709 12:23:44.699394  4002 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.699920  3953 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:44.700256 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.706377 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.626710  3948 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.711027  4008 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:44.711357 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:44.717355 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1817) took 1088 ms. Trace:
I20260709 12:23:44.661952  3917 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.688526 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.662225  3727 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:44.802065 31498 raft_consensus.cc:2393] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:44.743662 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.679003  3997 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:23:44.753547  3984 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:23:44.772615  3960 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:23:44.660784  3743 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:23:44.752561 31499 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:44.816565 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:44.683912  3733 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:44.752501  3994 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:23:44.707055 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 107773us
I20260709 12:23:44.780753 31466 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:44.804236 31496 rpcz_store.cc:276] 0709 12:23:43.628602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.630971 (+  2369us) service_pool.cc:224] Handling call
0709 12:23:43.631237 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:43.865107 (+233870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.717134 (+852027us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400141c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:44.717299 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510849920}
I20260709 12:23:44.663867  3847 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:44.775502  3947 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 1.261s	user 0.000s	sys 0.009s
I20260709 12:23:44.659035  3890 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:23:44.767443  3978 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:23:44.837456 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 56817us
I20260709 12:23:44.838127 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.839684 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:44.811430 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 100150us
I20260709 12:23:44.841729 31496 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:44.782955 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:44.843108 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 60224.3us
W20260709 12:23:44.822373  3989 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:23:44.780051  4005 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:44.855330  3914 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.855029  4011 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:44.856107  4005 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.722837  3998 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:44.815800 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:23:44.858433 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 97689.1us
I20260709 12:23:44.862875 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:44.818989 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.820425 31424 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:44.864172 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.864151 31423 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:44.753312  3895 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.813999 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.823424 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:44.782485  3826 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:44.832072 32080 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:44.835991 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:44.815619  3951 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.817019  3801 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:44.843266  3924 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:44.847370  3970 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:44.810971  3917 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.815326  3888 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:44.801177  3963 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:23:44.815819  3961 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.854915  4007 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:44.844326 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:44.831800  3832 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.870657 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.908607 31498 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:44.909037 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.857791  3849 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.909744 31573 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:23:44.782599  4002 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.917074  4002 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:44.872550  3826 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:44.891147  3970 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.920184  3970 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:44.867784  3998 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.924813  3998 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.889941  3951 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.882973  3260 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:44.882965 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:44.886319 32080 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:44.893005 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.893509 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.882030  3733 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.893661 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.894603 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.895000 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.895471 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:44.945386 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59185.3us
I20260709 12:23:44.896400 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:44.896842 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.843407  3768 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:44.902354 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1816) took 1320 ms. Trace:
I20260709 12:23:44.869668  3900 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:44.723143  3943 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.875787  3999 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:23:44.891433  3987 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
W20260709 12:23:44.910573 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 66378.7us
I20260709 12:23:44.968005 31569 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:44.969226 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.911531 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.970536 31420 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:23:44.970904 31573 raft_consensus.cc:1813] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Handling vote request from an unknown peer 0065979e5b9a477f8abf064563426291
I20260709 12:23:44.971028 31419 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:44.971443 31573 raft_consensus.cc:2368] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:44.972344 31573 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:44.972796 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.973646 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.974627 31422 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:23:44.975003 31422 pending_rounds.cc:85] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 10
I20260709 12:23:44.975170 31422 pending_rounds.cc:107] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:44.975382 31422 raft_consensus.cc:2889] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:44.912207 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.915217 31540 leader_election.cc:400] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13.
I20260709 12:23:44.862010  4008 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:23:44.898507  3973 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:44.915016  3976 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:44.930891  3806 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:44.931092  3836 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 12:23:44.873791  3895 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.953357  4011 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:44.914628  3741 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.933269  3426 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:44.907284  3963 consensus_queue.cc:1243] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:44.937906  3954 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:44.938064 31415 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:44.942800 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.947726 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.950197 31500 rpcz_store.cc:276] 0709 12:23:43.582339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.615470 (+ 33131us) service_pool.cc:224] Handling call
0709 12:23:44.525982 (+910512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:44.533382 (+  7400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.902095 (+368713us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54003bb850. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:44.902260 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093329280}
I20260709 12:23:44.951730 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:44.952327 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:44.950518 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54214.3us
I20260709 12:23:44.897619  3801 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:44.968576  3900 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:44.976384 31572 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:44.976626 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61566.6us
I20260709 12:23:44.977026 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:44.969863 31423 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:44.943985  3951 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.932260  3917 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.987349  3836 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12.
I20260709 12:23:45.014284  3927 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.928798  3832 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:44.956821  3260 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:45.035856  3260 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.036960  3832 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:44.993662 31571 raft_consensus.cc:2410] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:45.039567 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.039897 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:45.041800 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:45.042593  3924 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:45.043072  3924 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.043221  3794 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:45.043708  3794 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:45.043531  3900 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.044708  3794 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.046186  3794 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.047406  3890 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:44.994067 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:45.048620  3826 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.051657 31572 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:45.053175 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:44.995327 31567 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:45.056020 32114 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:45.057102 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.059058 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:44.965287 31498 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:44.996287 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48648.5us
I20260709 12:23:44.981921  3976 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.997352 31568 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:44.984408 31573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:23:45.067541 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:44.996989  4004 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.015218 31570 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:45.016345  3426 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.017858  3778 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.023588  3801 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.026019  4001 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:45.027428  3721 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:45.031697 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:45.157270 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.157928 31415 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:45.017903  3733 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.033669  3741 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.033895  3948 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.071827  3976 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:44.997145  3737 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:45.060166 32105 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:45.061424 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.062742 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.067703 31573 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:45.248660 31416 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:45.248832 31573 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:45.008364 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:45.059566 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.072140 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.248832 31424 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:45.068140  3849 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
W20260709 12:23:45.074353 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67748.8us
I20260709 12:23:45.259019 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.261083 31389 leader_election.cc:400] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:45.261377 31389 leader_election.cc:403] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:45.076210 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:45.082789 31423 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:23:45.262462 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 186349us
I20260709 12:23:45.080942  3914 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
I20260709 12:23:45.043483  3924 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:45.164395  4004 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:45.139724 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.140020 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:45.146870 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:45.310586 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 163819us
I20260709 12:23:45.148993  3847 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 12:23:45.149726 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.312974 31422 raft_consensus.cc:2376] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12. Re-sending same reply.
I20260709 12:23:45.247782  4002 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:45.159282 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:45.317337  4009 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:23:45.161372 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:45.318723  4019 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:23:45.318979 31499 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:45.320272  4013 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:45.162276 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.323169 31491 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:45.160583 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.324163 31496 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:45.068516  3890 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:45.238773 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 214003us
I20260709 12:23:45.249779  3948 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.298942  3727 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.328456  3948 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.329149  3727 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.157042  3997 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:23:45.330090 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.297588  3888 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.167407 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:44.997442  3961 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.080672  3951 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:45.163935  4008 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:45.332052  3482 consensus_meta.cc:287] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.962s	user 0.019s	sys 0.001s
I20260709 12:23:45.073511 31569 pending_rounds.cc:85] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 6
I20260709 12:23:45.345371 31569 pending_rounds.cc:107] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:23:45.345708 31569 raft_consensus.cc:2889] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:45.253751 31574 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:45.249796 31567 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:45.347113 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.258051 31424 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:45.348498 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.349452 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.139442  3892 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.149869  3963 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.263681 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.083690 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.353988 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:45.354610 31568 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:45.268417 31416 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:45.149536  3954 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:45.156467  3721 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:45.164208  3998 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:45.238747  3426 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.153777  4001 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:45.297406 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.082806 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.369645 31423 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:45.238461  3949 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:45.370487 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:45.370785 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 108791us
I20260709 12:23:45.350888  3951 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.147693  3848 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 12:23:45.148761  4011 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:23:45.154734  3968 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 12:23:45.442189  3968 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:45.442813  3968 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.451116  3976 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.456228  3976 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:44.983956  3973 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.470566  3517 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:45.471117  3517 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:45.471685  3973 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.310042 31417 raft_consensus.cc:2376] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10. Re-sending same reply.
I20260709 12:23:45.245528  3943 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.472728  3914 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.310055 31572 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.473273  3914 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.475342  3914 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:45.150074 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82600us
I20260709 12:23:45.241447 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1261) took 1087 ms. Trace:
I20260709 12:23:45.332252 31422 raft_consensus.cc:2393] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:45.297890  3737 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:45.296788  3917 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:45.152559  3832 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:45.344138 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:45.315790  3826 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.347702 31567 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:45.484016  3917 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.485554  3917 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:45.486222 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:45.298561 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 304580us
I20260709 12:23:45.487272  3832 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.487883 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:45.489770  3832 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:45.356082 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92481.4us
I20260709 12:23:45.363188 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:45.364380 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.491146 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.491581  4010 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:23:45.326273  3890 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.492479 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.371645 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:45.153832  3437 raft_consensus.cc:3055] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:45.368340  4004 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.341046  4002 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.352499  3961 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:23:45.367015  3954 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.361804  3836 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:45.357599  3963 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.374017  3998 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:45.370954  3426 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:45.432682  3970 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.001s
I20260709 12:23:45.433442  4001 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.346446  4008 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.350417  3482 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.355408  3892 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.376892  3949 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.420783  3951 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.434508  3721 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.504484  3737 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.531477  3721 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:45.311369 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.533690  3951 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:45.534421 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 223134us
I20260709 12:23:45.535159 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:45.505926  3437 raft_consensus.cc:740] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:45.535842 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:45.537737 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.538734 31496 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:45.463295  4022 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 12:23:45.468472  3829 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.477861 31566 rpcz_store.cc:276] 0709 12:23:44.154446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.191570 (+ 37124us) service_pool.cc:224] Handling call
0709 12:23:44.191945 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:44.192341 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.192381 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:44.193064 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 12:23:44.382424 (+189360us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:44.382482 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:44.382573 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.241227 (+858654us) raft_consensus.cc:1685] finished
0709 12:23:45.241248 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.241390 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6686,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":152256,"threads_started":1,"wal-append.queue_time_us":322849}
I20260709 12:23:45.481863 32105 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:45.483254 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:45.305397 31573 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.355438 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:45.552960 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 69768.3us
I20260709 12:23:45.553399 31574 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:45.489673 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:45.554776 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 65256.5us
I20260709 12:23:45.362727 31415 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:45.556309 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.557138 31415 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 11: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:45.557010 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.491735 31570 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:23:45.494906 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 123364us
I20260709 12:23:45.558434 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.503979 31498 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:45.487371 32114 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.538247 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.508152 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.504357  3769 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:45.518823  3482 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.519277 31421 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:45.520771  3963 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.521384  3892 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.522574 31424 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:23:45.524670 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:45.495386  3768 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:45.528652 32108 raft_consensus.cc:1240] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:45.504976  3948 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:45.506646  3705 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:23:45.518846  4008 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.540107 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:45.485514  3849 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:23:45.542909 31572 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:45.531497  3954 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.547935 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.540887  4011 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:45.564878 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:45.515033  3895 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.566744 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.568043 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:45.606693 32107 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:45.569553 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:45.608096 31389 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:45.608312 31415 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:45.575366 31573 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:45.582502 31500 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:45.519315  3426 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.544894 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:45.600811 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45704.1us
I20260709 12:23:45.604844 31495 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:45.509791  4004 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.557627 31493 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:45.565096  3260 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:45.574051  4027 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:45.561805  3995 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:45.561275  3741 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:45.622903 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.638303 31415 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:45.579275  3999 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:45.593125 32114 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:45.526608  3970 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.646252 31496 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:45.582916  3778 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:23:45.519333  3998 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.616688  3948 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:45.641233  3999 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:45.624830  3899 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.606122  3976 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:45.637897  3826 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:45.598488  4007 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:23:45.636804  3482 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:45.725165 31418 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:45.727556 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 187923us
I20260709 12:23:45.612588  3951 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:23:45.624138  3840 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:23:45.636488  3963 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:23:45.759155 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.761300 31573 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:45.646991  3894 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:45.763715 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:45.726851  3999 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:45.615087  4011 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.756265  3995 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:45.637831  3437 consensus_queue.cc:260] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:45.819795 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 205874us
I20260709 12:23:45.820994 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:45.758780  3482 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:45.799127 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 200755us
I20260709 12:23:45.648389  3961 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.659198  3968 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.765652  3976 consensus_queue.cc:1243] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:45.855937 31390 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.780844  3894 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:45.833181  3949 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.829304  4041 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:45.836086  3995 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:45.765573  3836 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 12:23:45.855334  3743 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:45.933662 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 364172us
I20260709 12:23:45.851649  3482 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:45.944458 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:45.946835 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:45.885022  3951 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:45.871922  4002 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.952900 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:45.858289  3794 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 12:23:45.933084  3976 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.957149 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:45.957945  3968 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:45.964936  3968 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.965381  3968 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:45.965968  3890 raft_consensus.cc:2764] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:23:45.965610  3995 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.966903  3995 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.968642  4004 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:45.941951  4031 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:45.969473  4031 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.960916  3949 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:45.961145  3953 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:45.972091  3953 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:45.973532  3924 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.001s
I20260709 12:23:45.973807  3927 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.973987  3924 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:45.885496  3961 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.974303  3927 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.974870  3919 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:45.975358  3919 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:45.975703  4026 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 12:23:45.976449  3919 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.977710 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.977818  3919 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:45.977937  4028 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:45.978384 31493 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:45.978610  4028 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:45.980397 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.980791  4028 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.981407 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.981985 31419 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:45.982218 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:45.982926 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.982283 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.983546 31419 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:45.983661 31415 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:45.984364 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:45.984941 31419 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:45.986332 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:45.934067  4041 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:45.987133 31466 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:45.987598 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.990824 31495 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:45.994035 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:45.942965  3743 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:45.949748  3426 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.004290 31416 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:46.006134 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.009986 31494 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:23:45.961318  4007 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:45.976472  3927 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:45.990713  3769 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.033716  4045 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:23:46.035849  4043 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:23:46.036895  4035 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:45.998891  3890 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.041158 31573 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:46.041898 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:45.995870  4041 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:46.000289  3743 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:46.046686  3778 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:45.965401  3976 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.050382  3900 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:46.050840  4007 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:46.051000  3953 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.013584  3997 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:46.054960  3769 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.104174  3517 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.105337  3517 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:46.107456  3943 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:46.109570  3999 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.015374  3426 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.061014  3894 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.062798  4011 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.077796  3890 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:46.084048 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.093868 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.066146  4035 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:46.104745  3769 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:46.057487  3917 consensus_meta.cc:287] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 12:23:46.112393 31572 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:46.075042  4008 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.066803  3970 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.002312  3951 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:46.089339  3778 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.112584  3997 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.140776 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:46.139901 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73980.5us
I20260709 12:23:46.113874  3426 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:46.145530 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 192720us
I20260709 12:23:46.147163 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.149843 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.150527  3970 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:46.146169  3778 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:46.152709  3888 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.806s	user 0.007s	sys 0.003s
I20260709 12:23:46.153105  3888 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 11.
I20260709 12:23:46.128485  3949 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.127556  3890 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.147500 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.159214 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:46.162317 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:46.149106  3997 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.171523 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.172642 31390 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.155923  3426 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.173077  4007 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.185451 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.140514  3917 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.187201 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 3154) took 1103 ms. Trace:
I20260709 12:23:46.189471 31422 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.160000  3888 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.143530  4008 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.167702  3951 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:46.189522 31420 rpcz_store.cc:276] 0709 12:23:45.083423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.371549 (+288126us) service_pool.cc:224] Handling call
0709 12:23:45.371873 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:45.721604 (+349731us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:45.721639 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:45.727399 (+  5760us) log.cc:844] Serialized 26 byte log entry
0709 12:23:46.071397 (+343998us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:46.071449 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.071541 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.186996 (+115455us) raft_consensus.cc:1685] finished
0709 12:23:46.187014 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.187140 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79322,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":642397,"threads_started":2,"wal-append.queue_time_us":383119}
I20260709 12:23:46.169126  3970 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:46.229981 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.190541 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.182129  3778 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:46.235097 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44632.6us
I20260709 12:23:46.164652  3949 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.239480 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.239766 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.240985 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.242220 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.189162  4028 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:46.189040  3919 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.245282 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:46.245158 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.248121 31495 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:46.190994  4066 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:46.246447 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:46.243867 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72414.3us
I20260709 12:23:46.250401 31499 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:46.246409 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.252015 31390 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.253054 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:46.250819 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:23:46.255067  4050 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:23:46.255970  4049 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:46.256217  4008 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.187458  3953 consensus_queue.cc:1059] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:23:46.191941  3426 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.258963 31497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 1844) took 1102 ms. Trace:
I20260709 12:23:46.236189  4057 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:46.276317 31419 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:46.196240  3888 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.258193 31422 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:46.234503  3924 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.302995 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:46.169503  4035 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.307535 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.304620 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:46.258453 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 3156) took 1116 ms. Trace:
I20260709 12:23:46.257289  3976 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.310510  4070 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:46.309312 31423 rpcz_store.cc:276] 0709 12:23:45.141715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.375051 (+233336us) service_pool.cc:224] Handling call
0709 12:23:45.375358 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.611843 (+236485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.611874 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:45.641747 (+ 29873us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.998981 (+357234us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.999035 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.999134 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.258253 (+259119us) raft_consensus.cc:1685] finished
0709 12:23:46.258273 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.258398 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76129,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":475998,"threads_started":2,"wal-append.queue_time_us":389838}
W20260709 12:23:46.319094 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.289310  4028 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:46.289439  3426 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:46.290334 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 3129) took 1822 ms. Trace:
I20260709 12:23:46.284657  3999 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.337775 31421 rpcz_store.cc:276] 0709 12:23:44.467847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.472011 (+  4164us) service_pool.cc:224] Handling call
0709 12:23:44.475995 (+  3984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.566417 (+1090422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.290098 (+723681us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003516d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:46.290264 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398944512}
I20260709 12:23:46.291194 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1886) took 1321 ms. Trace:
I20260709 12:23:46.342984 31418 rpcz_store.cc:276] 0709 12:23:44.969454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.973489 (+  4035us) service_pool.cc:224] Handling call
0709 12:23:46.291017 (+1317528us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540022ef54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:46.291134 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726796672}
I20260709 12:23:46.283758  3743 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:46.318645  4023 log.cc:927] Time spent T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.940s	user 0.004s	sys 0.006s
I20260709 12:23:46.258630  3960 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:46.292331  3836 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:46.259717  4066 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:46.292933 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.293433  3917 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.293752  3900 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:46.293881  3517 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.294382  3737 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.295440  4048 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:23:46.297713 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.298919 32107 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:46.299568 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.258384  3919 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.303606 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.303711 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.190040  4065 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:46.306456 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.307089 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.373895 32112 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:46.306509 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:46.375253 32106 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:46.282068 31497 rpcz_store.cc:276] 0709 12:23:45.157058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.196097 (+ 39039us) service_pool.cc:224] Handling call
0709 12:23:45.196494 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.484166 (+287672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.258702 (+774536us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400023ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:46.258897 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338603392}
I20260709 12:23:46.309417 31570 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
W20260709 12:23:46.293784  3721 consensus_meta.cc:287] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.002s
I20260709 12:23:46.345233 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:46.284904  4057 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:46.349701  4001 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:46.352963 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.290472  3968 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.319939  4008 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:46.360445 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 109743us
I20260709 12:23:46.368746  3900 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:46.390925 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.392764 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:46.363227 31493 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:23:46.285779  3951 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:46.368335 32110 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:46.395367 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 1895) took 1250 ms. Trace:
I20260709 12:23:46.370230  3426 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:46.371068 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67428.1us
I20260709 12:23:46.355983  4035 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.415725 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:46.416417 31497 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.417505 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:46.372251  3961 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.385501  4057 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:46.370671 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67143.7us
I20260709 12:23:46.364734  3836 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.428617 32107 raft_consensus.cc:1240] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:23:46.429131 32106 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:46.395779 31424 rpcz_store.cc:276] 0709 12:23:45.145215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.349244 (+204029us) service_pool.cc:224] Handling call
0709 12:23:46.395181 (+1045937us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002120d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:46.395307 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396725632}
I20260709 12:23:46.357604  4041 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.401011 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:46.418891 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.405124  3806 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:46.433019 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.406507  3968 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.433732 32108 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:46.412770  4060 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:23:46.393541  4008 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:46.434491  4008 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.413558  3778 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.418251 31495 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:46.415336 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.384713  3997 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.437148 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:46.378175  3960 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:46.437659  3997 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.437831  3960 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:46.422291 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.438306  3960 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:46.438524 32114 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:23:46.438926 31494 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:46.433224  3961 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:46.439411  3968 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:46.440081  3968 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:46.433023  3806 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.441008  3968 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.421234 32110 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:46.442602  3806 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.439496  3961 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:46.426047 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.443825  3961 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.446359 31573 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:46.433117  4041 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.446743 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.438212 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.448601 32110 raft_consensus.cc:2393] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:46.449759 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.450632  3828 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:46.450738 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.451186  3828 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:46.379065  3995 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:46.370030  3517 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.453334 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.458956 31415 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.459098 32110 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:46.453609 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.460136 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:46.456700 31419 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:46.457154 31495 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:46.453006 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.372756  3737 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.417431  3847 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:46.463505 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.464130 31419 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.417111  3999 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.419642  3705 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:46.468082 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.468504 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.468150 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.468776 31418 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:46.469450 31418 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:46.472414 31416 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:23:46.473557 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.474462 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.475603 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.475982 31500 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:46.475704 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.476856 31491 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:46.477248 32107 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:46.457015  3794 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:46.479753  3794 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.480162 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.481359 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.481397 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.479701  3828 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:46.481750  3482 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.004s
I20260709 12:23:46.470424 31418 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.480276  3794 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.482589 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.483559 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.459326  4041 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.485663 31416 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:46.486790 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.487496 31423 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:46.492621 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.500346 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.500718 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:46.501276 31415 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:46.414036  4066 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.485205 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.496519 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:46.498476 31419 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:46.502759 31417 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:46.473505  3995 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:46.513624  3995 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.505836 31418 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.515254 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:46.516027 31498 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:46.504554 31492 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:46.420248  3426 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.504796 31466 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.508092  4073 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:46.506385  4041 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.506529  4070 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:46.484601  3999 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.510957  3919 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.507296  4065 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:46.487221  3847 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:46.519682  3769 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:46.531993 31418 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:46.535764 31498 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:23:46.474397  3705 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:46.539218 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.529017  4028 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.465758  3778 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:23:46.539273 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:46.498328  3482 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.502983  3806 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:23:46.530164  4073 consensus_queue.cc:1243] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:46.536367  4070 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.551723 31491 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:46.536586  4066 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.543733  4065 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.557770  4070 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:46.571914 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.577709  4070 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.549880  3894 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:46.579170  3894 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:46.580137  3894 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:46.582957 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.590775  3769 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:46.591647  3769 consensus_queue.cc:1243] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:46.592913 31492 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:46.520125  3952 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:46.548501  3705 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:46.604161  4076 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:46.566231  3948 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:46.546730  3919 consensus_queue.cc:1059] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:23:46.595786  4065 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:46.557257  3743 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:46.613875 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 100810us
I20260709 12:23:46.567211  3888 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.620779  4070 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.623740 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:46.613195  3948 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:46.630395  3948 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.631793  3948 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.608080  4080 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:46.553778  4028 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.634277 31497 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:46.629427  3517 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:46.647246 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.648231 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:46.655141 32107 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:46.595104  3847 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.653614  4080 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.655526  4045 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.686522 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 181786us
I20260709 12:23:46.691654 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:46.674377  3737 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.701365 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:46.702159 31497 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:46.711828 31497 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
W20260709 12:23:46.717219 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.678186  4080 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.726382 31466 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.732918  4017 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:46.733713  4017 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:23:46.722882  3890 consensus_meta.cc:287] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 12:23:46.698984  4001 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.740931 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:46.683820  4045 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.746781 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.738546 32114 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.748659 31390 leader_election.cc:400] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:46.749543 31390 leader_election.cc:403] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:46.760070  4027 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 12 is higher.
I20260709 12:23:46.751732 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:46.735278  4017 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.779466 31424 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:23:46.732173  4041 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.769942  3794 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.779923 31424 pending_rounds.cc:85] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 6
I20260709 12:23:46.780349 31424 pending_rounds.cc:107] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 12:23:46.780196 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.763926  3888 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:46.781575  3794 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.781772  3888 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.749032  3890 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.782156  3888 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:46.783392  3826 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:46.783622  3890 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.776973  3705 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.784044  3826 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.784574 32112 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:46.751814  4001 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.785573  3705 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.786978  4001 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.790446 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:46.780582 31421 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:46.793782 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:46.804824 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:46.805760 31416 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.811899 32107 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.780671 31424 raft_consensus.cc:2889] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:46.821848  3970 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.822419  3970 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.744171  3999 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.744781  3426 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.750308  3968 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:46.800745  4077 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:23:46.848346 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:46.853263  4032 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.982s	user 0.002s	sys 0.000s
I20260709 12:23:46.867357  3952 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.867865  3952 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.868417 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 2956) took 1797 ms. Trace:
I20260709 12:23:46.868780 31569 rpcz_store.cc:276] 0709 12:23:45.071364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.072773 (+  1409us) service_pool.cc:224] Handling call
0709 12:23:45.073222 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:45.350720 (+277498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.350764 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:45.351434 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 12:23:45.622996 (+271562us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:45.623049 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.623135 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:46.852609 (+1229474us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:46.868128 (+ 15519us) raft_consensus.cc:1685] finished
0709 12:23:46.868150 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:46.868359 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4175,"raft.queue_time_us":5328,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4669,"spinlock_wait_cycles":99775872,"thread_start_us":271227,"threads_started":1,"wal-append.queue_time_us":447762}
I20260709 12:23:46.858392  3482 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.866894  3426 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:46.871968  3426 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.765641  3961 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
W20260709 12:23:46.884387 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.876920  4031 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:46.891405 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.896021  4028 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.778352  3960 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.821388  4027 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:46.921444  4027 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:46.924710  4027 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.860621  3968 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.935813 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:46.931672  3260 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:46.937717  3260 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:46.931792  3996 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.933314  4020 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.562s	user 0.007s	sys 0.007s
I20260709 12:23:46.933585  3973 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:46.927142  3960 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.938544  3968 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:46.943485 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.803920 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:46.963158 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 159370us
I20260709 12:23:46.964685  3482 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:46.965242  3482 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.965669  3482 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:46.973482 31417 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:46.984434 31420 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:23:46.984697 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:46.988929  3888 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:46.939064  3996 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:46.992455  3996 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:46.992566 32107 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:46.995805  4045 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:46.997596 31416 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:46.960611  3437 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:47.010157 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:47.011016 31499 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:47.018273  3948 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.018703 31466 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:47.019610  4018 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:47.020906  3778 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:47.049573 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64951.2us
I20260709 12:23:46.960991  3973 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:46.979595  4047 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.048834 31493 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:23:47.063048 31493 pending_rounds.cc:85] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 6
I20260709 12:23:47.063449 31493 pending_rounds.cc:107] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:23:47.063836 31493 raft_consensus.cc:2889] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.056794 31499 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:47.055989 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:47.055964 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:47.069977 31420 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:47.057760  3889 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:47.026664 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.073331 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:47.104789 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.064184  3900 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 12:23:47.061998  3996 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:47.057127  3895 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:47.199755 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 178464us
I20260709 12:23:47.068154  3960 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:47.135277 31565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 1998) took 2238 ms (client timeout 2211 ms). Trace:
I20260709 12:23:47.169967  3952 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.106027  3995 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:47.162874 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.102341  3888 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.174039  3943 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.137245  3917 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.129088  4057 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
W20260709 12:23:47.127812  4066 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.006s
W20260709 12:23:47.137669 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 514027us
I20260709 12:23:47.070498  4028 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:23:47.234982 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:47.197781  4073 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:47.149982 32112 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:23:47.243459 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 154277us
I20260709 12:23:47.149019 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.152856 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.126328 31422 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:47.246466 32107 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:47.150918 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.183653 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:47.185135 31423 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:23:47.246631 32114 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:47.057473  3927 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:47.112869  3826 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.248957 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.250017 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.251053 32112 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:47.201236 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.061595  3890 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:23:47.103555  3889 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:47.112217  4055 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.054s	user 0.000s	sys 0.003s
W20260709 12:23:47.203042 31565 rpcz_store.cc:269] 0709 12:23:44.896474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.896616 (+   142us) service_pool.cc:224] Handling call
0709 12:23:47.135020 (+2238404us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54001cc354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:47.135180 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796623232}
I20260709 12:23:47.072172  3961 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.124382  3260 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:47.130225  4065 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.004s
I20260709 12:23:47.139525  3892 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:47.113118  3743 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:47.292927  3743 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.293332  3743 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.293859 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:47.295497  4042 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:47.296190  4065 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.296691  3826 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.140635  3973 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.244344  4040 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:47.214799 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.137975  4083 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.300351  4083 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.301782  3927 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:47.141839  3836 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:47.174561 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.302697  3927 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.128271  3426 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.304392  3426 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:47.304916  3426 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:47.301452 31496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1853) took 1757 ms (client timeout 1790 ms). Trace:
W20260709 12:23:47.306540 31496 rpcz_store.cc:269] 0709 12:23:45.544431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.544600 (+   169us) service_pool.cc:224] Handling call
0709 12:23:47.254257 (+1709657us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b540007e4d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:47.301392 (+ 47135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81192832}
I20260709 12:23:47.201146  4001 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:47.309643  4001 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.311694  4001 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.312219  4001 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.137470 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 523317us
I20260709 12:23:47.312531  3743 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.312645 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.317288  3743 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.322705 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.206820  3996 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.329013 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.241043 32111 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:47.239339 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.240916 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.208128  3727 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.283041 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.281873 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 98358.7us
I20260709 12:23:47.236057  3943 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.144606  3482 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.198105  3900 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.344223 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.317580  3968 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:47.347455 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.307397  4027 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.309144  3755 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.280117  3721 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:23:47.058727  3948 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.324952 31569 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:47.238310 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.326123 31573 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:23:47.140456  4008 consensus_meta.cc:287] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.705s	user 0.003s	sys 0.010s
I20260709 12:23:47.242619 32109 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:23:47.331406 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.331811 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.290416  3961 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.386057 31565 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:47.281059  3889 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:47.207464  3895 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.337998 32114 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 8.
I20260709 12:23:47.339952 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:47.394086 31417 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.341740 32110 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:47.344998 32113 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:47.212342  3847 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.288748  3888 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:47.232178  3995 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.298525  4065 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.403275  3943 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.403837  3900 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.370805  3976 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:23:47.405089 32079 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:47.353542 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:47.236585  3917 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.312660  4001 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.408500  3917 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.408449  4010 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:47.409329  3917 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:47.409782  4001 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.410120  4010 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:47.236210  4057 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.385919  4008 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:47.411715  4080 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260709 12:23:47.351503 32107 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:47.211333  3960 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.372169 31574 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:47.374115  3743 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:23:47.373106 31415 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:47.253602  4073 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.427333  3743 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:47.427639  4101 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:23:47.427763  3743 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:47.375571 31419 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:23:47.376228 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48980.5us
I20260709 12:23:47.430506 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:47.345166  3437 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:47.384766 32106 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:47.352536  3826 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.400476  3961 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.402329  3968 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.402945  3737 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:47.406526 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 53096.2us
I20260709 12:23:47.456519 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:47.410537  4010 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.423713  4057 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:47.424593  4100 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:23:47.392803 32111 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:47.433187 31570 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:47.397104  3426 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.374119  4027 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.376264  3755 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.352669  3727 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.387167  3899 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.403002  3888 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:47.463455 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.464896 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.493719 31496 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:47.470085 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:47.494904 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:47.495430 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:47.434484 31417 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:47.459156  3737 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:47.458974  4090 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:47.459213  3721 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:47.474387  3840 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:47.474627  4024 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:47.479899 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:47.491024 31493 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:47.492501 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:47.465545  4028 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:47.469738  4010 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:47.469467  3517 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:47.505250 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:47.471736  3960 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.506304 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:47.412158  4080 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.429698  3847 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.508366  3705 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:47.511667 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.524062 31574 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.512563 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.512640 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.525153 31569 raft_consensus.cc:2368] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:23:47.513386 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.525524 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.525916 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.526338 31573 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:47.527088 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.528214 31569 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:47.513963 31571 raft_consensus.cc:1217] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 12:23:47.470992  3892 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:23:47.514611  3426 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:47.491775  3769 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:47.519745 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.537371 31570 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:47.460140  3437 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.470155  3826 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.543218  3482 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.543308  3437 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.529335 31571 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:23:47.532482 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.532816 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.533424 32111 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:23:47.544996  3826 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.545514 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.534344 32113 pending_rounds.cc:85] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 9
I20260709 12:23:47.546234 32113 pending_rounds.cc:107] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:23:47.546518 32113 raft_consensus.cc:2889] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.546818 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:47.470800  3743 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.519860  4008 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.522643  3917 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:47.540753  3727 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.545578 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.556684 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.557518 32111 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:47.498968  3899 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.534871 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:47.547473 32106 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:47.522125  3517 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:47.554777  3970 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.536511  3426 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:47.547547  3705 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:47.538949  4073 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.549836  3995 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.552713  3769 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:23:47.565433  3836 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:23:47.567165  3426 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:47.587618  4080 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.552938  3917 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:47.571584  3517 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.589052  3952 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:47.589324  3948 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.589236  3917 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.538559  3888 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.561930  3743 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.593091  4027 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.594802  3952 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:47.594499  3705 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.595657  3952 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.574743  3755 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.597107  3952 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.598670  4083 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.599045  3949 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:47.600581  4105 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:23:47.573760  3899 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.571880  3847 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:47.578084  3260 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.605365  3737 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.574849  3973 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:47.608240  3996 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.575201  3895 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.570883  4028 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:47.611155  4028 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:47.612341  3889 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.614217  3737 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:47.617940 32106 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:23:47.614455  3889 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.623220  3917 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:47.629674 32111 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:47.499487 31417 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:47.502261 31419 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:47.492177 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:47.682360 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:47.684211 31415 pending_rounds.cc:85] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 8
I20260709 12:23:47.684686 31415 pending_rounds.cc:107] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:23:47.685066 31415 raft_consensus.cc:2889] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.487002 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:47.503777 31418 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:47.485164 31421 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:47.690526 31416 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:47.694218 31416 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:23:47.681152 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.684026 31419 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:47.515321 31498 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 8.
I20260709 12:23:47.511175 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.728888 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.535329 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.518419 31567 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:47.523201 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.547657 31572 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 10. Current term is 12. Ops: []
I20260709 12:23:47.709422 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:47.712882 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.718451  3437 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.722553 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.722132  3426 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.705996 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:47.705695 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 851) took 1229 ms. Trace:
I20260709 12:23:47.756584  4027 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.761662  3970 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:47.771941 31417 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:47.791527 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.819641 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48102 (request call id 942) took 1338 ms. Trace:
I20260709 12:23:47.822288  3949 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.822850  3889 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.823515 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.824529 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.827287 31390 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:47.834975  3847 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.852880 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.854493 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.855994 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.857182 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.859164 31573 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:47.860286 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.861008 31573 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:47.861928 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.863116  3847 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.863637  3437 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.845651 31422 rpcz_store.cc:276] 0709 12:23:46.476461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.481104 (+  4643us) service_pool.cc:224] Handling call
0709 12:23:47.705278 (+1224174us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003ece54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:47.705491 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481400064}
I20260709 12:23:47.868466 31571 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:47.872814  3949 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:47.874156 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72747us
I20260709 12:23:47.875331  3889 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.876605  4027 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.849735 31491 rpcz_store.cc:276] 0709 12:23:46.477368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.486547 (+  9179us) service_pool.cc:224] Handling call
0709 12:23:47.790574 (+1304027us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54002e7054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:47.815726 (+ 25152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119706880}
W20260709 12:23:47.881342 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.882467  4080 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:47.883781  4080 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:47.884203  4080 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:47.884860  3426 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.887521 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.888357 31565 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:23:47.890443 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.949760  3437 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.887526 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.890921  3970 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.954515 31574 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:47.956411  3970 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.892599 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.958257 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.959661  3889 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:47.959760 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:47.961113 31568 raft_consensus.cc:2410] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:23:47.962136 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:47.894148 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:47.965551 31389 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.843s (SENT) [suppressed 14 similar messages]
I20260709 12:23:47.894730  3976 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:47.967252  3976 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:47.968840  3976 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:47.897469 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:47.972399 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75275us
I20260709 12:23:47.974457  4040 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:47.885841  4080 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.976205  4080 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:47.858348 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.898635  4021 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:47.900921 31537 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:47.906050  3482 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:47.907228 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:47.911728  4119 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:23:47.915879 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:47.917299 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.921886  3847 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:47.923024  3949 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:47.928090 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.928998  4085 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:47.932731 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:47.934532  4002 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:47.935174 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:47.937222  4010 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:47.939101 31567 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:47.898289  4093 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:47.976231  4040 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:47.979386 32080 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:47.991986 31416 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:48.001513 31572 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:47.993551 31566 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15. Re-sending same reply.
I20260709 12:23:48.010932  4002 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.013975 31571 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:48.021552 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:48.025298 31419 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:48.030437 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 114962us
I20260709 12:23:48.030257  3737 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:48.039870  3737 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.040380  3737 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:48.036783 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 136242us
I20260709 12:23:48.042958 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.044103  3847 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:48.044546  3847 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.030224 31416 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:23:48.044871  3847 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.037397 31423 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:48.047004  3848 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:48.047770  3848 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:48.048457 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:48.048887  3848 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.054450 31423 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:48.055733  4027 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:48.056139 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 217711us
I20260709 12:23:48.056579  4090 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:48.057459  4090 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.057857 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:48.056192  3426 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:48.033228  3705 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:48.063355 31573 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
W20260709 12:23:48.072016 31570 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.008s
I20260709 12:23:48.072531 31570 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:48.074214 31570 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:48.079190 31565 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:48.085731 31568 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
W20260709 12:23:48.099187 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 145640us
I20260709 12:23:48.030961  3482 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.103686 32107 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:48.102545 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.077791  3705 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:48.124516 31572 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
W20260709 12:23:48.130962 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.090736  3426 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:48.143234  3426 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.150323  3826 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:48.152206  4002 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:48.159850  4127 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:48.168885  3482 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.171645  4010 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.140416  4093 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:48.116681  3737 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.183220  3889 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:48.186527  4093 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:48.198527 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.202291 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 224657us
I20260709 12:23:48.204043 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:48.204890 31569 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:48.201973  4093 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.212779  3737 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.220142 31566 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 12:23:48.224828 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.243882 31419 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
W20260709 12:23:48.247830 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.251940 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 149964us
I20260709 12:23:48.254426 31569 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 9.
W20260709 12:23:48.259519 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.260794 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.261938 32109 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:48.242045  3705 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.270484  3705 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.267745  3973 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 12:23:48.283659 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 225963us
I20260709 12:23:48.285326 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:48.285949  4021 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:48.286368  4021 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:48.287003  3997 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:48.287544  3997 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:48.288642  3997 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.310958  4090 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.316967 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.319048 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.320272 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:48.345824 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.339128 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:48.350737 32107 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:48.359534  3743 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.768s	user 0.019s	sys 0.000s
I20260709 12:23:48.360772 31320 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 6 to 10, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), now has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:48.352402  4126 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:23:48.353591  4028 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.620s	user 0.018s	sys 0.000s
I20260709 12:23:48.370630  4028 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.372999  4028 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:48.373701  4028 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:23:48.376133 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.380235  4135 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 12:23:48.382004 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:48.387274  3917 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.763s	user 0.015s	sys 0.005s
I20260709 12:23:48.378937 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:48.395720 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44760.9us
I20260709 12:23:48.391198  3743 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:48.400542 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 133451us
I20260709 12:23:48.402012  3826 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:48.409422 32107 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:48.411397  3888 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:48.412056 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 56737.5us
I20260709 12:23:48.412742 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:48.417816  3888 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:48.413904  3826 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.425511  3973 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:48.427621 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.428182  3973 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:48.428651  3973 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.429023 31463 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:48.397644  3847 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.430918  3952 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:48.440651  3847 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:48.442251  4085 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:48.448269 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:48.432122  3826 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.453048 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:48.453867 31572 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.455412  3888 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.456967  3888 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:48.460503 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.461530 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.461679 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.462466  4027 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:48.461984  3973 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.464478 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.466578 32111 raft_consensus.cc:1813] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Handling vote request from an unknown peer 0065979e5b9a477f8abf064563426291
I20260709 12:23:48.467339 32111 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 12:23:48.468041 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.434832  3952 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:48.443938  4085 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.475848 31572 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:48.476760 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:48.476866  3917 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:48.465651  4027 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:48.479271 32107 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.483560 32079 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.482565  3705 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:48.480672 31571 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:48.492900  4040 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:48.493553  4040 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:48.495749 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.497020 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:48.499316  4010 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:48.499830  4010 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:48.500837  4010 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.503093  3743 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:23:48.481617  4085 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.482033  3917 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.487278  3705 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.524569 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:48.507709  3737 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:48.516652  3917 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.521272  3705 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.512336  3743 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:48.494558  4040 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.532270  3973 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:48.551148 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.563987  3949 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.564801  3949 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:48.569468 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.537294  3737 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:48.575354 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.539834  4093 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.571933 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.553678  3801 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.578531  3426 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:48.579787  4137 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:23:48.541340  4027 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.586607  3973 raft_consensus.cc:2764] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:48.598788  3801 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.601068  3801 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:48.603060  3737 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.606343 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:48.607345 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57669.8us
I20260709 12:23:48.608023 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.608819 31499 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:48.611428 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.583698  3952 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.613004 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.612828  3848 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:48.644259 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:48.645982 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 86526.7us
I20260709 12:23:48.597997  4021 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:48.655371 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 158425us
I20260709 12:23:48.657083 32107 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:48.602245  3917 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.642194  3426 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:48.665620 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:48.668081 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 236514us
I20260709 12:23:48.670519 32111 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:48.673514 31496 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:48.676514 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.677927 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.678807 31495 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:48.679934 31491 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 10: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:23:48.677812 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.670469 31500 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:48.688413 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:48.688248 31574 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 6 to 9, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:48.689191 31422 raft_consensus.cc:606] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:48.689576 31422 raft_consensus.cc:614] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:48.690514  3836 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:23:48.691082 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.681901  4143 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 6 to 9, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:48.696753  4085 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.698819 31499 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:48.703308 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.704660  4085 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:48.674957  4021 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:48.713163 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.713694 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.714046 31497 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:23:48.714713  3426 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.715548 31390 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.716612  4144 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.716655 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:48.717538  4144 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:48.717626 31390 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.728529 31498 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:48.731914  4145 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:48.732105  4144 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:48.732460  4145 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:48.732858  4145 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:48.735178 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.735313  3949 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:48.739243 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:48.742173 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.747284 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.755683 31422 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:48.754083 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.759234 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:48.761919 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.744555  4144 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:48.743302  3997 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.748211  3949 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:48.769080 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:48.771919 31498 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:23:48.773694 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.774722 32107 raft_consensus.cc:2410] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:23:48.756359  4093 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.778107  3997 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.778957  4153 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:48.772162  3949 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:48.745862  4027 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:23:48.785312 32111 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:48.793138 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:48.796460 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.803929 31498 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:23:48.804474 31498 pending_rounds.cc:85] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 12
I20260709 12:23:48.804965 31498 pending_rounds.cc:107] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:23:48.805264 31498 raft_consensus.cc:2889] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:48.807037  4144 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:48.808881  4144 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:48.764997  3705 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.785250  3949 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.793134  3889 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.816704  4137 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.826025  4137 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:48.827329  4147 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:48.828460  4137 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:48.832819 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:48.833247 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:48.835724 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51543us
I20260709 12:23:48.836987 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:48.841869 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:48.842931 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 99860.3us
I20260709 12:23:48.864744 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:48.865592 31574 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:48.835664  3482 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:23:48.870169 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73049.1us
I20260709 12:23:48.882965  3899 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:23:48.859763  4090 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:48.857877  3917 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.895485 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:48.896185  3836 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:48.901742  3836 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:48.904078 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.904714 32109 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:48.905910 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:48.906517 31571 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:48.906699 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.907016 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.907505  3836 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:48.908130 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.907976  3899 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:48.907394 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.910866  4154 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:48.912098  4152 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:23:48.915412  3949 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:48.931921 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45211us
I20260709 12:23:48.862565  4141 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:48.930120  4153 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:48.858726  3889 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.955135 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.959175 31493 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:48.955788 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:48.863412  4027 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:23:48.951906 31574 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:48.959983 32106 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:48.968902 31418 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:23:48.961663  3826 consensus_meta.cc:287] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.001s
I20260709 12:23:48.975333 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.978353 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:48.981146 32111 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:23:48.981523 32111 pending_rounds.cc:85] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 10
I20260709 12:23:48.981729 32111 pending_rounds.cc:107] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:23:48.981963 32111 raft_consensus.cc:2889] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:48.984102 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:48.984300  3889 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:48.984995  4148 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:48.978101  3826 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:48.986398 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.986856 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.987088  3826 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:48.987690 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.988425 31499 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:48.990530 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:48.991657 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:48.992277 31496 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:48.993243 31465 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.600s (SENT)
I20260709 12:23:48.997920 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.004554 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.005337 31421 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:49.006304 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.007561  3705 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:49.009538  3949 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:49.013290 31422 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:48.946108  4090 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:49.017911 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 153397us
I20260709 12:23:49.022640 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.026505 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:49.021047 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.019868 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.031086  3997 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.031351 32111 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:23:49.031704 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.045089 31493 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:49.056392 31390 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:49.059649 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:48.975512  4141 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.067989 32113 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:49.079945 32111 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:23:49.082825 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.069301  4154 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:49.079846  4157 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:23:49.118952  4028 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.119566  4028 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.121798  4028 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:49.100791  3888 consensus_meta.cc:287] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.003s
I20260709 12:23:49.143635 31493 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:49.148144 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 60983.9us
I20260709 12:23:49.057860  4153 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.104939  4154 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:49.155521 31466 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:49.175550  4090 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.176927 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.179664  4141 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:49.179808  4145 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.182314  4154 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.194977 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:49.194005 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.196609 31415 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:49.197237  4174 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:49.197660 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.198546 31419 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:49.197827  4174 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:49.199292 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.200534 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.201212 31572 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:49.200224  4174 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.201972 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.202800 31423 raft_consensus.cc:2410] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:23:49.202898 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.203526  3836 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:49.194460 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44225.4us
I20260709 12:23:49.205865 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.210101 31422 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:23:49.211081 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.211920 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.212067 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.215927 32107 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:49.216988 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.217603 31497 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:49.218900 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.204027  3836 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.221220  3836 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:49.222044 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.223266 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.223949 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:49.227883 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67188.8us
I20260709 12:23:49.232935 31497 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:49.239602 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:49.243484 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.245114 32107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:49.245769 32107 raft_consensus.cc:606] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:49.246145 32107 raft_consensus.cc:614] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:49.207921  3997 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:49.249085 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.209945  4145 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.252521 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.250897 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.254536 32111 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:49.255671 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:49.255950 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:49.237789  4093 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.260157 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.261984 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.246145  3889 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:49.269215 32108 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:49.276055 31500 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:49.245311  4027 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:49.279696 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:49.271493  3889 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.285597 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.288029 31423 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:49.289346 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.270403  4093 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.293277 31420 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:49.294175  4093 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.256910  3997 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.276698  4145 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.295943  4145 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.298134  4145 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:49.298941 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.299980 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.301143 32108 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.302651 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:49.310834 32113 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:49.311722 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.312477 31419 raft_consensus.cc:3060] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.310223 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:49.299582 31424 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:49.300560 31417 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:49.289721  3889 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:49.323344 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.298643  4145 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.330518 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.330760 32109 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:49.331434 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 53946.2us
I20260709 12:23:49.333508 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.336431 31567 raft_consensus.cc:2410] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:49.336557 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.324126  4143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38884 (request call id 12) took 2563 ms. Trace:
I20260709 12:23:49.340261  3997 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:49.340541 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.341223 31496 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:49.341580 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.342064 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.342168 31497 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:49.329613 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.343122 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.343626 31497 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:49.344185  4186 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:49.344609  4186 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:49.344957  4186 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:49.345180  3426 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:49.346028  3826 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:49.346391  3826 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:49.343146 31492 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:49.329924 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.338828 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:49.324380  4010 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:49.350872 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:49.364027 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.300643  4090 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:49.370347 31498 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:49.372519  4021 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:23:49.361289 31540 connection.cc:256] RPC call timeout handler was delayed by -1.4608746270000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 12:23:49.340306  4143 rpcz_store.cc:276] 0709 12:23:46.736430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.736592 (+   162us) service_pool.cc:224] Handling call
0709 12:23:46.800174 (+ 63582us) log.cc:844] Serialized 508 byte log entry
0709 12:23:49.287233 (+2487059us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":343415,"raft.queue_time_us":349373,"raft.run_cpu_time_us":1076,"raft.run_wall_time_us":1075}
I20260709 12:23:49.374886 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:49.375875 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.376372  3426 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:49.376888  4188 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:49.378471 31497 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
W20260709 12:23:49.389896 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3726746269999239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 12:23:49.388942 31419 raft_consensus.cc:2468] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
W20260709 12:23:49.391216 31540 connection.cc:256] RPC call timeout handler was delayed by -1.2142746270001226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:23:49.388746 31420 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
W20260709 12:23:49.391587 31540 connection.cc:256] RPC call timeout handler was delayed by -1.084674626999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 12:23:49.392635 32108 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:49.399755 31537 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:49.347302  3826 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.406195 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.406980 31419 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:49.340394  4145 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.414453 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.419035  3848 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:49.420094 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45341.3us
I20260709 12:23:49.423346  3826 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.437124 31420 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:49.423403  4188 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:49.424696 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.425369 31304 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:23:49.388048  4021 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:49.436404 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 103959us
I20260709 12:23:49.395303  4160 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:49.427058  4182 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.446197 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.407104  3426 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:49.450089 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.430030  3888 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.436872  4080 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:49.454787 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.457074 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:49.459333  4183 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.459898  4183 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.460597 31572 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:49.446722  4021 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.469318 31420 raft_consensus.cc:2410] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:49.471500 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:49.472249 31419 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.468401 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.439028  3848 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.479869 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:49.461333  4160 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.553130 31569 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:49.489732 31497 raft_consensus.cc:2393] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:49.494365 31496 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:49.547616 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:49.595916 31495 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.482762 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.494033 31492 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:49.612272 31492 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:49.660245 31565 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:49.661629 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:49.662073  4185 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:23:49.662564 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.677076 31566 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.663571 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.665371  3848 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:49.670539 31567 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:23:49.473886  4188 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:49.680130 31419 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:49.692842 31568 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:49.467651  3888 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.697373 31572 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:49.684118 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.455603  4182 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:49.734786 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 140080us
I20260709 12:23:49.738767 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.739640 31565 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:49.733935 31419 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:23:49.743233 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.745499 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.754415 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.755244 31569 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:23:49.760056 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.692281  4188 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:49.784117  4188 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.785590  4188 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:49.786739 31416 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:49.787106 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.787832 31416 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:49.789736 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94735.8us
I20260709 12:23:49.682953 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:49.790449 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.687844 31492 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.767361 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.806797 31569 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:49.768242  3888 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.659705  4160 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.482156  4191 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.278s
W20260709 12:23:49.769310  4190 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:23:49.769603 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:49.769791 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.770148  3889 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.770898  4183 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.772646  4182 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.762514  3426 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.774276  4184 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.774957 31418 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:49.779273 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:49.704394  3848 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:23:49.780176 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:49.783073  4145 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.792960 31566 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:49.842865 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.765935 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.801754 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.804662 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.806941 31492 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:49.791770 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 108941us
W20260709 12:23:49.808764 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.807121  4080 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:49.818315 31540 leader_election.cc:400] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:23:49.819288 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:49.848807 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.849380 31570 raft_consensus.cc:2368] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 8. Current term is 9.
I20260709 12:23:49.850164 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.815750 31495 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:49.802863  4085 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:49.854171 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.837792 31569 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:49.844576 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:49.855542 31500 raft_consensus.cc:2368] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
I20260709 12:23:49.847343 31568 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:23:49.847534 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:49.844360 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64261.2us
I20260709 12:23:49.853157 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:49.828272 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.839061  3952 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:49.888015 31569 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:23:49.889284 31566 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:49.889657 31566 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:49.890739 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:49.889720 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 420866us
I20260709 12:23:49.891845 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:49.894213 31574 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:49.897562 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79487.1us
I20260709 12:23:49.899179 31565 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:49.921981 31574 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:49.895282 31566 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:49.887701  3952 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:49.931062 31565 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:23:49.854740  4143 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:49.934360 31566 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:49.857945  4085 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.895498  4160 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:49.894842  4141 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:49.940263 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 161098us
I20260709 12:23:49.961515  4205 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.966320  4093 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:49.844812  4184 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:49.967377  4200 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:23:49.942312 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81723.1us
W20260709 12:23:50.029474 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88817.1us
W20260709 12:23:50.033701 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 87949.3us
I20260709 12:23:49.925808  4182 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:49.968053 31320 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:49.942056  4143 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:49.943893 31574 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:49.946987  4204 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:23:49.897557  4010 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:23:50.031229 31566 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
W20260709 12:23:50.029115 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 132750us
I20260709 12:23:49.946230  4085 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:49.986073  4141 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.983454 31492 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:23:50.061559 31492 pending_rounds.cc:85] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 8
I20260709 12:23:50.061910 31492 pending_rounds.cc:107] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:23:50.062219 31492 raft_consensus.cc:2889] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.036114 31320 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:50.030360 31567 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:49.841343  4186 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:49.962448  4205 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.057425 31566 pending_rounds.cc:85] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:23:50.031530  4093 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:50.035542  3952 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.067852 31466 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.038940  4090 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.049556  3743 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:49.944887  4080 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.071190 31566 pending_rounds.cc:107] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:23:50.095894 31566 raft_consensus.cc:2889] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:50.032785  4154 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.046602  4143 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.067978  4141 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.070873 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:50.051154  4157 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.105731 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.107981  3848 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:50.120177 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49387.5us
I20260709 12:23:50.074249  4191 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:50.070089  4182 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.106856  3482 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:50.119570  4157 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.129518  4184 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.131057 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:50.107158  3952 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.094982  4090 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.141690 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.143103 31568 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:50.147276 31569 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:50.082007  4093 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:50.143510 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 216485us
W20260709 12:23:50.130594  3826 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.685s	user 0.005s	sys 0.004s
I20260709 12:23:50.099869  3743 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.103341  4154 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.159198 31492 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:50.160194 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.144004  4204 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:50.161490 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.144694  3848 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.177421  4093 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:50.180521 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.182265  3743 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.184366 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:50.185148 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.194808 31495 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
W20260709 12:23:50.188975 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47359.9us
I20260709 12:23:50.210469 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.220297 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.221629 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:50.161586  4192 raft_consensus.cc:2804] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:50.160490  4209 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.222942 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:50.274314 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51472.8us
W20260709 12:23:50.270722 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.281718 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.276962 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:50.219611  3848 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.297652  4090 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:50.298316  4211 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:23:50.212698  3826 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:23:50.300674  4206 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:50.301188  4205 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.301709  4209 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.303289  4217 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:50.207237  4203 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:50.306293 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.308396 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.310945 31497 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:23:50.314451 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 105083us
I20260709 12:23:50.315393 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:50.316315  4202 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 12:23:50.318102 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.319846  4218 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:23:50.327450  3426 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.328207  3426 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.265911  3888 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:50.221258  4184 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.336400  4184 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:50.337459  4188 consensus_meta.cc:287] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
I20260709 12:23:50.338588  3426 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.343465  4182 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.305601  4192 raft_consensus.cc:697] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:50.345041  4192 consensus_queue.cc:237] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:50.347324 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51585.8us
I20260709 12:23:50.349577  4090 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:50.338560  4184 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.355829  4160 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:50.378643 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 194307us
W20260709 12:23:50.379215 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 63947.3us
I20260709 12:23:50.379616  4160 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.380200  4160 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.380671  4028 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:50.381338  4028 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:50.381271 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.382884  4144 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:50.382700  4028 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.383517  3426 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:50.386116 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:50.387225 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 110337us
I20260709 12:23:50.393050  4141 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.387753  4145 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:50.395052  4145 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.395586  4145 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.388136 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.388707 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.406451 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.409063  3426 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:50.402045  4090 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.377010  4215 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.410068  4215 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.412717  4215 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.412886  4090 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:50.414373  4021 consensus_meta.cc:287] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.938s	user 0.007s	sys 0.004s
I20260709 12:23:50.414916  4021 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.415619 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.417323  4021 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.417593 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.419320  3482 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.419158  4145 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.419984  3482 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.422083  4145 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.423158 32108 raft_consensus.cc:2368] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15.
I20260709 12:23:50.313218  3826 raft_consensus.cc:2764] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:23:50.424178  3426 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:50.426838 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:50.427115  3426 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.427584  3426 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.427416 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.304839  3848 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.405431 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.430575 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.424998 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.407152 32114 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:50.449222 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.363392  4206 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:50.455669 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.455757 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:50.461391 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.461782 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.462755 31493 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:50.463806 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.462793 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:50.467396 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.456986 31491 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:50.473908 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.474772 32109 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:50.422622  3482 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.477058 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.481166 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:50.501511 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.451289  4209 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:50.533166 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 438388us
I20260709 12:23:50.430594  4145 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:23:50.514802 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:50.426232  4085 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.482380  4188 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:50.533233  4205 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:50.566838  4229 raft_consensus.cc:2764] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:23:50.539897  3826 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:50.568430 31495 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:50.570149  4188 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:50.570392  4208 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.520s	user 0.007s	sys 0.006s
I20260709 12:23:50.570295 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:50.513458  3482 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:50.570719  4188 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.571432 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:50.593572 31499 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.575291  4157 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:50.580807 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 149765us
W20260709 12:23:50.583986 31500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 1884) took 1303 ms (client timeout 1614 ms). Trace:
I20260709 12:23:50.588086 31570 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:50.589161 31569 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:50.537725  4215 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.606920 31500 rpcz_store.cc:269] 0709 12:23:49.280374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.280486 (+   112us) service_pool.cc:224] Handling call
0709 12:23:50.583769 (+1303283us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400012f54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:50.583920 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284998912}
I20260709 12:23:50.541953  4090 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.580782  4191 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:50.636955 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:50.637859 31567 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:50.638391 31568 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:50.592083  4205 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:50.622529 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:50.591928  4141 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.646523 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:50.651221 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:50.655134 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 228347us
I20260709 12:23:50.673290 31422 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:50.676229 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.637607  4191 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.618557  4137 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:50.645094  3952 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.692363 31417 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:50.695942 32113 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:50.623622  4215 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.656030  4205 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:50.701610 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49443.9us
I20260709 12:23:50.681239  4144 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:50.707894 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56760.7us
I20260709 12:23:50.680958  4191 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:50.712018 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.650633  4145 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:23:50.642445  4090 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:50.716641 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60855.9us
I20260709 12:23:50.720760 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:50.722965 31418 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:50.723876 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:50.727249 31389 connection.cc:256] RPC call timeout handler was delayed by -1.0614214199999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 12:23:50.727917 31389 connection.cc:256] RPC call timeout handler was delayed by -1.0202346689998194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 12:23:50.695969  4080 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.731104  4183 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.731369  4080 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.731709  4183 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.733608  4080 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.735433  3889 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.735908  4183 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:50.736706  4228 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:50.695861  3705 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:50.698655  4021 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:50.750164 31567 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:50.748090 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.753320 31418 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:50.759529 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:50.713707  4144 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:50.763358 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.765889 31418 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:50.760340 31500 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:50.764752 31498 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:50.748624  3705 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:50.757601  4143 consensus_meta.cc:287] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.004s
W20260709 12:23:50.770147 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 68551.6us
I20260709 12:23:50.767668 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.772575 32112 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:50.772054  4143 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.750204  4021 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.775638 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.775624 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.715222  3952 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.755482  3848 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:50.786522 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:50.789286 31418 raft_consensus.cc:606] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:50.789639 31418 raft_consensus.cc:614] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:50.767905  4144 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:50.770026  3705 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:50.657415  4206 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.799583  4248 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:50.800158  4248 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.800645  4248 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:50.804615  3426 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.780185  4021 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:50.764338  4040 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:23:50.812986  4042 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:23:50.856406  4042 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.856878  4042 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:50.818054  4235 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:50.803891  3705 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.868669 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:50.819288  3426 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.807155  3848 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.826360  4160 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.841158  4090 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.889919 31320 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.891618  4160 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.892053  3705 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.841246  4154 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.892760 31419 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:50.841760  4241 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:50.842561  4205 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.895030  4042 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.843783 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 2975) took 1361 ms. Trace:
I20260709 12:23:50.845552  4242 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:50.850646 31499 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:50.852135  4085 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.896610 31573 rpcz_store.cc:276] 0709 12:23:49.482339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.482460 (+   121us) service_pool.cc:224] Handling call
0709 12:23:50.843479 (+1361019us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54002634d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:50.843688 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168114432}
I20260709 12:23:50.852912  4215 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.854538  3952 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.855162  4143 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:50.859089 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54593.8us
I20260709 12:23:50.834208 32108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55794 (request call id 1086) took 1080 ms. Trace:
I20260709 12:23:50.858485  4182 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:50.835918  4183 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:23:50.869378 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:50.869895  4080 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.881250 31389 leader_election.cc:336] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.600s (SENT)
I20260709 12:23:50.904819  4186 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:50.912562 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 138703us
I20260709 12:23:50.896898 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:50.913224 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:50.906895 32108 rpcz_store.cc:276] 0709 12:23:49.753628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.753770 (+   142us) service_pool.cc:224] Handling call
0709 12:23:50.833939 (+1080169us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400720e54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:50.834108 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385504512}
I20260709 12:23:50.914418 31421 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:50.914052 31418 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:23:50.916262 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.894240  4248 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.927628  3826 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:50.928536  3826 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:50.928691 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:50.929675  3426 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:50.930094  3426 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.929931 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.930523  3426 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:50.933164 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51964.4us
W20260709 12:23:50.934209 31389 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.843s (SENT)
I20260709 12:23:50.934590 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:50.923130 31320 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 11, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 11 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:50.945648  3426 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:50.948702 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.950500  3426 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.911756  4182 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:50.952589 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:50.953189 32108 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:50.953512 31317 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 276) took 22791 ms (client timeout 15000 ms). Trace:
I20260709 12:23:50.954038  4191 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.956434  4191 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.948437  4160 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:50.961400  4182 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:50.941116  4188 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.963069  4144 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.965102  4144 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.967819 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:50.968312  4248 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:50.968588 31418 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:50.917536  4080 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.970752  4080 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.970872 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet d385c04853e749af8fb00afe40a4a255 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:48288
I20260709 12:23:50.947024  4241 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:50.977007  4021 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:50.979604  4219 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.708s	user 0.001s	sys 0.001s
I20260709 12:23:50.982326 32112 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:50.982501 31420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 869) took 1616 ms. Trace:
I20260709 12:23:50.982932 31420 rpcz_store.cc:276] 0709 12:23:49.366588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.478505 (+111917us) service_pool.cc:224] Handling call
0709 12:23:49.660126 (+181621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:49.853769 (+193643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:49.855306 (+  1537us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:49.896013 (+ 40707us) log.cc:844] Serialized 26 byte log entry
0709 12:23:50.105272 (+209259us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:50.105308 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.105374 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:50.978896 (+873522us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:50.982214 (+  3318us) raft_consensus.cc:1685] finished
0709 12:23:50.982238 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:50.982423 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113508,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":22999808,"thread_start_us":248929,"threads_started":2,"wal-append.queue_time_us":209584}
I20260709 12:23:50.987562  3848 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.988651 31320 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:50.989724 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.993232  4188 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:50.969126 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:50.994733 31417 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:50.994922  4215 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:50.994849 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 81699.2us
I20260709 12:23:50.995543  4215 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:50.996479  4215 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:50.998765 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:51.000370 31465 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.626s (SENT)
I20260709 12:23:51.003654 31422 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 3221) took 1726 ms. Trace:
I20260709 12:23:51.003715 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:51.004186 31422 rpcz_store.cc:276] 0709 12:23:49.277285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.277489 (+   204us) service_pool.cc:224] Handling call
0709 12:23:49.280031 (+  2542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.673791 (+1393760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.003276 (+329485us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003e9c54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:51.003585 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3203744640}
I20260709 12:23:51.004984 32114 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:51.004196 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:51.005374 32113 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:51.006821 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:50.948472 31540 leader_election.cc:400] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11.
W20260709 12:23:51.014886 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66935.7us
I20260709 12:23:51.016465  4145 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:51.016695 31571 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:23:51.018780 31465 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.731s (SENT)
I20260709 12:23:51.017477 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.019117 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:51.017781 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.017035 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.018150 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.021004 31566 raft_consensus.cc:1813] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Handling vote request from an unknown peer 0065979e5b9a477f8abf064563426291
I20260709 12:23:51.021471 31566 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:50.990543 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.023082 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.024464 32108 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:50.994410 31421 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:51.035138 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.035923 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:51.036451 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:51.041289 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:51.043377 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.044231 31571 raft_consensus.cc:2368] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:51.040385 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:51.050086 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.051119 31574 raft_consensus.cc:2368] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15.
I20260709 12:23:51.068313 31574 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:23:51.045255  4204 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.086136 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45828.5us
I20260709 12:23:51.088697 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:51.055219 31465 leader_election.cc:336] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.906s (SENT)
I20260709 12:23:51.045848  4093 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:51.090225 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.093932 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:51.090161 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:51.095709 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.042809  4157 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:23:51.098107 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.106086 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:51.105908  4214 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:51.109668  4254 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:51.111006 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:51.111264  4254 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:51.112257 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57072.2us
I20260709 12:23:51.087883  4242 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:51.113583 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.111789 32110 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 9: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:51.114621 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.120193 32080 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:51.120400 31573 raft_consensus.cc:2376] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15. Re-sending same reply.
I20260709 12:23:51.092618  4093 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:51.098199  4248 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:51.128028 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.129899 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.126654 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.131042 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.087754  4205 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:23:51.131377 31569 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:51.131668 31570 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:51.135342 31569 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:51.131834 31566 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:51.119551  4021 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:51.137389 31419 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:51.128242  4093 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.134296 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.141856 31573 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:51.136461 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.123399  3743 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:51.127485  4143 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:51.091887  4204 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:51.133864 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 161034us
I20260709 12:23:51.127803  4214 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:51.127688  4042 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:51.162997 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:51.166505 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.167462 31570 raft_consensus.cc:2368] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:51.170116 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.171149 31573 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:23:51.140760  4159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.010s	sys 0.002s
I20260709 12:23:51.180131 31571 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:51.186208 31574 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 12. Current term is 13.
W20260709 12:23:51.183028  4159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.010s	sys 0.003s
I20260709 12:23:51.146808 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.188941 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.192260 31499 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:51.173297 31569 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:51.192837 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.193483 31566 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:51.196022 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:51.145537 31389 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.938s (SENT)
I20260709 12:23:51.191567 31572 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:51.166016  4254 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:51.203101 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:51.204656 31569 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:51.207324 32106 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:51.179690  4242 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:51.202279 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.208364 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:51.208616 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:51.209465  4252 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:23:51.209834 32114 raft_consensus.cc:1275] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:51.182981  4042 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:51.210724 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:51.218600 32112 raft_consensus.cc:2368] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17.
I20260709 12:23:51.213505 31496 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:51.213583 32110 raft_consensus.cc:606] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:51.219322 32110 raft_consensus.cc:614] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:51.213790 32108 raft_consensus.cc:2368] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:51.165786  3705 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:23:51.215059 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:51.210047  4175 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:51.222126 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:51.223277 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 77774.8us
I20260709 12:23:51.226248 31572 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:51.210067  4260 tablet_replica.cc:333] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
W20260709 12:23:51.231570 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 118730us
W20260709 12:23:51.323026 31389 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.053s (SENT)
I20260709 12:23:51.323477 31463 leader_election.cc:400] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15.
I20260709 12:23:51.323772 31463 leader_election.cc:403] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:51.223778  4175 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:51.331766 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:23:51.333599 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 100843us
I20260709 12:23:51.417903 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.216921  3848 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 12:23:51.424588 31499 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:51.430033 31571 raft_consensus.cc:2368] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:51.424137 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.215453  4241 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 12:23:51.432188 31572 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:51.419919  4256 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.088s	user 0.004s	sys 0.004s
I20260709 12:23:51.435209 31569 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:23:51.439908 31569 pending_rounds.cc:85] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:51.440192 31574 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:51.388562  4214 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:51.440673 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:51.897429 31499 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 11: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:51.777838  4204 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:51.815481  4271 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:23:51.432109  4042 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:51.896178 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 573141us
I20260709 12:23:51.525820 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:50.953917 31317 rpcz_store.cc:269] 0709 12:23:28.162002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.240520 (+ 78518us) service_pool.cc:224] Handling call
0709 12:23:29.710049 (+1469529us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5400002210. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663f640 00007fc11f516846 00007fc11f62090e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:50.953290 (+21243241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:43.419609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:43.420329 (+   720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:43.420380 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:23:43.420401 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:43.421850 (+  1449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:43.421959 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:43.421989 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:23:43.511795 (+ 89806us) tablet.cc:701] Row locks acquired
0709 12:23:43.511860 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:23:43.512076 (+   216us) write_op.cc:270] Start()
0709 12:23:43.512276 (+   200us) write_op.cc:276] Timestamp: P: 1783599823511979 usec, L: 0
0709 12:23:43.512304 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:23:43.513259 (+   955us) log.cc:844] Serialized 6409 byte log entry
0709 12:23:43.976172 (+462913us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b
0709 12:23:44.781390 (+805218us) op_driver.cc:464] REPLICATION: finished
0709 12:23:45.018954 (+237564us) write_op.cc:301] APPLY: starting
0709 12:23:45.019096 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:45.426663 (+407567us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:45.441875 (+ 15212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:45.468549 (+ 26674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:45.468839 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:23:45.468880 (+    41us) write_op.cc:312] APPLY: finished
0709 12:23:45.469231 (+   351us) log.cc:844] Serialized 148 byte log entry
0709 12:23:45.622723 (+153492us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:45.648660 (+ 25937us) write_op.cc:454] Released schema lock
0709 12:23:45.692334 (+ 43674us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:45.857011 (+164677us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:45.860952 (+  3941us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34995,"reported_tablets":49,"spinlock_wait_cycles":31248640,"child_traces":[["op",{"apply.queue_time_us":213493,"apply.run_cpu_time_us":23787,"apply.run_wall_time_us":800989,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71103,"num_ops":16,"prepare.queue_time_us":366507,"prepare.run_cpu_time_us":96571,"prepare.run_wall_time_us":1045239,"raft.queue_time_us":345213,"raft.run_cpu_time_us":12634,"raft.run_wall_time_us":174019,"replication_time_us":1268918,"spinlock_wait_cycles":23893248,"thread_start_us":1628283,"threads_started":4,"wal-append.queue_time_us":919697,"wal-append.run_cpu_time_us":38473,"wal-append.run_wall_time_us":2037368}]]}
I20260709 12:23:51.449682 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.487697  4175 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:51.556685 32106 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:51.495584 32113 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:51.514943 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:51.901557 31569 pending_rounds.cc:107] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 13.8
W20260709 12:23:51.425664  4255 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.208s	user 0.002s	sys 0.007s
I20260709 12:23:51.914662 31492 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:51.915093 31569 raft_consensus.cc:2889] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:51.904583 31389 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.095s (SENT)
I20260709 12:23:51.922564 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:51.761225 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:51.441846 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:51.684319 31496 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:23:51.904583 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:51.918613 31573 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:51.435457 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.915962 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:51.927515 31574 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:51.572578  4263 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:23:51.574563  4264 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:23:51.929659 31571 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:51.911676  3482 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:51.921839  4259 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.496s	user 0.001s	sys 0.001s
I20260709 12:23:51.911455  4154 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:51.944763 31492 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:51.949998 31574 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:51.934815  4252 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:51.954772  4159 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:51.937373  4175 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:51.969802 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:51.972019 31492 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:51.956693 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 821719us
W20260709 12:23:51.961427 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 638038us
I20260709 12:23:51.961933  4225 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15.
W20260709 12:23:51.964176 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.966987 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.976199 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:51.977574 31498 raft_consensus.cc:1217] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:23:51.985584 31498 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:23:51.984566 31465 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.550s (SENT)
I20260709 12:23:51.978984 31493 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:51.975378 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:51.984548 31497 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:51.945626  3482 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:51.990770 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:51.991571 31499 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:23:51.944410  4242 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:23:51.951349  4272 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:51.992990 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88435.5us
W20260709 12:23:51.996418 31389 leader_election.cc:336] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.175s (SENT)
I20260709 12:23:51.996784 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:52.000761 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.001053 31495 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:23:52.005287 31492 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:52.006645 32108 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:23:51.952430  4154 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.006982 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:52.015925 31540 connection.cc:256] RPC call timeout handler was delayed by -1.9302764849999221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:23:52.016340 31540 connection.cc:256] RPC call timeout handler was delayed by -1.8870764849998523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:23:52.016625 31540 connection.cc:256] RPC call timeout handler was delayed by -1.7835764849996849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 12:23:52.016916 31540 connection.cc:256] RPC call timeout handler was delayed by -1.7223764850000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:23:52.017185 31540 connection.cc:256] RPC call timeout handler was delayed by -1.7106764850000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:23:52.017448 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6908764849999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:23:52.017719 31540 connection.cc:256] RPC call timeout handler was delayed by -1.6575764849999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:23:52.018044 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5999764849998428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:23:52.018311 31540 connection.cc:256] RPC call timeout handler was delayed by -1.5936764849998326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 12:23:52.018577 31540 connection.cc:256] RPC call timeout handler was delayed by -1.4667764850000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:23:52.019079 31540 connection.cc:256] RPC call timeout handler was delayed by -1.4217764850000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:23:52.019455 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3785764849999396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 12:23:52.019765 31540 connection.cc:256] RPC call timeout handler was delayed by -1.3119764849998319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 12:23:52.020617 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:52.021581 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.022336 31492 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:51.988464  4252 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:51.990026  3826 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.975402  4248 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:23:52.025548 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.007761  4225 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:52.030459 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:52.026894 31567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1352) took 1030 ms. Trace:
I20260709 12:23:52.009440  4182 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:51.982338  4159 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.035000 31567 rpcz_store.cc:276] 0709 12:23:50.996693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.999881 (+  3188us) service_pool.cc:224] Handling call
0709 12:23:51.000183 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.000527 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.000556 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.000978 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.100739 (+ 99761us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:51.224406 (+123667us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.224637 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.224725 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.026598 (+801873us) raft_consensus.cc:1685] finished
0709 12:23:52.026632 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.026817 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":335270,"prepare.run_cpu_time_us":1298,"prepare.run_wall_time_us":12420,"raft.queue_time_us":527,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2116,"thread_start_us":198502,"threads_started":2,"wal-append.queue_time_us":205068}
I20260709 12:23:52.041415 31492 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:23:52.040946 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:52.024255  3848 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.049710 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.033192  4204 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.047116  4225 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:52.096551 31420 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:23:52.045636  4260 raft_consensus.cc:2243] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.098238 31415 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:23:52.037608  4241 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:52.045714  4254 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:52.102394  3482 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.123015 31423 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.036514  4141 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:52.035035  3826 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:52.126196 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 89998.5us
I20260709 12:23:52.133278 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:52.054908  4243 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:52.043675  4144 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:23:52.136041 31491 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:52.045607  4206 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:23:52.143260 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.153861 31416 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:23:52.138054 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97159.4us
I20260709 12:23:52.157683 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:52.129693  4263 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:23:52.151377 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 176078us
I20260709 12:23:52.052770  3848 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.166538 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.053365  4199 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:23:52.172492 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.172895 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.175896 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.184705  3826 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:52.187443  4276 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:52.193704 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.194526  3482 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:52.194937  3482 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.195235  3482 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:52.196214 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.151080  4272 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:52.120942  4204 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.201413 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.135371  4191 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:52.206750 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.207543 31421 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:52.204428 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.199481 31389 leader_election.cc:400] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:52.210002 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:52.211359 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 228000us
I20260709 12:23:52.213459 31423 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:23:52.223151 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 202585us
I20260709 12:23:52.197396  4145 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:52.155320  4141 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:23:52.199716  4182 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:52.234063 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:52.241475 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 81786.4us
W20260709 12:23:52.235625 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75794.4us
I20260709 12:23:52.242395 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.243467 31423 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:52.246243 31499 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:23:52.231576  4260 pending_rounds.cc:70] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Trying to abort 1 pending ops.
I20260709 12:23:52.221089  4253 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:52.251081 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.234665 31420 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
W20260709 12:23:52.247717 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 192064us
I20260709 12:23:52.233258  4145 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.206386  4183 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:52.242615  4272 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:52.238734  4182 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.156369  4252 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:52.272006 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 131956us
I20260709 12:23:52.255683  4260 pending_rounds.cc:77] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7305624753951539200 op_type: NO_OP noop_request { }
I20260709 12:23:52.267561  4145 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:52.279312  4093 consensus_meta.cc:287] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 1.119s	user 0.012s	sys 0.001s
I20260709 12:23:52.294067 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.267170  4253 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:52.275640  4182 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:52.270426  4272 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.267747  4243 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:52.278126  3826 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:52.302820 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 92984.7us
I20260709 12:23:52.224814  4225 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.309530 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.295485  4260 raft_consensus.cc:2889] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:52.311810  3426 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:23:52.330849 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57676.4us
I20260709 12:23:52.335150  3426 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:52.301869  4154 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.342284  3426 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.305835  4272 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:52.345470  3426 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:52.346954 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:52.348059 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76815.8us
I20260709 12:23:52.354985  4141 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:52.348670  4260 raft_consensus.cc:2272] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.295601  4251 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:23:52.357776 31389 leader_election.cc:400] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:23:52.301761  4159 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.359622 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.361328 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.361639 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.362572 31420 raft_consensus.cc:2410] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:23:52.362200  3482 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.309720  4191 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:23:52.365607  3482 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.366039  4260 ts_tablet_manager.cc:1916] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:52.367231 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:52.367972 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.368134 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.378242 31421 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:52.368767 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.379009 31422 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:52.356451  4144 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:52.345639  4284 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.366415  4154 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:52.303638  4093 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.358259  3826 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:23:52.375932  4183 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:52.413163 31422 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:23:52.331349  4290 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:23:52.390026 31420 raft_consensus.cc:2955] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 6 to 9, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:52.420469  3426 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.421069  3426 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:52.414443 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 202397us
I20260709 12:23:52.420006 31421 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:52.387406  4144 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.387531  3848 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.456285  3426 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:52.485424 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:52.444836  4144 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:52.445555  4204 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.403847  4284 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:52.497897  4299 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:23:52.398849  4243 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:52.538865 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 92927.5us
I20260709 12:23:52.516786  4186 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:52.517558  4279 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 12:23:52.518368  4295 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:52.518853  4303 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.542670 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:52.528708  4093 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.495095  4191 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:23:52.396112  4253 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:52.550185 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 307965us
W20260709 12:23:52.541569  4283 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:23:52.551539 31568 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:52.552897 31463 leader_election.cc:400] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:52.553117 31463 leader_election.cc:403] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.522501  4145 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:52.555896  4298 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:23:52.558856  4175 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.005s
I20260709 12:23:52.549129  4205 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.565655 31463 leader_election.cc:400] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17.
I20260709 12:23:52.566082 31463 leader_election.cc:403] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:23:52.569087 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.620481 31494 raft_consensus.cc:2410] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 12:23:52.613011 31568 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:52.620832 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 990) took 1389 ms. Trace:
I20260709 12:23:52.624253  3482 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.621474 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.625218  3482 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.623585 31500 rpcz_store.cc:276] 0709 12:23:51.177481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.177622 (+   141us) service_pool.cc:224] Handling call
0709 12:23:51.182391 (+  4769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.958972 (+776581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.958999 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.959461 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.204680 (+245219us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:52.204750 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.206603 (+  1853us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.566506 (+359903us) raft_consensus.cc:1685] finished
0709 12:23:52.566528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.566662 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":776242,"raft.queue_time_us":777165,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":237537,"threads_started":1,"wal-append.queue_time_us":331559}
W20260709 12:23:52.631299 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 65773.5us
I20260709 12:23:52.634027 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:52.565112  4199 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:52.641619 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.642817 31496 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:23:52.571071  4204 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.645311 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 192708us
W20260709 12:23:52.645749 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 351767us
I20260709 12:23:52.622567  4303 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:52.647346 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.649750  3482 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.650779  3482 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.651293  3482 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.655383 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.655630  4313 consensus_queue.cc:1048] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:23:52.656845  4306 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:23:52.658265  4314 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17.
I20260709 12:23:52.620401  4205 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.670822  4201 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.671604  4201 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.653113  4191 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:23:52.678872  4300 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:52.646950  4303 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:52.659176  4314 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:52.697047 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50248.5us
I20260709 12:23:52.698182 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.648440  4204 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.712041 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:52.751232 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 117316us
I20260709 12:23:52.645179  4199 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:52.761255 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 213768us
W20260709 12:23:52.758289  4274 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.747s	user 0.000s	sys 0.010s
I20260709 12:23:52.712963  4300 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:52.717365  3482 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.709662  4042 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.710031  4314 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:52.773168 31493 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:52.775388 31500 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.775704  3426 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:23:52.784718 31566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48852 (request call id 2070) took 1452 ms. Trace:
I20260709 12:23:52.784677  4314 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.786270  4085 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:52.785297 31566 rpcz_store.cc:276] 0709 12:23:51.332088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.332216 (+   128us) service_pool.cc:224] Handling call
0709 12:23:51.332531 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:51.428403 (+ 95872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.428436 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:51.456068 (+ 27632us) log.cc:844] Serialized 26 byte log entry
0709 12:23:51.902818 (+446750us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:51.925412 (+ 22594us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.925697 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.925791 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.757521 (+831730us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:52.784418 (+ 26897us) raft_consensus.cc:1685] finished
0709 12:23:52.784519 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.784641 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22360,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":5175,"raft.queue_time_us":26132,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9864,"spinlock_wait_cycles":195847936,"thread_start_us":328199,"threads_started":1,"wal-append.queue_time_us":472262}
I20260709 12:23:52.786841  4085 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.784294  3426 consensus_queue.cc:1243] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:23:52.788661  4272 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.791414  4272 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:52.791661  4273 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.888s	user 0.006s	sys 0.000s
I20260709 12:23:52.792274  4183 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:52.793145  4182 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.776656  3826 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:52.775691  4303 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.797046 31492 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:52.752707  4144 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.809290  4183 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.809819  4183 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.812777 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.767599  4154 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:52.798725  4262 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 1.358s	user 0.012s	sys 0.018s
I20260709 12:23:52.818782 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58364 (request call id 1357) took 1820 ms. Trace:
I20260709 12:23:52.819358  4204 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:52.812129  4145 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.799841 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 1011) took 1349 ms. Trace:
I20260709 12:23:52.819126 31565 rpcz_store.cc:276] 0709 12:23:50.998093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.998731 (+   638us) service_pool.cc:224] Handling call
0709 12:23:50.999044 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:50.999434 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.999477 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:51.000177 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 12:23:51.138706 (+138529us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:51.230927 (+ 92221us) log.cc:844] Serialized 14 byte log entry
0709 12:23:51.231356 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.231427 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.798338 (+1566911us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b240020d7b8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc1164fc9c4 00007fc1164faacb 00007fc1166b5dc9 00007fc1166b5a55 00007fc1166b509d 00007fc1192e710e 00007fc1192fe88c 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221
0709 12:23:52.818477 (+ 20139us) raft_consensus.cc:1685] finished
0709 12:23:52.818574 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.818723 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":384794,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1440,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"spinlock_wait_cycles":52906880,"thread_start_us":196698,"threads_started":2,"wal-append.queue_time_us":389387}
I20260709 12:23:52.799295  4199 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.820319 32112 rpcz_store.cc:276] 0709 12:23:51.450513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.456255 (+  5742us) service_pool.cc:224] Handling call
0709 12:23:51.510146 (+ 53891us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:51.520706 (+ 10560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:51.520738 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:51.521335 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 12:23:51.902354 (+381019us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:51.902414 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.902501 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:52.790977 (+888476us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:52.799532 (+  8555us) raft_consensus.cc:1685] finished
0709 12:23:52.799552 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.799769 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10052,"raft.queue_time_us":11040,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20114,"spinlock_wait_cycles":25804544,"thread_start_us":290896,"threads_started":1,"wal-append.queue_time_us":332964}
I20260709 12:23:52.803484 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.801376 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.804294  4311 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:23:52.788980  4085 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.814738 31498 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.815279  4317 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:52.815675  4182 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.819480 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.822208 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.803829  4284 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:52.833889 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 121938us
I20260709 12:23:52.823577 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:52.842864 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 196246us
I20260709 12:23:52.854640 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.856495 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.857137 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.776850  4042 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.854562  4144 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:52.822497  4277 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:52.868970  4325 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:52.876127 31415 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:52.884428 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 134333us
I20260709 12:23:52.889678  4281 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:52.890264  4281 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:52.871416  4183 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.901654 31419 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:52.873030  4325 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.922909 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.924077 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:52.924634 31417 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:52.926033 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50435us
I20260709 12:23:52.927722 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.929454 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.873872  4308 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:52.934096 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.934720 32107 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:52.935477  4284 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:52.938066  4284 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:52.939507  3743 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:52.939183  4284 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.937476  4010 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:52.939893  3743 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:52.900110  4201 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:52.905287  4145 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.945628 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.946424 32108 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:52.944839 32107 pending_rounds.cc:85] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 12
I20260709 12:23:52.948666 32107 pending_rounds.cc:107] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:23:52.948916 32107 raft_consensus.cc:2889] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:52.948794 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.949307 32108 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:52.932509  4183 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:52.953248 32108 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:52.952267 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141957us
I20260709 12:23:52.940745  4284 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:52.942919  4010 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:52.972585 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.932152  4325 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.976269 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.979167 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:52.980014 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.968510  3848 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:52.992383 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:52.989089 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:52.989269 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:52.990094 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:52.951212  4145 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:52.995103  4010 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.996155  4010 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:52.977335  3743 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:52.999624  3743 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:53.006584 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:53.008219 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:52.963280  4201 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:23:52.959466  4183 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.026628 31417 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:53.029628  4288 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:52.983625  4300 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.970000  4317 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:53.004894  4242 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:53.007603  3848 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.033351  4021 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:23:53.023694  4308 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:53.008525  4215 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:52.952325  4281 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:53.053648 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 257543us
W20260709 12:23:53.056174 31465 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.750s (SENT) [suppressed 35 similar messages]
I20260709 12:23:53.050402 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:53.060001 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.046224  4144 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:53.061757  3426 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:53.064643  3426 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:53.064203  4090 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:53.068847 31465 leader_election.cc:336] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.784s (SENT)
I20260709 12:23:53.071697  3426 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:53.055967  4042 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:53.063618  4144 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:53.044801  4300 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.055492  3848 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:53.095227 31465 leader_election.cc:336] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.925s (SENT)
W20260709 12:23:53.095976 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.098832  4289 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.098663 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.099442  4289 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.100052  4306 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:53.100955 31465 leader_election.cc:336] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.951s (SENT)
I20260709 12:23:53.101727  4289 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:53.102555 31465 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.966s (SENT)
I20260709 12:23:53.085690 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.087433  4281 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.058089  4215 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.074793  4329 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:53.111315  4328 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:23:53.112259  4327 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:23:53.069994  4308 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:23:53.135848  4144 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.079309  3826 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:23:53.141714 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63301.2us
I20260709 12:23:53.142304  4311 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:53.135957  3848 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.149435 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:53.156373 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53868.2us
W20260709 12:23:53.157023 31465 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.018s (SENT)
I20260709 12:23:53.141436  4215 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:53.163549 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.143896  3826 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:53.150084  4330 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:23:53.145799  4308 consensus_queue.cc:1243] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:53.155745 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.184337  4260 ts_tablet_manager.cc:1929] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 12:23:53.184947  4260 log.cc:1199] T d385c04853e749af8fb00afe40a4a255 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/d385c04853e749af8fb00afe40a4a255
I20260709 12:23:53.186313  4260 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48288 (request call id 6) took 2219 ms. Trace:
I20260709 12:23:53.155089  4144 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.140318  4329 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.197847  4215 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:53.198465  4215 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.200830  4215 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:53.201380  4242 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.201958  4242 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.203913  4325 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.204093  4242 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:53.206466 32112 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:53.174507  4300 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:53.155033  4042 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:53.210156  4205 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.186667  4260 rpcz_store.cc:276] 0709 12:23:50.966367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.970570 (+  4203us) service_pool.cc:224] Handling call
0709 12:23:51.209703 (+239133us) ts_tablet_manager.cc:1151] Deleting tablet d385c04853e749af8fb00afe40a4a255
0709 12:23:51.209791 (+    88us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:23:52.874007 (+1664216us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:53.184165 (+310158us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:53.186183 (+  2018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604774,"tablet-delete.queue_time_us":238022,"thread_start_us":174194,"threads_started":1}
I20260709 12:23:53.217104  3826 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.218145  3826 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.219297  3848 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:53.219703  3848 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:53.220590  3848 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.221712  3848 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.227142  4183 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:53.218168  4214 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:53.229171  4214 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:53.230129  4214 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.231045 32112 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 12:23:53.231462  4214 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.232689 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.233417 32112 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:53.169896  4311 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:53.234987  4311 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.235387  4311 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:53.241079 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.243837  4329 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:53.253017 31465 leader_election.cc:336] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.069s (SENT)
W20260709 12:23:53.253814 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56418.8us
W20260709 12:23:53.256524 31465 leader_election.cc:336] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.729s (SENT)
I20260709 12:23:53.256875 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:53.259678 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.260839  4322 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.399s	user 0.003s	sys 0.000s
I20260709 12:23:53.213757  4284 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:53.275339 31565 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:53.276530 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.277226 31570 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:53.279635 31568 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:23:53.280002 31568 pending_rounds.cc:85] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 9
I20260709 12:23:53.280217 31568 pending_rounds.cc:107] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:23:53.280453 31568 raft_consensus.cc:2889] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:53.284351 31465 leader_election.cc:336] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.790s (SENT)
I20260709 12:23:53.284909 31465 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:53.286105 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 200500us
I20260709 12:23:53.286933 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.289110 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.289968 31567 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:53.288921 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.290916 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:53.292785 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 143405us
I20260709 12:23:53.294618 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:53.296512 31465 leader_election.cc:336] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.800s (SENT)
I20260709 12:23:53.279260  4280 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.283264  4325 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:53.296926 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.296917 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:23:53.301178 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.301792 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.292136  4284 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:53.302747 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.302559 32112 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:53.309129 31570 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:53.306170 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.309320 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.306433 31571 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:23:53.306356 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.306948 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.310786 31571 pending_rounds.cc:85] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:53.311484 31571 pending_rounds.cc:107] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:23:53.311524 31569 raft_consensus.cc:2376] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12. Re-sending same reply.
I20260709 12:23:53.311851 31571 raft_consensus.cc:2889] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.299121  4241 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:53.312975  4241 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:53.313325  4241 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:53.314321 32079 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:53.308084 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:53.316051 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.316164 31568 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:53.316242 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.310110 31572 raft_consensus.cc:2376] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16. Re-sending same reply.
W20260709 12:23:53.321403 31465 leader_election.cc:336] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.808s (SENT)
I20260709 12:23:53.299705  3848 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:53.304718  4290 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:53.333880 31465 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.004s (SENT)
I20260709 12:23:53.309753  4284 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:53.310537  4341 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:23:53.338040 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.344354 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.345013 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.354455 31568 raft_consensus.cc:2376] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15. Re-sending same reply.
I20260709 12:23:53.345240 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.347785  4204 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:53.300838  4308 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:23:53.332171  3848 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.318336  4306 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:53.297953  4316 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:23:53.303833  4280 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:53.427728 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.428171 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.429183  4280 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:53.437637 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.351857  4284 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:53.360785  4294 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:53.310060  4310 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:23:53.330121  4242 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:53.447386  3482 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:53.447826  3482 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:53.383836 31420 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:53.384114 31422 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:53.367769 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.393062 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.393318 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.395172 31424 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:53.395803 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.451670 32113 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:53.399147 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.400755 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.408351 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.453506 31417 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:53.409476 31416 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:53.412262 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.413594 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.414412 31497 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:23:53.414327 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.442655 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.356496 31565 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:53.384606 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:53.452960 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:53.459645 32111 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:23:53.462322 31420 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:53.463596 31416 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:23:53.381458  4341 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:53.465320 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.361444  4204 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:53.470340  3482 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.500542  3482 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.467706 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.478904  4242 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:53.495469 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.468475 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.451835  3848 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:53.504937 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.516093 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:53.518265 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.519173 31565 raft_consensus.cc:2410] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:23:53.520330 31424 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:53.522399 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.525298 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.526444 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:53.527195  4329 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:53.527732  4329 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:53.528159  4329 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:53.532318 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:53.507221  4281 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:53.540199 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.509986  4294 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:53.547626 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.506069  4192 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:23:53.556231 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:53.556607 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.531616  4310 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:53.560168 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 244765us
I20260709 12:23:53.562343 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.563513 31497 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:53.576378 31497 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:53.576830 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.531745  4325 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:23:53.582261 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:53.583892 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.553484  4183 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:53.599037  4183 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.578138  4204 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.601084  4204 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:53.563490  4310 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.572439  4316 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:53.619275  4316 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.619760  4316 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:53.620285  4349 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:23:53.585937 31494 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:53.566744  4314 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:53.596784 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.560748  4160 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:53.634837 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.572608  4141 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:23:53.645507  3826 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.655160 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.655754 31567 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.632887  4310 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:53.658942 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.589941  4192 consensus_queue.cc:1059] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:23:53.610877  4183 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.654822  3826 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.666891  3826 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.667891  4358 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:53.668514  4358 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:53.670028  4358 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.672750  4303 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:53.674304 31567 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:53.586398  4341 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.676944  4315 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:53.679536 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:53.683298 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 99964.6us
I20260709 12:23:53.683467 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.687361 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.687788 31572 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:23:53.688164 31572 pending_rounds.cc:85] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 7
I20260709 12:23:53.688382 31572 pending_rounds.cc:107] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:23:53.688594 31572 raft_consensus.cc:2889] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:53.690191 31500 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:53.631323  4242 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.680819  4315 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:53.699535 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:53.702768 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.706244 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129034us
W20260709 12:23:53.706552 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 130039us
I20260709 12:23:53.708504 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:53.690375  4358 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:53.707437 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.691177  4141 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:23:53.689852  4311 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.707055  4246 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:53.710924  4010 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:53.711236  4241 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:53.722661 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.723006 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.744657 31572 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:53.724527 32114 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:53.725693 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.733371 31574 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:23:53.748538 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.733984  4021 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:53.740127  4246 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:53.761740 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52216.4us
I20260709 12:23:53.762537 31573 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:53.765156 31415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 1933) took 1642 ms. Trace:
I20260709 12:23:53.765807 31415 rpcz_store.cc:276] 0709 12:23:52.122437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.123563 (+  1126us) service_pool.cc:224] Handling call
0709 12:23:52.822967 (+699404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.876552 (+ 53585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:53.534523 (+657971us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400148054. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:53.764991 (+230468us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400148050. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:23:53.765103 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664864384}
I20260709 12:23:53.779328 31567 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:53.742493  4192 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:23:53.783445 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.737634  4329 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.767211  4246 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.797242  4315 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.802021  4315 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:53.802829  4339 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:53.774384  4183 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.782908  4284 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.774619  4354 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:23:53.829978 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 69200.3us
I20260709 12:23:53.843539 31571 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:53.846043 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78306.1us
I20260709 12:23:53.809139  4183 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.883029 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.883733 31493 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:53.884464 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.890895 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43951.8us
I20260709 12:23:53.895311 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.900595 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.901211 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:53.905793  4366 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:23:53.909272  4333 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:23:53.879129  4205 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:53.910876 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:53.917843 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.918357 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:53.924590 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.886287  4144 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:23:53.928843 31389 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.930s (SENT)
W20260709 12:23:53.930315 31465 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.965s (SENT)
I20260709 12:23:53.913301  4311 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.934562 31565 raft_consensus.cc:2410] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 12:23:53.923635  4248 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:53.941073 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.941908 31570 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16. Re-sending same reply.
I20260709 12:23:53.947499 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:53.948583 31493 raft_consensus.cc:2410] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:53.950273 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.951395 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:53.952132 31389 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.955s (SENT)
I20260709 12:23:53.952559 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:53.953078 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.952539 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.953898 31570 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:53.957474 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.959739 31570 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:53.961624 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.964385 31570 raft_consensus.cc:2376] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16. Re-sending same reply.
I20260709 12:23:53.966257 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.969247 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:53.972787 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.977059 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:53.928354  4241 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.945070  4248 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:53.919701  4205 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:53.950793  4325 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:23:53.951628  4206 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:53.978031  4310 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:53.996434  4284 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:53.997455  4248 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:54.003764  4329 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.006196  4205 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.010106  4183 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.016215  4206 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.052244  4206 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.056922  4310 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.059527  4145 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.068749  4289 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:54.069187  4289 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.077732 31500 raft_consensus.cc:2410] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:53.980422 31570 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:23:54.080231 31570 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
W20260709 12:23:54.080910  4371 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.202s	user 0.001s	sys 0.002s
I20260709 12:23:54.081045 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:54.042749  4191 raft_consensus.cc:3055] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:54.081697 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:54.081873  4191 raft_consensus.cc:740] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.082336 32113 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:54.082930  4350 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.450s	user 0.003s	sys 0.000s
I20260709 12:23:54.082823  4191 consensus_queue.cc:260] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.083907  4191 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:54.027168 32114 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:54.081430 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:54.021191 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 69090.2us
W20260709 12:23:54.088778 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.096191 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:54.097851  3848 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.001s
I20260709 12:23:54.098404  3848 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.099793 31570 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:23:54.101467  3848 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.018343  4316 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.104228 31494 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:54.038209  4306 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:54.105779  4306 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.107273  4316 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.106755  4306 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.108264  4306 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.116911 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:54.120000 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.116437 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:23:54.016710 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.016976 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.021514 31567 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:54.129827 31567 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:54.021627  4144 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:54.024964 32106 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
W20260709 12:23:54.132098 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.122004 31574 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.147286 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.149271 32113 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:54.158004 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:54.158823 31495 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:54.161873 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:23:54.163336 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.164276 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.165678 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.168741 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.171406  3426 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:54.173518 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56705.4us
I20260709 12:23:54.173818 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.175011  3426 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.176152 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:54.176249 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.177847 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:54.171072  4205 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.179200  4205 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.181739  4205 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.182317  4345 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:54.184187  4345 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:54.184676  4345 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:54.185555  4345 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.186811  4145 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:54.187237  4145 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:54.187608  4145 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:54.175017  4311 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.192889  4316 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.193532  4316 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.196029  4316 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.196692  4325 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:54.198362  4325 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.070112  4289 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.200486  4358 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.201027  4358 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.202847 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.204532  4144 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:54.205014  4144 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:54.205484  4144 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:54.208129 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 60936.6us
I20260709 12:23:54.210162 31424 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:54.211544 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.212345 31415 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:54.211948 31567 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.213284 31567 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:54.214895  4329 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:54.216046 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.215889  4246 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.217763 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.218528 31422 raft_consensus.cc:2393] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:23:54.219453 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.223289 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.226792 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.220693 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:54.227033 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.231583 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.231952  4358 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.232458 31424 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 9.
I20260709 12:23:54.237002  4253 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.237550 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.237699  4253 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:54.238881 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61136.2us
I20260709 12:23:54.239763 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.240491  4316 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.241225  4354 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:54.245307 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:54.249840 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:54.257465 31492 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:54.262391 32114 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.165956  4189 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.283502 32106 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:54.283789 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:54.286425 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.280962 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:54.296274 32114 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:54.287884 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 196997us
I20260709 12:23:54.290858 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:54.297933 31389 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 2.011s (SENT)
I20260709 12:23:54.298327 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:54.300823 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45580.7us
I20260709 12:23:54.302022 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:54.297108 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:54.305845 31573 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 12:23:54.242333  4354 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:54.306219 31573 pending_rounds.cc:85] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 11
W20260709 12:23:54.311151 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 71466.7us
I20260709 12:23:54.311414 31573 pending_rounds.cc:107] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:23:54.311800 31573 raft_consensus.cc:2889] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:54.312388 31389 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Timed out: RequestConsensusVote RPC to 127.29.143.195:34217 timed out after 1.779s (SENT)
W20260709 12:23:54.313390 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.313992 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.315089 31424 raft_consensus.cc:2410] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:54.317111 31567 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:23:54.317531 31567 pending_rounds.cc:85] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 5
I20260709 12:23:54.317241 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.317860 31567 pending_rounds.cc:107] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:23:54.318235 31419 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:54.307976 31421 raft_consensus.cc:1217] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Deduplicated request from leader. Original: 10.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 12:23:54.320176 31421 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:23:54.318252 31567 raft_consensus.cc:2889] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:54.322111 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.219277  4090 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 12:23:54.324347 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.299484  4280 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:54.329164 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.328013 31415 raft_consensus.cc:2393] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:54.331811  4284 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.331951  4385 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:54.332406  4284 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.332620  4385 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.336535  4309 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:23:54.328759  4341 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:54.337666  4341 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:54.338557  4341 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.339174  4339 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:54.339757  4339 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.340978 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.341573 31572 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.341746  4339 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.282506  4285 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:23:54.343576  4285 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:54.343963  4285 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:54.344836  4285 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.345376  4345 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:54.346163  4285 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.346408  4345 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:54.346797  4345 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:54.332142  4381 log.cc:927] Time spent T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:54.347590  4345 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.348721  4345 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:54.316895  4253 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.310459  4310 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:23:54.350891  4385 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.318300  4205 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:54.322376  4246 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.352880 31574 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:54.353415 31424 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.354018 31566 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:54.354977 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.355546 31568 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:54.355831 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:54.356115 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:54.356391 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.357197 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.311329  4354 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:54.360466 31572 raft_consensus.cc:2468] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:54.360570 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:54.362986 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 186892us
I20260709 12:23:54.363777 31540 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.363973 32079 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:54.334483  4284 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.325145  4010 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:54.369510 31419 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:23:54.372856 31417 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:23:54.365833 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.368003 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
W20260709 12:23:54.365326 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.384022 31415 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:23:54.387003 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.392138  4144 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.395327  4144 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.403084  4311 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:54.403285 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 101788us
I20260709 12:23:54.369876  4385 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:54.369136  4253 raft_consensus.cc:2804] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:54.407265 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.369136  4093 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:54.414345 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.415381 31419 raft_consensus.cc:1240] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:54.416646 31540 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.362650  4145 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.359331  4248 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.366567  4042 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:23:54.369444  4246 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:23:54.406740  4253 raft_consensus.cc:697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:54.433260 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.433019  4141 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:23:54.437595  4241 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:54.439433  4145 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.439491  4248 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.420845  4093 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:54.445603  4093 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:54.445716 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.447392  4253 consensus_queue.cc:237] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.423647  4343 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:23:54.440727 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.430423  3705 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:23:54.444362  4385 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.424027  4284 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:54.456094 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.457409 31566 raft_consensus.cc:2410] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:23:54.458412 31568 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.460548 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:54.462303 31566 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:23:54.462811 31566 pending_rounds.cc:85] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 6
I20260709 12:23:54.463088 31566 pending_rounds.cc:107] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 12.7
W20260709 12:23:54.463989 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.463685 31566 raft_consensus.cc:2889] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:54.464119 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.466717 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:54.470062 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.467996 31572 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.474843 31419 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.475494 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.477814 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.480746 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.483201 31419 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:54.453783  4284 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.486220 31566 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:54.486969 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.485863  4284 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.458316  4303 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:54.491390 31567 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:54.491556  4303 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.493892  4303 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.487717 31419 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.499099 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.499799 31416 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:54.500803 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:54.501319 31571 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:54.501461 32113 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:54.511016 31493 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:54.512521 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.514176 31416 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:54.524695 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.526916 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.532238 31574 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:23:54.532691 31419 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:54.524250  4183 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:54.536980 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.539881 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.541343 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.542358 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.545553 31573 raft_consensus.cc:2376] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13. Re-sending same reply.
I20260709 12:23:54.546341 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:54.546747 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.547434 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.546413 31572 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:54.550170 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.552477 31573 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:54.552708 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.553459 31415 raft_consensus.cc:2410] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:23:54.555086 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.553215 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.564584 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.565140 31418 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:54.565683 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.566756 31419 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:54.567163 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.567955 31574 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:54.571550 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:54.572081 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:54.575240 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.576093 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.576800 31574 raft_consensus.cc:2393] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:54.577044 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.578922 32110 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:54.574471  4362 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:54.580224 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.583527 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:54.583645 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.585566 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.561240  4183 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:54.589596 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.590991 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.592046 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.592666 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.593725 31573 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:54.597206 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.599545 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.600430 31572 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:23:54.603780 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:54.607788 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.612403 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.580123  4362 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.601881  4160 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:54.622639 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.615140  4206 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.626057 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.602103  4145 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:23:54.630611 31389 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.631026 31494 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:54.632768 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.637864  4093 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.640035  4093 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:54.640224  4387 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.354s	user 0.002s	sys 0.003s
I20260709 12:23:54.642088 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.646837  4241 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.647344  4241 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.649324  4241 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:54.651091 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:54.615162  4205 consensus_queue.cc:1059] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:23:54.654604 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.654776 31540 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.654387  4341 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.657387  4384 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:54.661314 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.664044 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.666064  4386 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:54.668210  4390 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:54.668222  4386 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:54.671751 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.673386 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.675448 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.669291  4386 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:54.677699  4392 log.cc:927] Time spent T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:54.679167  4204 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:54.679816  4391 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:23:54.677825  4386 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.664520  4404 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:54.700253 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.703387 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.704032 31565 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.704490 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.670404  4206 raft_consensus.cc:2764] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 12:23:54.706336 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 83161.8us
I20260709 12:23:54.707357 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:54.674124  4144 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:54.719281 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.721081 31419 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:23:54.726595 32106 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:54.727048 31565 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:23:54.729135  4400 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:23:54.730243 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:54.730930 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.731999 31569 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:54.732474 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.733047 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:54.733916 31569 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:54.739969  4289 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:54.655726  4183 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.662207  4093 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:23:54.744622  4093 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:54.745115  4093 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:54.745774  4354 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.747778  4354 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.701547  4145 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:54.754253 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 170789us
I20260709 12:23:54.755154 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:54.756769 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.756958 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:54.730980  4206 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:54.758708  4363 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.945s	user 0.000s	sys 0.002s
I20260709 12:23:54.760449  4192 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:54.761055  4192 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.708690  4160 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:23:54.762573  4394 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:23:54.762869 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 177369us
I20260709 12:23:54.763615 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:54.765060 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:54.766518 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:54.791841 31570 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:23:54.702809  4404 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:23:54.796888 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 145850us
I20260709 12:23:54.798262 31416 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:54.800040 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:23:54.802335 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.794627  4391 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:23:54.762015  4192 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.728013 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:54.793923  4402 log.cc:927] Time spent T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:23:54.811117 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 43686.2us
I20260709 12:23:54.670562  4362 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.813716  4362 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:54.815034  4290 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:54.794982  4306 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.796252  4246 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:54.797020  4145 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.799355  4141 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:54.799479  4310 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:54.889730 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.842464 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.817358  4325 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:54.802009  4281 consensus_queue.cc:1059] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:23:54.746558  4093 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.827132  4246 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:54.918617 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 106547us
W20260709 12:23:54.919652 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 77313.2us
I20260709 12:23:54.831447  4310 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.834761  4010 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:54.889302  4141 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.914753  4191 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.828747  4316 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:23:54.914515  4306 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.921880  4242 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.917582  4325 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:54.833844  4145 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.923386 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.929126  4310 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:54.923943  4246 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:54.956760 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.960870 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.934530  4412 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.936848  4093 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:54.954928  4325 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:54.971799  4285 consensus_meta.cc:287] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.625s	user 0.002s	sys 0.009s
I20260709 12:23:54.946835  4284 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.974159  4284 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:54.951843  4290 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:54.970101 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.982977 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.984640 31389 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.986146 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:54.935596  4010 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.987182 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:54.962342  4406 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:23:54.980147 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57681.1us
I20260709 12:23:54.977825  4183 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:54.979637  4316 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:54.955379  4242 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.022069  4242 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:54.997938 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.976289  4248 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:54.945185  4191 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:54.999658  4403 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:55.001134  4405 raft_consensus.cc:3055] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:23:55.001684  4145 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:54.985368  4404 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:54.986210  4160 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:55.032220  4405 raft_consensus.cc:740] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:54.992954  4386 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:54.990515  4329 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:55.037779  4329 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.037576  4405 consensus_queue.cc:260] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:55.003880  4411 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:55.038903  4405 raft_consensus.cc:3060] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.009143 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:55.039855  4191 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:54.962949  4159 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:55.043011  3705 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:23:55.032526  4248 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.045451  4248 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:55.016764  4407 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:23:55.018953  4253 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:23:54.975296  4290 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:54.992853  4141 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:54.986019  4408 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:55.028815  4204 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.054790 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.060070 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:55.038184  4329 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:55.062340 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.008306  4316 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.090610 31572 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:55.094988 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.096740 31498 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:55.096784 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.094988 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.098800 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:55.104394  4306 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:55.104833  4306 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.105666  4306 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.106966  4306 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.109412  4246 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.115270 32106 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:55.110571 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.110737  4160 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:55.120831  4160 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.121292  4160 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.127734  4306 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:55.112690  4316 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.132138  4316 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.134155  4010 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.139058 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.142087 31494 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:55.142367 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.143121 31500 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:55.143033  4306 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.147689 31497 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:23:55.102883 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 346209us
I20260709 12:23:55.165828 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:55.178012 31494 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:55.179859 31500 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:55.186295  4289 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:55.186849  4314 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:55.161125  4325 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.162619  4310 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.201932 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.202953 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.203349 31494 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:55.212733 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:55.220932  4325 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.222065  4306 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.222599 31416 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:55.224303  4412 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:55.233731  4329 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.216208  4159 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:55.235049  4159 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.237092  4159 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.243386  4310 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.292112 32114 raft_consensus.cc:1240] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:55.295737 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.295279  4145 consensus_queue.cc:1059] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:23:55.298086  4145 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:55.298435  4145 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:55.301980 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:55.302820 32113 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:55.287320  4160 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.303941  4145 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.307396  4145 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:55.294633  4412 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.319396 32113 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:55.308722  4412 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.322139 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.335227 31421 raft_consensus.cc:1240] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:55.340736 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:55.319726  4141 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.346511 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:55.347175 31420 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:55.349159  4424 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:23:55.355993 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.362346 31418 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:55.371809 31420 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:55.351135  4329 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.361815  4310 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:55.380445 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:55.345386  4141 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.384903  4154 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:55.385376  4154 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:55.385768  4154 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:55.391997  4412 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.398017  4141 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.416246 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.414669 31498 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:55.422364 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:55.426272  4418 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
W20260709 12:23:55.426836 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.430365 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet d385c04853e749af8fb00afe40a4a255 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
W20260709 12:23:55.433147 31307 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 2.05199e+06us
I20260709 12:23:55.438897  4143 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:23:55.439486  4431 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:23:55.442219 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 716206us
I20260709 12:23:55.443194 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.442965 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:55.445045  4310 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:55.447571 31417 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:23:55.447942 31417 pending_rounds.cc:85] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 8
I20260709 12:23:55.448149 31417 pending_rounds.cc:107] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:23:55.448390 31417 raft_consensus.cc:2889] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:55.442327 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:55.450197 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:55.462961  4284 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:55.465329  4204 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.468058  3826 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.468827  3826 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.471908 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:55.474915  4384 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:55.456629  4159 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:23:55.462405  4311 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:55.453305  4042 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:23:55.466150  4204 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:55.481209  4396 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.907s	user 0.006s	sys 0.000s
I20260709 12:23:55.483635  4160 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.484331 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48102 (request call id 1020) took 1225 ms. Trace:
I20260709 12:23:55.485780 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:55.486543 31500 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.488171 31498 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:55.491436 32113 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:55.485054 31499 rpcz_store.cc:276] 0709 12:23:54.259375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.259481 (+   106us) service_pool.cc:224] Handling call
0709 12:23:54.299971 (+ 40490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:54.406196 (+106225us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:23:54.406473 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.494179 (+ 87706us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b18004519c0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116676522 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:54.545507 (+ 51328us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.565163 (+ 19656us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:54.585573 (+ 20410us) log.cc:844] Serialized 52 byte log entry
0709 12:23:54.585719 (+   146us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:23:54.585994 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.744363 (+158369us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18004519c0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc11d63758f 00007fc116676571 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd
0709 12:23:54.760360 (+ 15997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.761158 (+   798us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b5400023ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:23:54.761204 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.450446 (+689242us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18004519c0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db
0709 12:23:55.480743 (+ 30297us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:23:55.484127 (+  3384us) raft_consensus.cc:1685] finished
0709 12:23:55.484147 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.484279 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235890,"prepare.queue_time_us":2350,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":971,"raft.queue_time_us":294339,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":30516,"spinlock_wait_cycles":204851712,"thread_start_us":135188,"threads_started":1,"wal-append.queue_time_us":167478}
I20260709 12:23:55.484432  4204 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.493458  4160 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:55.483929  3826 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:55.496838 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54601.7us
I20260709 12:23:55.497462  4141 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:55.439492  4143 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.500186  4280 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:55.501259  4143 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.501956  4246 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.502950  4141 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.504298  4141 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:55.511349 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53767.7us
I20260709 12:23:55.512887 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:55.496788  4358 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.519563  4358 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.523535  4358 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.534551 31500 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:23:55.565793 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:55.569456  4143 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:23:55.571487 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45086.1us
I20260709 12:23:55.571995  4154 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.572772 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.551506  4339 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:55.526232  4290 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.566816 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.510063  4408 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:23:55.547576  4042 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.577001 31418 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:55.577291 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:55.587597 31574 raft_consensus.cc:1275] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:55.578455 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:55.565337 31317 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.591398 31317 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.593061 31317 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 14, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 14 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.594442 31317 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.575021  4412 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:23:55.603745 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 158952us
I20260709 12:23:55.600793 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:55.574870  4143 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.574640  4154 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.576625  4339 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:55.603320 31317 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.607446 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.588702  4093 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:55.612506 31317 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 14, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 14 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.584462  4384 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.582206  3826 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:55.617403 31320 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 189) took 27670 ms (client timeout 15000 ms). Trace:
I20260709 12:23:55.577957  4290 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.588795  4204 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.615365 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.619124 31463 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.644136 31574 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:55.623446 31415 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:23:55.583513  4042 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.645093 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:55.639732 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.615197 31317 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 10, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 10 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.607986 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:23:55.623667 31304 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet e77a183300084f968171dcd68225d026 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 9
I20260709 12:23:55.611018  4310 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:55.654086 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:55.616276  4093 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:23:55.617805 31320 rpcz_store.cc:269] 0709 12:23:27.947301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.947573 (+   272us) service_pool.cc:224] Handling call
0709 12:23:55.617319 (+27669746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:52.131984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:52.183920 (+ 51936us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:52.183975 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:23:52.183996 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:52.184900 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:52.184994 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:52.185030 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:52.185832 (+   802us) tablet.cc:701] Row locks acquired
0709 12:23:52.185903 (+    71us) write_op.cc:260] PREPARE: finished
0709 12:23:52.186079 (+   176us) write_op.cc:270] Start()
0709 12:23:52.186226 (+   147us) write_op.cc:276] Timestamp: P: 1783599832186011 usec, L: 0
0709 12:23:52.186248 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:52.241434 (+ 55186us) log.cc:844] Serialized 2789 byte log entry
0709 12:23:52.950649 (+709215us) op_driver.cc:464] REPLICATION: finished
0709 12:23:53.163118 (+212469us) write_op.cc:301] APPLY: starting
0709 12:23:53.171038 (+  7920us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:53.202660 (+ 31622us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:53.226834 (+ 24174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:53.230377 (+  3543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:53.238777 (+  8400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:23:53.238834 (+    57us) write_op.cc:312] APPLY: finished
0709 12:23:53.239172 (+   338us) log.cc:844] Serialized 65 byte log entry
0709 12:23:53.239391 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.239509 (+   118us) write_op.cc:454] Released schema lock
0709 12:23:53.239569 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:53.240077 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:53.240110 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2542052,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":205595,"apply.run_cpu_time_us":11447,"apply.run_wall_time_us":76901,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":601428,"prepare.run_cpu_time_us":37911,"prepare.run_wall_time_us":368351,"raft.queue_time_us":148014,"raft.run_cpu_time_us":73006,"raft.run_wall_time_us":233565,"replication_time_us":749564,"thread_start_us":678529,"threads_started":4,"wal-append.queue_time_us":204527,"wal-append.run_cpu_time_us":14171,"wal-append.run_wall_time_us":1794835}]]}
I20260709 12:23:55.615177  4412 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:55.656602 32113 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:23:55.654399 31317 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 15, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:23:55.667347 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59439.3us
I20260709 12:23:55.644928  4189 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:55.667145 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:55.669760 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.670894 31317 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 12, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.651597  4310 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.675580 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.677884 31574 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:55.662595  4093 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.660192  4280 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:55.641183  4384 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.681448 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.678431 31317 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.681330  4438 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:55.642832  3826 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.687026  4440 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:55.655387  4314 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:23:55.687963  4314 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:55.688308  4314 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.689019  4314 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.647414  4204 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.690114 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.692358 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.690533 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.692984 31567 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:55.690968 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.693552 31571 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.694108 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.691125 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.691533 31570 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:55.695217 31565 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:55.699311 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.699565 32107 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:55.677944  4310 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.675158  4441 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:55.702489 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:55.703052 31420 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:55.706146 31317 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.684836  4159 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:55.708396 31317 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 13, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.741394 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:55.742115 31494 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:55.744689 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.746160 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:55.736433  4159 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:55.690083  4314 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:55.675266  4325 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:23:55.710793 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.716024 31420 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:55.720546 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.727885  4246 consensus_queue.cc:1048] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:55.729027  4412 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.731359  4384 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:55.732995  4290 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.692718  4339 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.711642 31566 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:55.759922 31317 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.715934 31565 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
W20260709 12:23:55.763562 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57937.1us
W20260709 12:23:55.769080 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48620.3us
I20260709 12:23:55.769770 31571 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:23:55.771740 31421 raft_consensus.cc:2393] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:55.771843 31494 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:23:55.788288 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.793207 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.793900 31565 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:55.762393  4316 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.794066 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:55.760648  4280 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.795611 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.799813 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.795478 31317 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.800160 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.800879 31571 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:55.801128 31317 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.778378  4160 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:55.806051 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:55.838217 31568 raft_consensus.cc:2393] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:23:55.785197  4446 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:23:55.803453 31317 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.843001 31317 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.842522 31565 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:23:55.777351  4437 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.834661 31571 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:55.784812  4341 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:55.845430 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45702.6us
I20260709 12:23:55.846805 31317 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 9, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.791018  4439 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.850759 31317 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 4 to 13, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.850172 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:55.794727  4440 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.792285  4311 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:55.798305  4289 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:55.853001 31568 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:55.861757 31571 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:55.862197 31568 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:23:55.806582  4284 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:55.865918 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 3065) took 1157 ms. Trace:
I20260709 12:23:55.866407 31569 rpcz_store.cc:276] 0709 12:23:54.710954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.795410 (+ 84456us) service_pool.cc:224] Handling call
0709 12:23:54.795808 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:55.579383 (+783575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:55.579411 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:55.580421 (+  1010us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.645362 (+ 64941us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:55.669757 (+ 24395us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.680258 (+ 10501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.680337 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.721396 (+ 41059us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800395620. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:55.734294 (+ 12898us) spinlock_profiling.cc:243] Waited 982 us on lock 0x7b1800395620. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116676522 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:23:55.865663 (+131369us) raft_consensus.cc:1685] finished
0709 12:23:55.865693 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.865849 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668370,"prepare.queue_time_us":24251,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":681066,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":10535,"spinlock_wait_cycles":12743296,"thread_start_us":197004,"threads_started":2,"wal-append.queue_time_us":106223}
I20260709 12:23:55.839788  4290 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:55.837145  4160 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:55.846933  4385 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:55.869279  3848 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:55.857719 31317 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 2 to 7, term changed from 10 to 14, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to <none>, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:23:55.843693  4141 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:23:55.866962  4289 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:55.883599  4204 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:55.884549  4042 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.905936  4290 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.921550  4290 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.885715  3826 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:55.888505  4093 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.929355  4093 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:55.871286  4241 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:55.930322  4241 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.931155 32106 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 16. Current term is 17. Ops: []
W20260709 12:23:55.906237 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 181720us
I20260709 12:23:55.805500  4316 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.842132  4404 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:23:55.911759 31317 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 10, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.858465  4345 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:23:55.935750 31317 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 14, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:23:55.906534  3848 consensus_queue.cc:1243] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:55.905741  4160 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:55.939797 31317 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 12, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:55.856204  4437 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.930826  4241 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:55.875849  4311 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.870880  4341 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:55.944787 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 181610us
I20260709 12:23:55.943944 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:55.869817  4440 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.950407 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:55.868736  4439 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.954888  4440 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:55.955925  4316 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:55.970196 31567 raft_consensus.cc:1813] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Handling vote request from an unknown peer b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.971101 31567 raft_consensus.cc:2410] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:55.902030  4159 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:55.952061  4354 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:23:55.985047 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124853us
I20260709 12:23:55.985778 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:55.986935 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:55.947199  4310 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:55.996989 32079 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.997766  4093 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:55.998960 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:55.999794  4093 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:56.000262  4093 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:56.001091  4093 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.009151 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.009783 31568 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:56.013810 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.014400 31495 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:56.017112 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.018164 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.018523 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:55.937242  4280 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.020373 31493 pending_rounds.cc:85] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 5
I20260709 12:23:56.022358 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.024387 31424 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:56.019080 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.028074 31495 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:23:56.029690 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.032621 31494 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:23:56.037515 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.039633 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.041049 31493 pending_rounds.cc:107] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:23:56.041491 31493 raft_consensus.cc:2889] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:55.969743  4289 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.044751 31422 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:56.047304 31497 raft_consensus.cc:2368] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:56.049162 31415 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:56.020231  4440 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:56.035131  3826 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:56.042752  4154 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:56.042606  4145 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:56.034379  4345 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:56.064083 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.041749  4385 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:56.065167 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.066490 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.043848 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.070436 32113 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:56.086467 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.088065 31422 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
W20260709 12:23:56.088889 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45147.9us
I20260709 12:23:56.068009  4289 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:56.091382  4448 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:23:56.086647  4345 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.111598  4345 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.068480  4241 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.116525  4241 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.076567  3826 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:56.117693  4341 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:56.099996  4452 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:23:56.118517  3826 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:56.125356 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57952.1us
W20260709 12:23:56.130323 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 180008us
I20260709 12:23:56.093117  4288 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:56.131771 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:56.093952  4145 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:56.135324 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.141199 31415 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:23:56.144366 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:56.144963  4451 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:23:56.145025 31424 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:23:56.140672  4204 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.146198  4204 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.149147  4204 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:56.108836  4439 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.089994  4385 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.133423  4288 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.136647  4316 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.142745  4311 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:56.192253 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 120965us
I20260709 12:23:56.163406  4154 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:56.170580  4175 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:56.188567  4288 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.204615  4311 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:56.186861  4191 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:23:56.207741 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.214794 32107 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:23:56.207947 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.209185 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.176544  4189 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:23:56.192154  4093 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:56.185133  4141 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:56.222981 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.201519  4368 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:56.291268  4461 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:23:56.221715  4310 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.327860  4408 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.328424  4408 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.228286  4406 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:56.330564  4408 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:56.287650  4143 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:56.337760 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:56.250523  4362 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:23:56.347282 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 111999us
W20260709 12:23:56.347188 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 113238us
I20260709 12:23:56.348104 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.348717 31499 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:56.229014  4093 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.228400  4145 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.336660  4289 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.381237 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.350286  4253 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:56.374366  4458 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:23:56.247565  4368 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.378018  4439 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:56.337141  4154 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.388176  4311 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:56.422138  4311 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.422541  4311 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:56.399034  4253 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.340025  4406 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.413343  4385 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:56.427346  4093 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:56.443075  4470 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:23:56.449136  4368 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.428700  4439 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.451543  4439 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.385599  4289 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.408819  4160 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.478942 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.479655 31574 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:23:56.480940 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.481063 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.481761 32106 raft_consensus.cc:2393] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:23:56.482196 31415 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:56.489996  4289 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.492223  4160 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.493235  4437 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.493606  4253 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.495335 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.496007 31415 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:56.496347 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.499012 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.501821 31574 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:56.531941 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.494450  4311 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.552393 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.553203 31418 raft_consensus.cc:2410] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:56.556555 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.559360 31567 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:56.560088 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:56.560765 31573 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16. Re-sending same reply.
I20260709 12:23:56.559266 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.562341 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.557207 31566 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:23:56.562952 31569 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:56.568310 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:56.568923 31568 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:23:56.577404  4288 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:56.581272  4473 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:23:56.586196  4311 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:56.567037  4450 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:23:56.550415  4480 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:56.592350 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:56.592646  4480 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.593076  4480 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.594095  4358 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:56.594511  4358 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.595000  4406 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:56.595407 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.595996 32110 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:56.597486 31495 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:56.594892  4358 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:56.599752 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.602610 31493 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:56.601682 31390 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:56.602931 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.604277 31566 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:56.607249 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.609543 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.610193 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.605386 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.612264 31498 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:23:56.614398 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.617061  4206 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:56.617478  4206 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.617820  4206 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:23:56.611423 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59434.9us
I20260709 12:23:56.623221 31568 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:56.625799 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.630796 31496 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:56.626844 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:56.627811 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.628274 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:56.645304 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:56.647666 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:56.649286 31568 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:56.649777 31568 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:56.650233 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:56.650542 31568 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.651465 31568 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.653260 31573 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:56.656808 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:56.657791 31565 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:23:56.660944 31568 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:56.666393  4314 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:56.667198  4191 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:23:56.667526  4484 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:23:56.667626  4191 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.668211  4191 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:56.667429  4289 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:56.681206 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:56.683776 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.684517 31416 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.689747 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:56.691830 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:56.646718  4467 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:56.704864  4439 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:56.714866 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:56.705411 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.675108  4288 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.711735 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:56.715538 32106 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:56.720786 31565 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.722090 31497 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:23:56.732674  4191 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.737496  4480 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.741811 31565 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:56.742770  4385 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:56.746773 32106 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:56.697299  4437 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:56.749014 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.697482  4341 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:56.752041 31416 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:56.719616  4439 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:56.767220 31565 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:56.769048 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:56.776659  4093 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:56.777068  4093 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:56.777458  4093 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.778292  4480 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.756803  4341 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:56.779431 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:56.764060  4439 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:56.780961 31565 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.764057  4248 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:23:56.773952  4343 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:56.789950 31565 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
W20260709 12:23:56.791039 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 111800us
I20260709 12:23:56.793244 31416 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:23:56.793359 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.793991 31418 raft_consensus.cc:3060] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:56.795662 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.796877 31422 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:23:56.803370 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.804333 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:56.796404 31424 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:56.805156 32106 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15.
I20260709 12:23:56.807987 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.819860 31492 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:23:56.782147  4341 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:56.825276 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:56.830130  4494 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:56.832198  4494 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:56.831446 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 114693us
I20260709 12:23:56.837728 31540 leader_election.cc:400] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:56.838245 31540 leader_election.cc:403] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:56.824301  4343 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:56.825546  4191 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:56.796877  4291 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:23:56.851253 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.851413 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.852047 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.852337 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.853876 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.839490  4090 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:56.854884 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.856580 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.857419 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:56.858024 31416 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:56.856084 31424 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:56.858409 31417 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:56.873869  4439 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:56.875717  4093 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.854423  4325 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:23:56.888779  4206 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.890985  4206 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:56.892258  4488 log.cc:927] Time spent T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:56.893397  4093 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:56.903926  4439 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:56.911922 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 165743us
I20260709 12:23:56.919175 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.882329 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:56.920619 32106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:56.921264 32106 raft_consensus.cc:606] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:56.940049 31387 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15.
I20260709 12:23:56.940413 31387 leader_election.cc:403] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:23:56.916549  4489 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:23:56.860016  4450 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:23:56.944826  4306 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:23:56.883334  4494 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.884461  4090 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:56.956626  4090 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:56.958842 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 116234us
I20260709 12:23:56.948307  4325 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:23:56.957803 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 69609.8us
W20260709 12:23:56.964226 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82027.8us
I20260709 12:23:56.964913 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:56.878121  4343 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:56.959542 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:23:56.971943 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54746.4us
W20260709 12:23:56.972399 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55350.2us
I20260709 12:23:56.975454  4439 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:23:56.976720 31492 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:56.939725  4497 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:56.980868  4502 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:56.981736  4160 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:23:56.985387 31494 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:56.986008 32106 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:56.986276 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.992745 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.993523 31417 raft_consensus.cc:2368] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
I20260709 12:23:56.995402 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.995546 32107 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:56.995653 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:56.996752 31417 raft_consensus.cc:2393] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:57.002655 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.963233  4325 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:56.996865 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:57.015635 32106 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:57.005741 31500 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:57.005865 31568 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:23:56.971784  4192 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:57.012810 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:57.013710 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:56.988982  4495 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:56.972319  4404 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:23:57.040789 31570 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:23:57.052181 31494 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:23:57.045575 31418 raft_consensus.cc:2468] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:57.047564 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:57.063591 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:57.021943  4439 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:57.067378 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 72061.8us
I20260709 12:23:57.065631 31466 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:57.065661 32106 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:57.022663  4192 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.995677  4289 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:23:57.073496 31540 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:57.035748  4406 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:23:57.041322  4495 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:57.022143  4435 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:23:57.093580 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:57.178510 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 137778us
W20260709 12:23:57.184271 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 111724us
I20260709 12:23:57.366551 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:57.183990 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112997us
I20260709 12:23:57.072765  4192 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.087419  4316 raft_consensus.cc:2804] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:57.380708  4316 raft_consensus.cc:697] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:57.381655  4316 consensus_queue.cc:237] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.067623  4499 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:23:57.088299  4457 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:57.098562  4439 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:57.384104  4439 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:57.384637  4439 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:57.386011  4280 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:57.386422  4280 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:57.223093  4508 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:23:57.387223  4280 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.097599  4495 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:57.200659  4494 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:23:57.224398  4501 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 12:23:57.273156  4358 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
I20260709 12:23:57.406805 32080 leader_election.cc:400] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
I20260709 12:23:57.407238 32080 leader_election.cc:403] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:23:57.278241  4341 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.293887  4160 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15.
I20260709 12:23:57.064746  4497 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:57.219069  4435 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:57.387754  4465 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:57.388000  4508 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:57.389178  4466 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.389572  4386 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.092388  4325 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.400475 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:23:57.496582 31418 raft_consensus.cc:606] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:57.496985 31418 raft_consensus.cc:614] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:57.399050  4280 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:57.488701 31421 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:57.452085  4246 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
I20260709 12:23:57.474429  4435 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:57.482038  4508 consensus_queue.cc:1243] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:57.411684  4358 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.496852  4160 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:57.538118  4090 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.504634  4386 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:57.573815 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.496802  4466 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.555202  4160 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:57.607591 31494 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:23:57.573714  4090 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.623747  4341 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:57.694255  4505 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 12:23:57.696063  4515 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:23:57.698448  4513 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:57.717849  4502 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:57.718638  4502 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.721495  4502 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:57.585494  4435 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.751708 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:57.750905  4517 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:23:57.688583  4508 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:57.637981  4160 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.762179  4435 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:23:57.803093 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 216172us
I20260709 12:23:57.785812  4358 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:57.809329 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.776238  4508 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.791138  4192 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:57.810729  4466 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:57.809186  4386 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:57.761715  4503 consensus_queue.cc:1175] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 14 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: [13.8-13.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:57.822839  4527 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:57.823606  4530 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:57.825582  4474 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:57.842743  4474 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.843600  4439 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.845758  4439 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:57.838122  4527 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.849400  4183 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:23:57.849960  4183 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:57.851073  4183 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.852056  4474 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:57.839536  4530 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:57.857134  4183 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:57.853298  4090 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:57.923771  4090 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.926017  4386 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:57.864755  4508 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:57.909358 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88253.4us
I20260709 12:23:57.917812  4192 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:57.850528  4527 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:57.907048 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:57.955958  4530 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:57.983191 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:57.983199 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:57.987922 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:23:57.991891 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.000710  4495 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.006s
W20260709 12:23:58.001667 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 635055us
W20260709 12:23:58.004503 31390 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.925014  4090 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.019207  4441 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:23:58.020905  4498 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:23:58.032186 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 137652us
I20260709 12:23:58.032806  4329 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:58.052202 31572 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:58.053758  4329 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:58.056105  4329 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.058882 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.063237 31421 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.059180  4441 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.068866  4441 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:58.060197 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96475.9us
I20260709 12:23:58.070106  4495 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.082834 31494 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:23:58.092502 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.093501 31570 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:58.105697  4385 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.111043  4341 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:58.113085  4457 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.119170  4457 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.120517  4090 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.121804  4457 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.125192 31569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 3093) took 1126 ms. Trace:
W20260709 12:23:58.126219 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 43556.1us
I20260709 12:23:58.127070  4280 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.127765  4525 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.128116  4280 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.128607  4525 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.132018  4495 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.133960  4406 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.118221 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.135790 31423 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:23:58.138950  4311 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:58.111138 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.120548  4325 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:58.106571  4385 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.134797  4358 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.145728  4385 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.145466  4358 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.134656  4406 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.152343  4406 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.155686 31421 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:58.125633 31569 rpcz_store.cc:276] 0709 12:23:56.998334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.998705 (+   371us) service_pool.cc:224] Handling call
0709 12:23:56.998976 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.999318 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:57.033723 (+ 34405us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.407398 (+373675us) log.cc:844] Serialized 14 byte log entry
0709 12:23:57.998620 (+591222us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b180015af60. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc11975b060 00007fc11976d716 00007fc11977e287 00007fc11977e208
0709 12:23:58.038025 (+ 39405us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.061592 (+ 23567us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.061844 (+   252us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:58.061899 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.062019 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:58.081746 (+ 19727us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180015af60. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc11d63758f 00007fc116676571 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd
0709 12:23:58.124727 (+ 42981us) raft_consensus.cc:1685] finished
0709 12:23:58.124750 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.124973 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668973,"prepare.queue_time_us":36997,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":6237,"raft.queue_time_us":610196,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":62210,"spinlock_wait_cycles":108987648,"thread_start_us":343023,"threads_started":1,"wal-append.queue_time_us":514140}
I20260709 12:23:58.171499 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:58.169281 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64582.5us
I20260709 12:23:58.175163  4341 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:58.176129  4341 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.183023  4508 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.183840  4508 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.186246  4508 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:23:58.191892 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 73693.1us
I20260709 12:23:58.144143 31390 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:58.218598 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.219301 31421 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:58.218142 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.226351 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.228820 31416 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:23:58.229583 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85604.4us
I20260709 12:23:58.230037 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.231549 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.234772  4502 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:58.235586  4502 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:58.236032  4502 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.236351  4502 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.236874  4311 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.237628  4311 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.240291  4311 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.241580  4341 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.208403  4457 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:58.205802  4508 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.215135  4525 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.255507 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.257241 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.262880 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:58.267238 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.269249 31572 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:58.270247  4514 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:58.271121  4254 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:58.271584  4254 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.271945  4254 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:58.275367 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.277069  4192 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:58.277570  4192 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:58.278375 31423 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:23:58.283676  4550 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:23:58.284368  4368 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.284972  4368 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.287850  4329 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:58.288615 32106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:23:58.287931 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.250947  4341 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.290961 31573 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:23:58.291631  4341 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.293154  4368 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.299407  4457 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.303264  4192 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.304244  4508 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.307502 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:58.308813 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:58.309733 31494 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:23:58.310398  4160 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.332600 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.333809 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.336025  4280 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.337210 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.338387  4539 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:23:58.339058  4535 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:58.339571  4535 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.339489  4325 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:23:58.340113  4535 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:58.340884  4311 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.342453 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.342079 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:58.345863 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57526.2us
I20260709 12:23:58.352438 31423 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:23:58.356766  4516 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:58.363481 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:58.364650 32106 raft_consensus.cc:606] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:58.367944  4525 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:58.355659  4311 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.370918  4545 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.360468  4254 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.371573  4545 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.373636  4254 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.376292 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.376725  4288 raft_consensus.cc:993] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:58.377290  4288 raft_consensus.cc:1081] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:58.348193  4441 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.379025  4441 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.381915  3826 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.381736  4502 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.382597  3826 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.354565 31492 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:58.358759  4516 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.388571 31424 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55328 (request call id 3358) took 1337 ms. Trace:
I20260709 12:23:58.388890  3826 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.389076 31424 rpcz_store.cc:276] 0709 12:23:56.995390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.995995 (+   605us) service_pool.cc:224] Handling call
0709 12:23:57.002801 (+  6806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.022342 (+ 19541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.022389 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:58.153486 (+1131097us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b2c00000c88. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2
0709 12:23:58.154077 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:23:58.215558 (+ 61481us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:58.215594 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:58.222285 (+  6691us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:58.317714 (+ 95429us) raft_consensus.cc:1685] finished
0709 12:23:58.317742 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:58.332884 (+ 15142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19144,"raft.queue_time_us":31296,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":23233,"spinlock_wait_cycles":25431424,"thread_start_us":56561,"threads_started":1,"wal-append.queue_time_us":58706}
I20260709 12:23:58.391341  4311 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:23:58.393338  4554 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 12:23:58.406899 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:58.413774 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55098.5us
I20260709 12:23:58.419314  4457 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.389024  4516 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.394413  4502 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.425527 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.433126 31572 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:58.435320  4358 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.435985 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:58.436570 31497 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:58.436770 31566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:23:58.437425 31566 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.437762 31566 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.443190 31424 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:58.445822  4441 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.455004  4439 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:23:58.459290 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 63277us
I20260709 12:23:58.459656  4439 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.462124  4439 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.432605 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.426256  4524 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.444553  4341 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.455981 31566 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.436584  4508 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.495970 31566 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.497488 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.466078  4524 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.498629 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:58.507653 32106 raft_consensus.cc:2368] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:58.513813 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.525193 31572 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:58.523015  4439 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:58.524724 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.532485 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.532895 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.533298 31416 raft_consensus.cc:2368] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13.
I20260709 12:23:58.534261 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.542948 31422 raft_consensus.cc:2368] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:23:58.539218 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.544301 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.545097 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.545341 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.546990 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.539438  4160 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.554620 31418 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:23:58.550194  4160 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:58.555447 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.556640 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:58.569473 32106 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:58.557271  4159 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.550741  4525 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:58.574723  4525 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:23:58.575719  4525 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.576794  4160 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.579010 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:58.583187  4544 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:23:58.583698  4544 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:58.584525  4544 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.585446  4535 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:58.558924  4555 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:58.590739 31540 leader_election.cc:400] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:23:58.591106 31540 leader_election.cc:403] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.591180  4159 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.593673  4159 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.564191 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:23:58.605209 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49159.2us
I20260709 12:23:58.571540 31497 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:23:58.569805 32106 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:58.607455  4539 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:23:58.613065 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.610245 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:58.614884 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.619100 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:58.611328 32106 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.609364  4341 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:58.628104  3826 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.597841  4439 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.643177 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:23:58.633639 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77397.1us
I20260709 12:23:58.643867 32113 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:23:58.646013  3826 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.648214  3826 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.654377 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.651060 31387 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:58.655961 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.659240 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:58.660256 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.661464  4159 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:23:58.661957  4159 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.662390  4159 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:23:58.671521  4535 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.673830  4529 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.674449  4529 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.676379  4191 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.676730  4529 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.677264  4408 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:23:58.677830  4408 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:23:58.678794  4408 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.676909  4191 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.684962  4368 raft_consensus.cc:993] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:58.685348  4191 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.685557  4368 raft_consensus.cc:1081] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:23:58.686291  4093 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:58.686941  4093 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.689056  4093 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.626880  4539 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:58.629199  4502 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:58.635097  4385 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:58.649879  4386 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.706826 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.722534 31537 leader_election.cc:400] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:58.735703  4358 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:58.739493 31537 leader_election.cc:403] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.708086 31421 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:58.739924  4358 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.723627 31573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:23:58.741075 31573 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.741451 31573 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.730180 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.742064 31570 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:58.729347 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:58.724346  4439 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.743570  4439 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:23:58.708058 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:58.722143  4385 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:23:58.708386 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:58.746654  4385 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.722342 31572 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:58.721441  4539 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.739513 31420 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:58.722007  4386 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.720510  4516 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.754987 32114 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:58.712870  4524 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.707300 31568 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:58.706552 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:23:58.765007 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58536.5us
I20260709 12:23:58.764554  4524 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:23:58.795267 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.800817 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.802841 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.802994 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.808835 31571 raft_consensus.cc:1275] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:23:58.812616  4341 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:23:58.819875 31570 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:23:58.821060 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.822010 31570 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:58.821796 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:58.837618 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 186620us
I20260709 12:23:58.814392  4516 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.792024  4514 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:23:58.846396 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.848186 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.793473  4159 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.856518  4545 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:58.859660  4339 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:23:58.872228  4159 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.872989  4159 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.873529  4159 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:58.852844 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.842060  4358 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.883180 31416 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:23:58.887092 31570 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:23:58.889814 31420 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:23:58.890796 31574 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:23:58.854660  4386 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:58.894263 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.894500 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.900357 31497 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:58.900946 31572 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:58.905337 32108 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:58.907289 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.908356 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:58.858286  4385 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.915819 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:58.916319 32114 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:23:58.891906  4525 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.921469 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.919549 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:58.920732 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.923902 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.928323 31418 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:23:58.930256 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:58.931587 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:58.979140 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 48995.9us
I20260709 12:23:58.979550 31416 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
W20260709 12:23:58.980342 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.983340 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:58.983597 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.984593 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.984826 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.985193 31493 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:23:58.984964 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:58.985908  4290 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:23:58.986279 31571 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:23:58.986164 31572 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:58.994475 31574 raft_consensus.cc:1217] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-17.11]   Dedup: 14.9->[15.10-17.11]
I20260709 12:23:58.994988 31574 pending_rounds.cc:85] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 9
I20260709 12:23:58.995266 31574 pending_rounds.cc:107] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:23:58.996310 31574 raft_consensus.cc:2889] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.915331  4386 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:23:58.999122  4386 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:58.999493  4386 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:23:59.000831 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71050.4us
I20260709 12:23:58.982364  4160 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.007531 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.009057 31497 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:23:58.987738  4325 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.016964 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.010870 31573 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.020493 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:23:59.023512  4206 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.024071  4206 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.026141  4206 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.027536 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:59.030627  4552 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.067s	user 0.010s	sys 0.008s
I20260709 12:23:59.031550  4435 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:59.033723  4386 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:58.927809  4525 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.042421  4525 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.044309  4385 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:58.994240  4192 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.049499 32113 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:58.994699  4514 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.047446 32108 raft_consensus.cc:2393] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:23:59.049276  4192 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.046970 31493 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:23:59.048156 31572 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:59.071259 31573 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:59.070734 31568 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:23:59.026639  4206 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:23:59.075789 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72844.1us
I20260709 12:23:59.104135 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:58.811986 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.109208 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:59.075882  4206 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:59.113056 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.063884  4514 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.144449  4514 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.117578  4573 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:23:59.057107  4385 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:23:59.068667  4290 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.068893  4160 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:23:59.147958  4570 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:59.149227  4280 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.149528 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.120602  4206 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:59.115645 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:59.116053 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:23:59.156517 32108 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:59.134341 31500 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:59.157011 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.142120 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.141350 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.158047 31573 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:23:59.156819 32108 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:59.149773  4576 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:59.149791  4280 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.164700 32108 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.165901 32108 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:59.167172 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.168156 31416 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:59.168259  4191 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:23:59.168920  4191 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:59.169483  4191 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:23:59.171252 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.171789 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.171998 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.172825 31419 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:23:59.172986 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.173853 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.174427 31420 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:23:59.168155 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.169415 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.181752 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:59.186239 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.189328 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.198779  4576 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.215260 31500 raft_consensus.cc:2410] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:23:59.187376 31566 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:59.215595 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.186313 31390 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.181072 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.220521 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.160459  4535 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:23:59.222229 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 113096us
I20260709 12:23:59.226231 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.228878 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.226666 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.234010  4154 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:59.234442  4154 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.234820  4154 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.236743  4386 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:59.239871  4525 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:59.240325  4525 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:59.240691  4525 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:59.217519  4576 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.246326 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:23:59.224865  4329 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.257733 31420 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:23:59.258239 31573 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:59.261963 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:59.262849  4368 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:59.264590 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.265342 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:59.265923 31418 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:59.261780 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:59.267032 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 86044.7us
W20260709 12:23:59.303468 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.274063 31566 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:59.274580 31421 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: []
W20260709 12:23:59.316545 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.320677 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:23:59.322032 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54430.9us
I20260709 12:23:59.265650  4339 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:59.344719 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.266700  4280 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:59.289870  4159 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.277210  4191 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.360828 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:59.290956  4512 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:23:59.266009  4329 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.375627 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.375833 31540 leader_election.cc:400] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13.
I20260709 12:23:59.376376 31540 leader_election.cc:403] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:23:59.375917 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.378592 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.369649  4159 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:59.363602  4339 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:59.386003 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.386962 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.391330 31495 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:23:59.391685 31495 pending_rounds.cc:85] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 10
I20260709 12:23:59.394956 31495 pending_rounds.cc:107] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:23:59.395195 31495 raft_consensus.cc:2889] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.395401  4191 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.356428  4580 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:23:59.403610 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.408654 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.410375 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.411077 31495 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
W20260709 12:23:59.414132  4572 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:23:59.416332  4569 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:23:59.418128  4509 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:23:59.428272 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46918.6us
I20260709 12:23:59.432032 32108 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:59.436324 31418 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:23:59.436962 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84632.6us
I20260709 12:23:59.443475 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.444120 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:59.444471 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.443892 31537 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:23:59.448338 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.449931 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.451571 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.432948  4408 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:59.431082  4512 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:59.457931 31495 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:59.453644 31494 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:59.447911  4385 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13.
I20260709 12:23:59.460460 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:23:59.461156 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:23:59.464769 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.404829  4579 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:23:59.455089  4159 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:23:59.432991  4538 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:23:59.466243  4512 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.476987 31421 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:59.460515  4582 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:23:59.487694  4582 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.488106  4582 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.493232  4339 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.476223  4159 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:23:59.496140  4159 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:23:59.501514  4579 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:59.501982  4579 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:59.469661 32106 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:59.457037  4154 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.451361  4509 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:59.455927  4545 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:59.483085  4492 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.486115  4329 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.486807  4160 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.463405  4206 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.519922 31416 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:23:59.521225  4206 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.522188  4154 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.523284 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.523581 31422 raft_consensus.cc:2368] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18.
I20260709 12:23:59.523643 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.528467 31498 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:59.530954  4545 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:23:59.531289 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 155661us
I20260709 12:23:59.531921  4545 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:59.533071  4566 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.417s	user 0.004s	sys 0.000s
I20260709 12:23:59.532649 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.535961 31540 leader_election.cc:400] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:23:59.537178  4525 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.538041 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.538282 31500 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:59.538872  4385 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.539562  4385 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:59.540362  4311 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:23:59.545013 31493 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
W20260709 12:23:59.557008  4577 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:23:59.560254 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:23:59.563357 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:23:59.564188 31418 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:23:59.565209  4192 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:23:59.577494 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:23:59.583712  4386 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:59.584195  4386 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.584578  4386 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:59.590246  4368 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:59.590818  4368 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:23:59.591861  4368 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:59.602592 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 164707us
I20260709 12:23:59.605381 31572 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:23:59.614562 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.526172  4576 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:23:59.622152 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82913.4us
I20260709 12:23:59.623530 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.637203 32106 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:59.641798 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55788 (request call id 1086) took 1111 ms. Trace:
I20260709 12:23:59.503012 31319 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 7 to 2, term changed from 14 to 10, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from VOTER to NON_VOTER. New cstate: current_term: 10 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.643101 32106 rpcz_store.cc:276] 0709 12:23:58.526125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.542345 (+ 16220us) service_pool.cc:224] Handling call
0709 12:23:58.743837 (+201492us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b180016f200. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11979e646 00007fc1196d858e 00007fc119759f9e 00007fc11975b7de 00007fc11976727c 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c
0709 12:23:59.469018 (+725181us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b580057ecd0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196bf0aa 00007fc119741447 00007fc119759fe7 00007fc11975b7de 00007fc11976727c 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c
0709 12:23:59.637814 (+168796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029331584}
I20260709 12:23:59.649132 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:23:59.654394 31495 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:23:59.660084 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:23:59.641444  4592 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:59.639478  4254 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:23:59.673036  4535 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:59.727387  4576 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:23:59.730100  4592 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:59.683707 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 105607us
I20260709 12:23:59.730628  4592 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:23:59.731638  4592 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.732177 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.680650  4524 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:59.663709  4385 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:23:59.722868 31495 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:23:59.723568 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.744055  4524 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:23:59.744664  4524 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:59.745823 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:23:59.744994 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84999.9us
W20260709 12:23:59.807750 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 132570us
W20260709 12:23:59.810746 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 78642.1us
I20260709 12:23:59.811568 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.774829  4580 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:59.745409  4159 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.847623  4159 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.819700  4358 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:23:59.872406  4594 log.cc:927] Time spent T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:59.807245  4509 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:23:59.895828 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.909085  4582 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.910475 31496 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:23:59.912470  4582 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:23:59.940557 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 191596us
I20260709 12:23:59.943403 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.945498 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:59.946496 31568 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:23:59.954353 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.954449 31572 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:59.954571 31415 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:23:59.955437 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.956260 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:23:59.957403 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.940511  4579 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:23:59.960250  4579 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:59.960109  4386 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:23:59.962311  4386 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.963382 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:23:59.966264 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:23:59.967211 31495 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:59.966418 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:23:59.978109 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.984845 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:23:59.985751 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 177246us
I20260709 12:23:59.982183 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:23:59.975183  4508 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:59.983019 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:23:59.993777 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.994282 31572 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:23:59.974433  4509 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:23:59.988883 31569 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:23:59.998558 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:59.998723 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:23:59.998652 31570 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:00.000196 31570 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:00.001221 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.003283 31570 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.004338 31570 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.005959 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.007385  4311 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.007988 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:00.008522 31569 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.021226 31571 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:00.028195  4524 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.028893 31570 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:24:00.029399 31570 pending_rounds.cc:85] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 10
I20260709 12:24:00.029668 31570 pending_rounds.cc:107] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:24:00.029966 31570 raft_consensus.cc:2889] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.031510 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:00.033394 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 985) took 1129 ms. Trace:
I20260709 12:24:00.033769 31423 rpcz_store.cc:276] 0709 12:23:58.904382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.904533 (+   151us) service_pool.cc:224] Handling call
0709 12:23:58.917174 (+ 12641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:58.994250 (+ 77076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:58.994294 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.015605 (+ 21311us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.209403 (+193798us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:23:59.344337 (+134934us) log.cc:844] Serialized 14 byte log entry
0709 12:23:59.352031 (+  7694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.352100 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:00.032622 (+680522us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b24001817d8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc1164fc9c4 00007fc1164faacb 00007fc1166b5dc9 00007fc1166b5a55 00007fc1166b4fb0 00007fc11932b488 00007fc11932bbe8 00007fc119303398 00007fc1192fe76a 00007fc1192fdbb6
0709 12:24:00.033093 (+   471us) raft_consensus.cc:1685] finished
0709 12:24:00.033223 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.033339 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65770,"prepare.queue_time_us":54478,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"raft.queue_time_us":65664,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":11129,"spinlock_wait_cycles":26129152,"thread_start_us":216860,"threads_started":2,"wal-append.queue_time_us":256128}
I20260709 12:24:00.039184 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.030448  4524 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:23:59.993746  4508 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.041412 32114 raft_consensus.cc:2368] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
W20260709 12:24:00.040537 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 229031us
I20260709 12:24:00.042829 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:00.046384 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.047979 31495 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.043972  4508 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.057202 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:00.046869  4530 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:00.061012 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76288.8us
I20260709 12:24:00.061219 31423 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.062943 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.064445 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.067236 31463 leader_election.cc:400] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
I20260709 12:24:00.067565 31463 leader_election.cc:403] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.068918 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.071480 32111 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
W20260709 12:24:00.074754 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.077368  4593 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:00.080632 31572 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:00.084249 32108 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:00.075803  4290 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.088285 31423 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:00.090070 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:00.091835 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:00.092707  4604 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:00.093286  4604 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:00.095073  4280 raft_consensus.cc:2764] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:24:00.052917  4358 consensus_queue.cc:1048] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:24:00.098853  4512 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.094143  4604 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.068552  4592 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:00.107095 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.132848  4508 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.135617  4508 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.136691  4368 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.139168  4617 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.143743 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.107971 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.114562  4618 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:00.123037  4599 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:00.148029 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.154748  4535 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.155375  4535 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.157464  4535 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.158172  4593 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
I20260709 12:24:00.161049 31569 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.164085 31422 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:24:00.164471 31422 pending_rounds.cc:85] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Aborting all ops after (but not including) 10
I20260709 12:24:00.163219 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:00.164740 31422 pending_rounds.cc:107] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:24:00.165091 31422 raft_consensus.cc:2889] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:00.167701 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:00.168321 31494 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.147909  4592 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:00.173622 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:00.159255  4599 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:00.163093  4311 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.178318 31466 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.187855 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:00.188652 31492 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:00.169945  4618 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:24:00.196388  4290 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:00.183583  4596 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:00.199070  4611 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.200816  4581 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.201373  4581 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.203219  4143 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:24:00.206895 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 1084) took 1159 ms. Trace:
I20260709 12:24:00.211069 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:00.215162  4509 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:00.215721  4509 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:00.216601  4509 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.218108  4599 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.219535  4599 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:00.229929  4280 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:00.241459  4154 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.242133  4154 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.244086  4406 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.244766  4406 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:00.249428 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44542.4us
I20260709 12:24:00.266753  4581 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.270913  4525 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.272399  4406 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.207456 32112 rpcz_store.cc:276] 0709 12:23:59.047354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:59.047504 (+   150us) service_pool.cc:224] Handling call
0709 12:23:59.054654 (+  7150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:59.277074 (+222420us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b1800446740. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc11975b060 00007fc11975bbfb 00007fc11976664b
0709 12:23:59.277213 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:59.277242 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:59.277740 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:23:59.407506 (+129766us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:59.407567 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.407875 (+   308us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:59.570901 (+163026us) raft_consensus.cc:1685] finished
0709 12:23:59.570928 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:00.206617 (+635689us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5400085050. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197628ad 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:00.206786 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32035,"raft.queue_time_us":34495,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":23137,"spinlock_wait_cycles":93354752,"thread_start_us":160095,"threads_started":2,"wal-append.queue_time_us":199249}
I20260709 12:24:00.275766  4502 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.276401  4502 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.280627 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.289937 31497 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:00.293298 31494 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.319718 31390 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:00.327260 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.327351 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.328186 31500 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:00.327525  4605 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.329002  4605 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.331297  4605 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:00.334455 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 184917us
I20260709 12:24:00.338497 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.317978  4581 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.342875 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:00.344009 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.344830 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.347497 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:00.349463 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 190569us
I20260709 12:24:00.343559  4406 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:00.343576  4605 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:00.362752 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.347946  4617 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.351267  4545 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.351365  4502 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.355342  4509 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.396252  4246 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:00.397076  4246 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.365693  4154 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.400177 31492 raft_consensus.cc:2468] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:00.373410  4602 raft_consensus.cc:2764] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:24:00.351490  4581 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:00.475093 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 119547us
W20260709 12:24:00.479418 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 127963us
I20260709 12:24:00.480696 31540 leader_election.cc:400] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18.
I20260709 12:24:00.481609 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:00.484899 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.490171 31465 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.460858  4605 consensus_queue.cc:1059] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:24:00.474718  4581 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.494518  4358 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.400454  4545 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:24:00.500555  4545 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:00.501014  4545 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:00.492604  4280 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:24:00.461544  4509 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.505954  4509 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.501976  4545 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.483378  4582 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:00.477403  4602 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.389742  4592 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:24:00.527415  4246 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.495261  4607 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:24:00.392271  4617 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:24:00.527052  4602 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.539018  4406 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:00.542474  4592 raft_consensus.cc:3055] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:00.558897 32080 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:00.568684 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.573580 31492 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:00.574939 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.557967  4592 raft_consensus.cc:740] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:00.564744  4604 raft_consensus.cc:2804] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:00.589195 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.589849 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.590384 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:00.591500 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:00.592034 31573 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.593175 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.593600 31571 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:24:00.600628 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.601678  4592 consensus_queue.cc:260] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.606949 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:00.607705 31566 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 18: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:00.609193 31465 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.579571  4617 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.618162 31572 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:00.621410 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.648823  4159 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.623369  4525 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.649477  4159 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.654837 31573 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.655886  4602 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:00.656322 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 171513us
W20260709 12:24:00.656016 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 179458us
I20260709 12:24:00.608723  4604 raft_consensus.cc:697] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:00.674921 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.677155 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.567616  4406 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.691025 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:00.691833 31419 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 19: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:00.690258 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:00.695837 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74359.1us
I20260709 12:24:00.704979 31415 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:00.699501 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:00.625443  4617 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.713661  4617 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:00.717133 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.719055  4154 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:00.719928  4154 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:24:00.722520  4599 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 12:24:00.727510 31565 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:00.728539 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:00.729326 31424 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 18: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:00.731842  4143 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:00.679895  4527 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:00.683202  4408 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.746109 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.760471 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:00.769011 31466 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:00.777102 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.782220 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.785120 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:00.782903 32114 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.788359 31415 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:00.795135 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:00.759205  4640 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.799037 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:00.799909 31574 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:00.775187  4358 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:00.795871 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:00.784297  4154 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:00.807180 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.787734  4635 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:00.812705  4406 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:00.834717  4154 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:00.816488 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:00.831143 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.814581  4636 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:00.836194  4636 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:00.835821  4154 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.836601  4636 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.838934  4640 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.841367  4159 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.842018  4159 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:00.842338 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:00.772617  4386 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:24:00.852445 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.854477  4611 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:00.854928 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.851212  4636 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.858160 31500 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:00.860004  4617 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:00.864657  4636 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:00.865801 31390 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.866535  4636 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:00.867451 31492 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:00.867946  4605 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:00.868446  4605 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:00.869711  4605 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:00.827504  4604 consensus_queue.cc:237] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:00.890756 31496 raft_consensus.cc:1240] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:24:00.872220 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:00.872584 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 58464.1us
I20260709 12:24:00.893594 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:00.877398  4329 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:00.896898 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:00.828569  4635 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:00.897749 31499 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:00.897927  4635 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:00.879817  4592 raft_consensus.cc:3060] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:00.888042 31491 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:00.904819 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.906076 31415 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:00.889809  4640 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:00.906919 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.890597 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.881049 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:00.890069 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:00.910058 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:00.902233 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 126673us
I20260709 12:24:00.915488 31499 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:00.803653  4545 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:00.923077 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.926491 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:00.916219  4329 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.902885  4597 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:00.929015 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:00.918651  4602 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:00.954896 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:00.935019  4492 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:00.931613  4618 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:00.975733  4280 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:00.979583  4254 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:00.952037  4358 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:00.950037  4597 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:00.957417  4605 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:00.930541  4617 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:24:01.000819 32112 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:00.960000  4589 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:24:01.012172  4589 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:01.012645  4589 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:01.013232  4597 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:01.013401  4589 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:01.014886  4589 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:01.020267 32111 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:01.029166  4625 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:01.033366 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:01.038422  4640 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:01.087347  4596 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.087915  4596 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:01.065845  4640 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:24:01.123397 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 341506us
I20260709 12:24:01.056218  4601 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:24:01.181479  4640 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:01.234654 31571 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:01.247364  4631 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:24:01.257682  4596 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:01.262967 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:01.263688 31574 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:01.265020 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:01.265821  4514 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:01.266191  4514 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:01.266546  4514 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.274493  4514 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:01.276573  4514 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:01.209486  4635 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:01.423028 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 209090us
I20260709 12:24:01.476131 31423 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:01.476256 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 51783.4us
I20260709 12:24:01.534657 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:01.535368 31573 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:01.551292  4597 consensus_meta.cc:287] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.004s
I20260709 12:24:01.546983  4653 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.573241 31573 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
W20260709 12:24:01.558466 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 319538us
I20260709 12:24:01.582237 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:01.591385 31568 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:01.564531  4597 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:01.609766 31574 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:01.600349  4579 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:01.580710  4653 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:01.644626  4663 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:24:01.645449  4662 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:24:01.694933 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48317.6us
I20260709 12:24:01.632166  4539 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 12:24:01.718927  4669 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:24:01.728729 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:01.729410 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:24:01.734592 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:01.735131 31499 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:01.742362 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:01.653394  4579 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:24:01.785342 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 135214us
I20260709 12:24:01.787452 31491 raft_consensus.cc:1275] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:01.703864  4635 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:01.852756 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:01.849552  4596 consensus_queue.cc:1048] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:24:01.880383 31573 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:01.881824 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:01.825112  4579 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:01.885037 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:01.888839 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:01.890496 31493 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:01.905040 32112 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:01.882653  4653 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:01.892465 31491 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:01.893821 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:01.853253  4597 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:01.908274 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:01.908466 31423 raft_consensus.cc:2393] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 19: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:01.926200  4514 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:01.943773  4602 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.943508  4653 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:02.015982 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75601.2us
I20260709 12:24:01.959084  4502 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 12:24:02.013738  4660 log.cc:927] Time spent T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:01.992435  4514 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:01.970501  4673 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:24:02.029119 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 73805.2us
I20260709 12:24:01.988332  4602 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:01.994658  4653 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.032326 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:02.060945  4690 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.061582  4690 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.064064  4690 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.079110 31389 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.079471  4514 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.084362  4602 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.084856  4692 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:02.086191 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.087074 31491 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:02.087427  4618 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:02.087949  4618 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.092854 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:02.094185 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.095047 31574 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:02.040877  4599 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:02.101639 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:02.107621  4686 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:02.121613  4686 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.110515  4690 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:02.110047  4694 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:02.129954  4618 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.133714  4653 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.127658  4690 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.135982  4690 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:02.128576  4694 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.139690  4694 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:02.152932  4671 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:02.153183 31500 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:02.153450  4671 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:02.155777  4329 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:02.156847  4509 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:02.160636  4686 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.109678  4599 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.163184  4599 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.163727 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.154428  4671 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.170663  4671 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:02.179199 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.188107 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.196231 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.196962 32114 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:02.198062 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:02.194515 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.203866 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.213066 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.217355 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.214023 31422 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:02.219540 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.215946  4653 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:02.215762  4686 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:02.299224 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82028.2us
I20260709 12:24:02.217801  4508 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
W20260709 12:24:02.319612 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 103996us
I20260709 12:24:02.308965  4653 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.137041 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.320634  4592 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:02.342975  4592 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.345088  4592 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.345321  4699 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:24:02.322268  4686 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.348444  4694 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.349501  4686 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.352726 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.297485  4618 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:02.355841 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:02.355756 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.358825 31500 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:02.361937 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:02.362757 31420 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:02.350490  4694 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.371182 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.372342 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.369247 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.352603  4653 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.342478  4690 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.384651  4690 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.371307  4671 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:02.387187 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.363478 31537 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.397182 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:02.402428  4690 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:02.402999  4690 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.405002  4690 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:02.386011  4671 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.427297 31420 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:02.397447  4686 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:02.434478 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.438933  4581 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.440203  4358 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:02.451290  4358 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.453369  4358 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:02.454149 31500 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:02.399725  4618 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.454901  4581 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:02.468940 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 104955us
I20260709 12:24:02.469188  4581 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:02.471460  4582 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.471971  4582 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.473366  4691 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.474102  4582 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:02.475783  4671 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.473860  4691 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.486518  4691 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.489964 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.491446 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:02.501670  4618 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.509387 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.511175 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.513500 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.515661 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:02.516296 31567 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:02.561147 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.561882 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:02.570185 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.571107 31492 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:02.574328 31496 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:02.576923  4512 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:02.572755 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.590709 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:02.592370 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.594502 31567 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:02.597270 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.605358 31570 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:02.601851  4582 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:02.592139  4618 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:02.594753  4159 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:02.598444  4686 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:02.609671  4686 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:02.610544  4686 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.606554 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.607739  4691 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:02.618733 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.622922 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.616183  4694 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:02.623495 31492 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:02.633735 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.615931  4159 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.639053 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.638306 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:02.639626 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.644981 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.643941 31415 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:02.652653 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.652906 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.654834 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.655591 31419 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:02.630878  4605 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:02.662395 31540 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.688077 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.670648  4694 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:02.663115  4599 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:02.672811  4692 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:02.715461  4599 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.717744  4599 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:02.718881 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:02.719897 31415 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:02.691864  4653 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.691597  4618 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:02.733374 31493 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:24:02.699849  4690 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:02.734416  4690 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:02.735534  4690 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.745119 31567 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:02.703310  4694 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.758288  4694 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.711942  4692 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:02.763926  4692 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:02.772182  4653 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:02.773677 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:02.774328 32110 raft_consensus.cc:606] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:02.774531  4254 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:02.775650  4254 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:02.777077 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:02.778718  4254 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:02.779220  4254 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:02.780251  4254 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:02.794552  4254 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:02.807444 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:02.807238  4508 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:02.808702 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:02.809298 32110 raft_consensus.cc:606] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:02.808650  4508 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:02.810478  4508 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:02.813326  4508 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:02.814205 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44461.5us
I20260709 12:24:02.815608 31317 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 277) took 10770 ms. Trace:
I20260709 12:24:02.822883 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:02.823504 32110 raft_consensus.cc:606] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:02.824853 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:02.833662 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:02.784962  4159 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:02.837574 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:02.837909  4694 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.838439  4159 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:02.815618  4508 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.842202  4692 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:02.816041 31317 rpcz_store.cc:276] 0709 12:23:52.049235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.060152 (+ 10917us) service_pool.cc:224] Handling call
0709 12:23:53.000617 (+940465us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:02.815420 (+9814803us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:56.293357 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:56.293901 (+   544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:56.293934 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:23:56.293950 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:56.469355 (+175405us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:56.469430 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:56.469463 (+    33us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:23:56.596965 (+127502us) tablet.cc:701] Row locks acquired
0709 12:23:56.596984 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:56.597139 (+   155us) write_op.cc:270] Start()
0709 12:23:56.597244 (+   105us) write_op.cc:276] Timestamp: P: 1783599836597078 usec, L: 0
0709 12:23:56.597266 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:56.625435 (+ 28169us) log.cc:844] Serialized 9232 byte log entry
0709 12:23:57.088933 (+463498us) op_driver.cc:464] REPLICATION: finished
0709 12:23:57.382246 (+293313us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b180044bcc0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11930b4bc 00007fc11665948b 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116673455 00007fc1196e0190 00007fc1196d9ae7 00007fc1196d8dd9
0709 12:23:57.384182 (+  1936us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc11d199ef0
0709 12:23:57.622512 (+238330us) write_op.cc:301] APPLY: starting
0709 12:23:57.629211 (+  6699us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:57.864503 (+235292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:57.864538 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:58.259817 (+395279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:58.260366 (+   549us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 12:23:58.260462 (+    96us) write_op.cc:312] APPLY: finished
0709 12:23:58.261248 (+   786us) log.cc:844] Serialized 204 byte log entry
0709 12:23:58.261493 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.262122 (+   629us) write_op.cc:454] Released schema lock
0709 12:23:58.262206 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:58.347441 (+ 85235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:58.348152 (+   711us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":153508,"reported_tablets":49,"spinlock_wait_cycles":108067072,"child_traces":[["op",{"apply.queue_time_us":528563,"apply.run_cpu_time_us":39894,"apply.run_wall_time_us":697516,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100405,"num_ops":23,"prepare.queue_time_us":200188,"prepare.run_cpu_time_us":24219,"prepare.run_wall_time_us":426188,"raft.queue_time_us":117584,"raft.run_cpu_time_us":18009,"raft.run_wall_time_us":487361,"replication_time_us":469279,"spinlock_wait_cycles":58059136,"thread_start_us":632715,"threads_started":4,"wal-append.queue_time_us":148220,"wal-append.run_cpu_time_us":17197,"wal-append.run_wall_time_us":2485956}]]}
I20260709 12:24:02.860594 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:02.865747 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 195935us
I20260709 12:24:02.920893 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:02.925624 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:02.927495  4711 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:02.964128 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:02.932519  4653 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:02.968513 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:02.969441 31419 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.980414 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:02.981817 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 347113us
I20260709 12:24:02.986496 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:02.963408  4711 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.996176 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:02.996912 31492 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:02.967368  4694 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:03.007328 31417 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:02.997455  4711 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:03.055619 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52763.1us
I20260709 12:24:03.076294 31492 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:03.054601  4717 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:03.075325  4709 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:24:03.090978 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 86505.5us
I20260709 12:24:03.091439 31421 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:24:03.093266 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 88677us
I20260709 12:24:03.094447 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:03.100885  4580 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:03.114540  4143 raft_consensus.cc:993] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:03.119604 31420 raft_consensus.cc:2410] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:24:03.131172 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54742.9us
I20260709 12:24:03.139382  4575 raft_consensus.cc:1081] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:03.163097 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:03.165524 31567 raft_consensus.cc:2368] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:24:03.157876  4692 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:03.228646 31389 leader_election.cc:400] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:24:03.231017 31389 leader_election.cc:403] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:24:03.240351 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.249122 31423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:50108
I20260709 12:24:03.249725 31423 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.250237 31423 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:03.256862  4727 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:24:03.262522 31419 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:03.264748  4690 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
W20260709 12:24:03.283953  4723 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
I20260709 12:24:03.300120 31570 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:24:03.304226  4692 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:02.936586 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.282403  4711 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.310329 31494 raft_consensus.cc:2368] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18.
I20260709 12:24:03.315786 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:03.270377 31423 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.325577 31491 raft_consensus.cc:2368] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:24:03.326545 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:03.327502 31574 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.330435 31423 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:03.356125  4724 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:24:03.360687 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:03.361512 31423 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:03.361992 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:03.362563 31567 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:03.360100  4711 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:03.374059 31390 leader_election.cc:400] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:24:03.378962 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:03.379928  4671 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:03.382891 32110 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:24:03.383271 32110 pending_rounds.cc:85] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 15
I20260709 12:24:03.383476 32110 pending_rounds.cc:107] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:24:03.383688 32110 raft_consensus.cc:2889] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:03.386341 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:03.387048 32108 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:03.387328 32108 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:03.388101 32108 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.388957 32108 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.396258 31567 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:03.398132 31574 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:03.401856 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:03.402576 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:03.434499 31423 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:03.425798 32108 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:03.405977  4686 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:24:03.437242 31569 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 10. Current term is 11. Ops: []
W20260709 12:24:03.447098 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44599.6us
I20260709 12:24:03.449697 31540 leader_election.cc:400] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18.
I20260709 12:24:03.450001 31540 leader_election.cc:403] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.458756 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:03.446736  4671 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:24:03.468163 31319 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 300) took 45930 ms (client timeout 15000 ms). Trace:
I20260709 12:24:03.469061  4539 raft_consensus.cc:993] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
W20260709 12:24:03.468607 31319 rpcz_store.cc:269] 0709 12:23:17.538035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.538279 (+   244us) service_pool.cc:224] Handling call
0709 12:24:03.468048 (+45929769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:01.646363 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:01.875349 (+228986us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:01.875404 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:24:01.875438 (+    34us) tablet.cc:662] Decoding operations
0709 12:24:01.875860 (+   422us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:01.875944 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:01.875972 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:01.876225 (+   253us) tablet.cc:701] Row locks acquired
0709 12:24:01.876276 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:24:01.876441 (+   165us) write_op.cc:270] Start()
0709 12:24:01.876576 (+   135us) write_op.cc:276] Timestamp: P: 1783599841876376 usec, L: 0
0709 12:24:01.876597 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:01.877611 (+  1014us) log.cc:844] Serialized 603 byte log entry
0709 12:24:02.318923 (+441312us) op_driver.cc:464] REPLICATION: finished
0709 12:24:02.446478 (+127555us) write_op.cc:301] APPLY: starting
0709 12:24:02.446566 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:02.447690 (+  1124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:02.447795 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:02.448446 (+   651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:02.448616 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:02.448662 (+    46us) write_op.cc:312] APPLY: finished
0709 12:24:02.448839 (+   177us) log.cc:844] Serialized 25 byte log entry
0709 12:24:02.449003 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:02.449086 (+    83us) write_op.cc:454] Released schema lock
0709 12:24:02.449122 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:02.449527 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:02.449560 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2235614,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":127292,"apply.run_cpu_time_us":3026,"apply.run_wall_time_us":3027,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":343091,"prepare.run_cpu_time_us":30029,"prepare.run_wall_time_us":372034,"raft.queue_time_us":265204,"raft.run_cpu_time_us":54376,"raft.run_wall_time_us":89171,"replication_time_us":442087,"thread_start_us":713704,"threads_started":4,"wal-append.queue_time_us":173573,"wal-append.run_cpu_time_us":116264,"wal-append.run_wall_time_us":1400131}]]}
I20260709 12:24:03.472972  4492 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:03.473542  4492 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:03.459491  4605 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:03.474452  4492 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.475032  4605 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:03.475900  4605 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.469700  4539 raft_consensus.cc:1081] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:03.461119  4694 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18.
I20260709 12:24:03.457810  4695 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:24:03.504228 31571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:03.512291 31571 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.512650 31571 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:03.500829  4671 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:03.525373 31497 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:24:03.526218  4684 raft_consensus.cc:993] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:03.526787  4684 raft_consensus.cc:1081] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:03.535236 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:03.535821 31570 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.536201 31570 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:03.552942  4607 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.470014 31316 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 2 to 7, term changed from 10 to 14, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to <none>, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:03.607151 31570 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.619589 31570 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:03.619915 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:03.583814  4385 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:24:03.633337 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:03.633980 31491 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:03.642589 31491 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:03.643939 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:03.644763  4686 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:03.645265  4686 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:03.646167  4686 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.587072  4607 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.672472 32108 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:03.677069 32108 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:03.678176 32108 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.682802 32108 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:03.688920 32108 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:03.589421  4671 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.664855  4653 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.709592 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:03.711354 31571 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.620992 31316 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 13, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.713032 31574 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:03.698529  4607 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:03.758952  4591 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:03.760022  4591 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:03.760363  4591 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:03.760896 31571 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:03.761169  4591 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.762415  4591 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:03.765127 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:03.767798  4565 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.774781 31418 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:03.774986  4565 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.777385  4565 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:03.781201 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:03.783025 31418 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
W20260709 12:24:03.808229  4728 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:03.808883 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:03.712879  4653 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.820513  4653 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:03.821162  4618 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:03.821718  4618 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:03.823078  4618 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:03.826792 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:03.827745 31418 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:03.829169 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:03.829982  4653 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:03.830350  4653 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.830717  4653 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:03.831941 31316 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 8 to 11, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 11 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:03.839278 31316 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:03.833318 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49452.9us
I20260709 12:24:03.852135 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:03.859620 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:03.867645 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:03.887434 31465 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:03.896785  4582 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:03.914031 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:03.957031 31316 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 11, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 11 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:03.960666 31316 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:03.966944 32114 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:03.928875  4653 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:03.970032 31497 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:03.978734 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:03.981236 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:03.981858 31420 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:03.983685 31567 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:03.986819 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:04.012560 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:04.014449 31420 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:03.992359  4653 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:04.016767 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:04.008137  4605 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:04.027591  4605 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:04.029662  4605 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:04.018226  4699 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:24:04.017104  4159 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:04.058977 31316 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 13, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.065845 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:04.066375 31422 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.043855  4582 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:04.071332 31491 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.072448 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:04.074601 31420 raft_consensus.cc:2368] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:04.076514  4582 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:04.077410  4582 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:04.088975 31540 leader_election.cc:400] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:04.089331 31540 leader_election.cc:403] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:04.102169  4686 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:04.099702  4605 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:24:04.107347 32114 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:04.130175 32114 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:04.154567  4694 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:04.174782  4686 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:04.176708 31316 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 9 to 11, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.120500  4618 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:24:04.260600  4737 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:24:04.263477  4606 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:04.318902  4606 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:04.356910  4606 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:04.365973 31418 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:04.367755 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:04.368376 31418 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:04.370693 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:04.371672 31497 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:04.376499 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:04.379789  4671 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:04.392750  4684 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:04.393440  4684 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:04.393929  4684 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:04.412132 31497 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:24:04.414752 31568 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:04.431787  4618 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:04.433633  4716 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:04.476424 32114 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.479743 31418 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:04.523823 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.494061  4719 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:24:04.542786  4684 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:04.543057  4694 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:04.601564 31418 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:24:04.606858 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 105736us
I20260709 12:24:04.617892 31565 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:04.612120  4673 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:24:04.646646  4673 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:04.696085  4684 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:04.709257 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:04.714143 31497 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:04.715143 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:04.737133 31417 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:04.747584 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:04.788159  4684 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:04.788765  4684 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:04.789726  4684 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:04.843161 32108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:04.843721 32108 raft_consensus.cc:606] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:04.844066 32108 raft_consensus.cc:614] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:04.880880 32108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:04.881505 32108 raft_consensus.cc:606] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:04.881820 32108 raft_consensus.cc:614] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:04.900621 32108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:04.901309 32108 raft_consensus.cc:606] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:04.910341  4772 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:24:04.914827  4774 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 12:24:04.926378 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:04.928333 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:04.929004 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.078579 31319 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.080325 31319 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 20, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 20 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.083081 31319 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 13, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
W20260709 12:24:05.082191 31316 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 190) took 15911 ms (client timeout 15000 ms). Trace:
I20260709 12:24:05.101619  4591 raft_consensus.cc:993] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:05.107192  4354 raft_consensus.cc:1081] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
W20260709 12:24:05.103291 31316 rpcz_store.cc:269] 0709 12:23:49.171158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.171441 (+   283us) service_pool.cc:224] Handling call
0709 12:24:05.082114 (+15910673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:04.363514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:04.364124 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:04.364157 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:04.364174 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:04.365021 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:04.365077 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:04.365111 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:24:04.365767 (+   656us) tablet.cc:701] Row locks acquired
0709 12:24:04.365786 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:04.365911 (+   125us) write_op.cc:270] Start()
0709 12:24:04.366025 (+   114us) write_op.cc:276] Timestamp: P: 1783599844365873 usec, L: 0
0709 12:24:04.366047 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:04.377354 (+ 11307us) log.cc:844] Serialized 3272 byte log entry
0709 12:24:04.424766 (+ 47412us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1166590ac 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b
0709 12:24:04.701575 (+276809us) op_driver.cc:464] REPLICATION: finished
0709 12:24:04.849064 (+147489us) write_op.cc:301] APPLY: starting
0709 12:24:04.849180 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:04.861070 (+ 11890us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11976032a 00007fc1196e5f14 00007fc1196e5ec3 00007fc1196e5e38 00007fc1196e5df3 00007fc1196e50dc 00007fc11970ee16 00007fc1196f6cbb 00007fc1196e139d 00007fc1196e4d75
0709 12:24:04.922355 (+ 61285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:04.923755 (+  1400us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:04.982637 (+ 58882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:04.982914 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:24:04.982956 (+    42us) write_op.cc:312] APPLY: finished
0709 12:24:04.983235 (+   279us) log.cc:844] Serialized 81 byte log entry
0709 12:24:04.983428 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:04.983560 (+   132us) write_op.cc:454] Released schema lock
0709 12:24:04.983612 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:05.007091 (+ 23479us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.007129 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":596294,"reported_tablets":36,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":140418,"apply.run_cpu_time_us":12354,"apply.run_wall_time_us":158006,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37615,"num_ops":8,"prepare.queue_time_us":173699,"prepare.run_cpu_time_us":14413,"prepare.run_wall_time_us":145310,"raft.queue_time_us":113440,"raft.run_cpu_time_us":24173,"raft.run_wall_time_us":203260,"replication_time_us":306416,"spinlock_wait_cycles":22424704,"thread_start_us":378953,"threads_started":4,"wal-append.queue_time_us":158993}]]}
I20260709 12:24:05.109084 31568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:05.109666 31568 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.110008 31568 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:05.110750 31319 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.117326 31568 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:05.117200 31319 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 13, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.122819 31319 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.125320 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:05.128129 31493 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:05.130955 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:05.131515 32108 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:05.131839 32108 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:05.132534 32108 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:05.133529 32108 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:05.135738 31493 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:05.137127 31319 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 18, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.146167 31319 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 13, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.138900 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:05.152514  4686 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:05.153053  4686 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:05.153887  4686 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:05.161657 31319 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.165395 31319 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 13, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 13 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.172746 31319 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.168325 31568 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:05.167167 32108 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:05.178345 31319 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.187878 31319 catalog_manager.cc:5697] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.213901 31319 catalog_manager.cc:5697] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 16, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.235322 31319 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 11, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 11 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.240679 31319 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.244206 31319 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.257649 31319 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 6 to 9, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.266638 31419 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:24:05.271359  4354 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:05.298023 31493 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:24:05.300098  4596 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:05.260558 31319 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.314409 31319 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 14, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.319661 31319 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 16, leader changed from <none> to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.321385 31319 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.322991 31319 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.324788 31319 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 5 to 13, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 13 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.326646 31319 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.330040 31319 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 18, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.331976 31319 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 17, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 17 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.334481 31319 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.337067 31319 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 14, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 14 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.338533 31319 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 14, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 14 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.339825 31319 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 8 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.348318 31319 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.352576 31319 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.355412 31319 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.361665 31319 catalog_manager.cc:5697] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.364508 31319 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 16, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.367107 31319 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.368237 31319 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.369764 31319 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.372289 31319 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 13, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 13 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:05.374305 31319 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 15, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:05.624217 31497 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:05.627751  4686 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:05.680877 32110 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:05.683872  4686 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:05.886161 31319 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 278) took 2253 ms. Trace:
I20260709 12:24:05.886961 31319 rpcz_store.cc:276] 0709 12:24:03.628061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.628208 (+   147us) service_pool.cc:224] Handling call
0709 12:24:05.880914 (+2252706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:05.500202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:05.500721 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:05.500752 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:24:05.500769 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:05.510789 (+ 10020us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:05.510850 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:05.510875 (+    25us) tablet.cc:685] Acquiring locks for 41 operations
0709 12:24:05.522437 (+ 11562us) tablet.cc:701] Row locks acquired
0709 12:24:05.522459 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:05.522596 (+   137us) write_op.cc:270] Start()
0709 12:24:05.522735 (+   139us) write_op.cc:276] Timestamp: P: 1783599845522547 usec, L: 0
0709 12:24:05.522758 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:05.524364 (+  1606us) log.cc:844] Serialized 16200 byte log entry
0709 12:24:05.595060 (+ 70696us) op_driver.cc:464] REPLICATION: finished
0709 12:24:05.642928 (+ 47868us) write_op.cc:301] APPLY: starting
0709 12:24:05.643010 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:05.705317 (+ 62307us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:05.705410 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:05.762926 (+ 57516us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:05.763357 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=82,key_file_lookups=82,delta_file_lookups=82,mrs_lookups=0
0709 12:24:05.763398 (+    41us) write_op.cc:312] APPLY: finished
0709 12:24:05.787075 (+ 23677us) log.cc:844] Serialized 348 byte log entry
0709 12:24:05.787253 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.787542 (+   289us) write_op.cc:454] Released schema lock
0709 12:24:05.787621 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:05.788024 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.788053 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13512,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":47605,"apply.run_cpu_time_us":45589,"apply.run_wall_time_us":145076,"cfile_cache_hit":166,"cfile_cache_hit_bytes":175753,"num_ops":41,"prepare.queue_time_us":26708,"prepare.run_cpu_time_us":8244,"prepare.run_wall_time_us":31391,"replication_time_us":72147,"thread_start_us":64239,"threads_started":2}]]}
W20260709 12:24:05.910526 31321 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 188) took 55760 ms (client timeout 15000 ms). Trace:
W20260709 12:24:05.913313 31321 rpcz_store.cc:269] 0709 12:23:10.149722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.172947 (+ 23225us) service_pool.cc:224] Handling call
0709 12:24:05.910312 (+55737365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25519,"reported_tablets":36}
W20260709 12:24:05.947603 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57385.7us
I20260709 12:24:05.960186 31318 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 10 to 15, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.967696 31318 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:06.016757 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet e77a183300084f968171dcd68225d026 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:06.017926 31321 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.020433 31321 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 11, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 11 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.022228 31321 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.027916  4792 tablet_replica.cc:333] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:24:06.028960 31321 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:06.029881  4792 raft_consensus.cc:2243] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.030931  4792 raft_consensus.cc:2272] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.030411 31321 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 13, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.034528  4792 ts_tablet_manager.cc:1916] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.055393 31321 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:06.064524 31321 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.069780 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet d385c04853e749af8fb00afe40a4a255 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:48288
W20260709 12:24:06.069866 31318 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 302) took 17152 ms (client timeout 15000 ms). Trace:
W20260709 12:24:06.077579 31318 rpcz_store.cc:269] 0709 12:23:48.917215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.917543 (+   328us) service_pool.cc:224] Handling call
0709 12:24:06.069778 (+17152235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:05.972312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:05.972860 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:05.972900 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:24:05.972923 (+    23us) tablet.cc:662] Decoding operations
0709 12:24:05.973311 (+   388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:05.973370 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:05.973404 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:05.973733 (+   329us) tablet.cc:701] Row locks acquired
0709 12:24:05.973749 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:24:05.973874 (+   125us) write_op.cc:270] Start()
0709 12:24:05.973974 (+   100us) write_op.cc:276] Timestamp: P: 1783599845973832 usec, L: 0
0709 12:24:05.973994 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:05.974984 (+   990us) log.cc:844] Serialized 930 byte log entry
0709 12:24:05.978894 (+  3910us) op_driver.cc:464] REPLICATION: finished
0709 12:24:05.979358 (+   464us) write_op.cc:301] APPLY: starting
0709 12:24:05.979444 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:05.980633 (+  1189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:05.980715 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:05.981979 (+  1264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:05.982154 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:24:05.982208 (+    54us) write_op.cc:312] APPLY: finished
0709 12:24:05.982418 (+   210us) log.cc:844] Serialized 33 byte log entry
0709 12:24:05.982583 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.982696 (+   113us) write_op.cc:454] Released schema lock
0709 12:24:05.982742 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:05.983090 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.983122 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":952137,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":3716,"apply.run_wall_time_us":3715,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2608,"prepare.run_wall_time_us":2930,"replication_time_us":4773}]]}
I20260709 12:24:06.113866  4792 ts_tablet_manager.cc:1929] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 12:24:06.114735  4792 log.cc:1199] T e77a183300084f968171dcd68225d026 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/e77a183300084f968171dcd68225d026
I20260709 12:24:06.121572 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet e77a183300084f968171dcd68225d026 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:06.128590 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet d385c04853e749af8fb00afe40a4a255 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:06.137425 31315 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 13 to 14, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 14 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.140232 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.139408 31315 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 18, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 18 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.156327 31315 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.171079 31315 catalog_manager.cc:5697] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 13 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.206080 31315 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.213217 31315 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 14 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.306437 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:06.307130 32110 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:06.309849 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:06.310423 32110 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:06.323275 32110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:06.323947 32110 raft_consensus.cc:606] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:06.326824 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:06.327386 31418 raft_consensus.cc:606] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:06.330361 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97e5105626c48be9d1768855511628a"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:06.330971 31418 raft_consensus.cc:606] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:06.332206 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:06.345954 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:06.347711 32110 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.360445 31315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 191) took 1719 ms. Trace:
I20260709 12:24:06.361079 31315 rpcz_store.cc:276] 0709 12:24:04.640890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.641635 (+   745us) service_pool.cc:224] Handling call
0709 12:24:04.800944 (+159309us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:06.360325 (+1559381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:06.238193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:06.238719 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:06.238767 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:24:06.238784 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:06.239548 (+   764us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:06.239610 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:06.239634 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:06.240133 (+   499us) tablet.cc:701] Row locks acquired
0709 12:24:06.240154 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:24:06.240298 (+   144us) write_op.cc:270] Start()
0709 12:24:06.240414 (+   116us) write_op.cc:276] Timestamp: P: 1783599846240261 usec, L: 0
0709 12:24:06.240436 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:06.241096 (+   660us) log.cc:844] Serialized 2470 byte log entry
0709 12:24:06.247290 (+  6194us) op_driver.cc:464] REPLICATION: finished
0709 12:24:06.248633 (+  1343us) write_op.cc:301] APPLY: starting
0709 12:24:06.248721 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:06.251991 (+  3270us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:06.252093 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:06.255612 (+  3519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:06.255805 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:24:06.255848 (+    43us) write_op.cc:312] APPLY: finished
0709 12:24:06.256091 (+   243us) log.cc:844] Serialized 65 byte log entry
0709 12:24:06.258835 (+  2744us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.258955 (+   120us) write_op.cc:454] Released schema lock
0709 12:24:06.259002 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:06.275222 (+ 16220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.275260 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4817,"reported_tablets":36,"spinlock_wait_cycles":296871168,"child_traces":[["op",{"apply.queue_time_us":1145,"apply.run_cpu_time_us":8157,"apply.run_wall_time_us":26540,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25116,"num_ops":6,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":3223,"prepare.run_wall_time_us":5132,"replication_time_us":6735,"spinlock_wait_cycles":113024}]]}
I20260709 12:24:06.379522 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.409355 31497 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:06.410887 31418 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:06.412335  4791 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:06.414297  4791 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:06.432698  4591 raft_consensus.cc:993] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.433604  4731 raft_consensus.cc:1081] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.435416 31574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:06.435933 31574 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.436254 31574 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:06.444496 31574 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.447479  4731 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.450939 31493 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.484429 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.506075 31317 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 303) took 2341 ms. Trace:
I20260709 12:24:06.506528 31317 rpcz_store.cc:276] 0709 12:24:04.165131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.165306 (+   175us) service_pool.cc:224] Handling call
0709 12:24:06.506011 (+2340705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53298,"reported_tablets":48}
I20260709 12:24:06.514637 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:06.521044 31497 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:06.532043 31497 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:06.533255 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:06.550740 31574 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:06.563241 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:06.564152 32110 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:06.564536 32110 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:06.548933  4686 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:06.569685 32110 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.594482 31493 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.596683 32110 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:06.626456 31320 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 302) took 5508 ms. Trace:
I20260709 12:24:06.626928 31320 rpcz_store.cc:276] 0709 12:24:01.101789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.102008 (+   219us) service_pool.cc:224] Handling call
0709 12:24:01.355614 (+253606us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400002210. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663f0b2 00007fc11f5b8759 00007fc11f550a76 00007fc11f521d58 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc
0709 12:24:06.609566 (+5253952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336267,"reported_tablets":48,"spinlock_wait_cycles":41974144}
I20260709 12:24:06.639154 32110 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:06.667268 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet e77a183300084f968171dcd68225d026 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:06.695896 32108 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:06.697105 31320 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 8 to 13, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.715930  4800 raft_consensus.cc:993] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.716902  4731 raft_consensus.cc:1081] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.719449 31567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:06.720073 31567 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.720551 31567 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:06.698818 31304 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:06.725551 31304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58186.9us
I20260709 12:24:06.725109  4799 raft_consensus.cc:993] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:06.728827  4159 raft_consensus.cc:1081] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:06.730144  4711 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:06.731331  4797 raft_consensus.cc:993] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:06.731848  4800 raft_consensus.cc:1081] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:06.731602 31567 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.735931 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:06.736486 32108 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:06.736779 32108 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:06.737504 32108 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.738348 32108 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:06.740374 31567 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:06.737715 31419 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:24:06.741498 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56254.2us
I20260709 12:24:06.762585 32108 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:06.764142 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:06.765204 31419 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:06.772677 31419 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:06.810889 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:06.811858 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 45525.5us
I20260709 12:24:06.816429 31493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f97e5105626c48be9d1768855511628a"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:06.817060 31493 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.817418 31493 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.817884  4798 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:06.820602 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 56594.5us
I20260709 12:24:06.826896 31418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:50108
I20260709 12:24:06.827459 31418 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.828032 31418 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:06.838449 31493 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.841001 31418 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.844161 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:06.844815 32108 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:06.851948 32108 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:06.853279 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:06.851406 31420 raft_consensus.cc:2955] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 8 to 13, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:06.841879 31493 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:06.855957 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:06.856827 31494 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:06.857805  4716 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:06.871886 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:06.882292  4716 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:06.816812  4686 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:06.889703 32108 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:06.891336 32108 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:06.892220 32108 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.893347 32108 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:06.894145 31494 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:06.884075  4802 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:06.844254 31418 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:06.898336 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:06.905704 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:06.906893 31422 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:06.907330 31422 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:06.912418 32108 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:06.918742  4716 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.920868  4811 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:06.921411  4811 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:06.911327 31422 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.928891 31422 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:06.941946 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 155141us
W20260709 12:24:06.945364 31322 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 301) took 28093 ms (client timeout 15000 ms). Trace:
W20260709 12:24:06.945779 31322 rpcz_store.cc:269] 0709 12:23:38.851752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.853276 (+  1524us) service_pool.cc:224] Handling call
0709 12:23:39.119664 (+266388us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b5400002210. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663f0b2 00007fc11f5b8759 00007fc11f550a76 00007fc11f521d58 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc
0709 12:24:06.945171 (+27825507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690019,"reported_tablets":48,"spinlock_wait_cycles":21110528}
I20260709 12:24:06.960335  4737 raft_consensus.cc:993] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.960913  4737 raft_consensus.cc:1081] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:06.960981 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet e77a183300084f968171dcd68225d026 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:06.927175  4802 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:06.973169  4802 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:06.979548 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:06.980353 31570 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.980760 31570 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:06.983080 31422 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:24:06.999025 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 84259.7us
I20260709 12:24:07.006860 31570 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:07.011425 31570 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:07.014066 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:07.014933 31422 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:07.015431 31422 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:07.016674 31422 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:07.018309 31422 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:06.958910  4686 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:07.015306 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:07.023864 31497 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:07.027144 31422 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:07.031930  4711 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:07.038472 31497 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:07.039937 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:06.983714  4811 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:07.071100 32110 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:07.087091 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 104461us
I20260709 12:24:07.059122  4802 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:24:07.145493 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63899.6us
I20260709 12:24:07.149622 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ab0d648ab643bf8d74dbe6ee9503d8 with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:33962
W20260709 12:24:07.217926 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64827.6us
I20260709 12:24:07.151054 31418 raft_consensus.cc:2955] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 7 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:07.139108  4802 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:24:07.256424 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 137792us
W20260709 12:24:07.354784 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 234882us
I20260709 12:24:07.382474  4802 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:07.415671 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 161552us
I20260709 12:24:07.434266  4838 tablet_replica.cc:333] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:24:07.519443 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dd7b78d2ef1488c970505878e67c6ca with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:07.558630 32110 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:07.559283 32114 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:07.567605 31321 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.587322 32106 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:07.595805 31497 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:24:07.601369 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 57300.4us
W20260709 12:24:07.609805 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45846.7us
I20260709 12:24:07.614956 31418 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:24:07.614897 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 205174us
I20260709 12:24:07.627159 31322 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 17 to 18, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.604763  4804 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:24:07.632587 31317 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 13 to 14, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.611336  4767 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:24:07.630017 31320 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 7 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:07.639114 31418 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:07.647337 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.614063  4811 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:24:07.601873  4833 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:24:07.687250 31497 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:07.696484  4838 raft_consensus.cc:2243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:07.697607  4838 raft_consensus.cc:2272] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:07.714960  4767 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:24:07.706419  4686 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:24:07.735395 32110 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:07.714574  4828 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:24:07.743086  4672 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 12:24:07.789466 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 105825us
I20260709 12:24:07.795737  4814 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:07.810350 31419 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:07.810988  4814 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:07.819610  4767 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:07.929613  4838 ts_tablet_manager.cc:1916] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:08.087852 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65690.2us
W20260709 12:24:08.100620 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79290.7us
W20260709 12:24:08.086685  4763 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:24:08.133237  4823 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:24:08.134377  4855 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:24:08.361416  4763 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:24:08.457864 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 496678us
W20260709 12:24:08.742192 31464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.002s	sys 0.003s
W20260709 12:24:08.743150 31464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.003s	sys 0.003s
I20260709 12:24:08.882977 32106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 1188) took 1082 ms. Trace:
I20260709 12:24:08.883704 32106 rpcz_store.cc:276] 0709 12:24:07.762830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.763031 (+   201us) service_pool.cc:224] Handling call
0709 12:24:07.764332 (+  1301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.764641 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.764667 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.770938 (+  6271us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.902937 (+131999us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:24:07.902973 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.903032 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.141763 (+238731us) raft_consensus.cc:1685] finished
0709 12:24:08.141785 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.845124 (+703339us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2610,"spinlock_wait_cycles":885632,"thread_start_us":116661,"threads_started":1,"wal-append.queue_time_us":181917}
W20260709 12:24:08.886813  4866 log.cc:927] Time spent T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.714s	user 0.006s	sys 0.010s
I20260709 12:24:08.842918 32113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1685dea95ca449998eaf8075418fda96"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:36526
W20260709 12:24:08.881888 32078 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.003s	sys 0.003s
W20260709 12:24:08.901978 31418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.001s	sys 0.016s
W20260709 12:24:08.902452 31418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.001s	sys 0.017s
I20260709 12:24:08.906258 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 1186) took 1084 ms. Trace:
I20260709 12:24:08.906836 32110 rpcz_store.cc:276] 0709 12:24:07.821378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.888078 (+ 66700us) service_pool.cc:224] Handling call
0709 12:24:07.888360 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:07.888704 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:07.888731 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:07.889284 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:24:07.905701 (+ 16417us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b18000e9740. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc1193030d1 00007fc11971ea0f
0709 12:24:08.014067 (+108366us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:08.014141 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:08.014230 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:08.905509 (+891279us) raft_consensus.cc:1685] finished
0709 12:24:08.905588 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:08.906010 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3350,"spinlock_wait_cycles":10403584,"thread_start_us":108144,"threads_started":1,"wal-append.queue_time_us":205515}
W20260709 12:24:08.899401 32078 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.003s	sys 0.004s
W20260709 12:24:08.897816 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.025s
I20260709 12:24:08.921612 32113 raft_consensus.cc:606] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:08.933853 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.001s	sys 0.026s
I20260709 12:24:08.991675  4886 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:08.992468  4802 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:08.992708  4886 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:08.993294  4802 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:08.996695  4886 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.025667  4889 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:09.029392 31317 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 304) took 1882 ms. Trace:
I20260709 12:24:09.034052  4802 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.059212  4814 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.061003  4891 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.029927 31317 rpcz_store.cc:276] 0709 12:24:07.147215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.147494 (+   279us) service_pool.cc:224] Handling call
0709 12:24:09.029134 (+1881640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.793865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.794607 (+   742us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.794653 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:24:07.794690 (+    37us) tablet.cc:662] Decoding operations
0709 12:24:07.795139 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.795209 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.795250 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:07.795477 (+   227us) tablet.cc:701] Row locks acquired
0709 12:24:07.795497 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:07.795681 (+   184us) write_op.cc:270] Start()
0709 12:24:07.795827 (+   146us) write_op.cc:276] Timestamp: P: 1783599847795623 usec, L: 0
0709 12:24:07.795851 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:07.796670 (+   819us) log.cc:844] Serialized 539 byte log entry
0709 12:24:07.811153 (+ 14483us) op_driver.cc:464] REPLICATION: finished
0709 12:24:07.930226 (+119073us) write_op.cc:301] APPLY: starting
0709 12:24:07.930646 (+   420us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:07.948888 (+ 18242us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:07.948982 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:08.061254 (+112272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:08.109050 (+ 47796us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:08.113420 (+  4370us) write_op.cc:312] APPLY: finished
0709 12:24:08.251589 (+138169us) log.cc:844] Serialized 25 byte log entry
0709 12:24:08.826567 (+574978us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.837322 (+ 10755us) write_op.cc:454] Released schema lock
0709 12:24:08.837441 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:08.925946 (+ 88505us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:08.925986 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":103149,"apply.run_cpu_time_us":21355,"apply.run_wall_time_us":1007245,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":149908,"prepare.run_cpu_time_us":3151,"prepare.run_wall_time_us":6764,"replication_time_us":15153,"thread_start_us":83056,"threads_started":1}]]}
I20260709 12:24:09.064584  4891 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.071182  4889 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.089958  4810 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.091049  4810 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.101979 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 306) took 1850 ms. Trace:
I20260709 12:24:09.104970  4800 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.105846  4800 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.109983  4820 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.110981  4820 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.114207  4814 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.115957  4833 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:09.116915  4833 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.114982  4814 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.121093  4819 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.121843  4819 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.124274  4840 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.125108  4840 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.125885  4819 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.133749  4891 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.135823  4833 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.137389  4836 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.137907  4873 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.138203  4672 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.183372  4836 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.183827  4672 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.186131  4836 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.183385  4873 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.189683  4873 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.137423  4837 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.155913 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.157094 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.152595  4810 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.163728  4811 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.164366 31321 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 17, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.166818  4814 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.074492  4889 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.169267  4822 raft_consensus.cc:993] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.176175  4842 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:09.176911  4876 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.177028  4711 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.178839  4897 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.179435  4800 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.180888  4898 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.186192  4672 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.187027  4854 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.190980  4837 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.191900  4832 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.161374 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.102600 31322 rpcz_store.cc:276] 0709 12:24:07.251685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.251833 (+   148us) service_pool.cc:224] Handling call
0709 12:24:09.101773 (+1849940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.638094 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.638600 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.638628 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:24:07.638643 (+    15us) tablet.cc:662] Decoding operations
0709 12:24:07.674222 (+ 35579us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.674265 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.674298 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:07.674467 (+   169us) tablet.cc:701] Row locks acquired
0709 12:24:07.674484 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:07.674721 (+   237us) write_op.cc:270] Start()
0709 12:24:07.684501 (+  9780us) write_op.cc:276] Timestamp: P: 1783599847674634 usec, L: 0
0709 12:24:07.689231 (+  4730us) op_driver.cc:348] REPLICATION: starting
0709 12:24:07.758936 (+ 69705us) log.cc:844] Serialized 539 byte log entry
0709 12:24:07.793388 (+ 34452us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11975ee28 00007fc11d199581 00007fc11d198d58 00007fc11d19d9f1 00007fc11d19d9a9 00007fc11d19d939 00007fc11d19d901 00007fc11d19cb2d 0000000000388634 0000000000388479
0709 12:24:07.798939 (+  5551us) op_driver.cc:464] REPLICATION: finished
0709 12:24:07.871003 (+ 72064us) write_op.cc:301] APPLY: starting
0709 12:24:07.871120 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:07.950479 (+ 79359us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:07.950516 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:07.951958 (+  1442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:07.952141 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:07.952188 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:07.952390 (+   202us) log.cc:844] Serialized 25 byte log entry
0709 12:24:09.091717 (+1139327us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b60000bd9c8. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11d0cd161 00007fc11d239815 00007fc11d23b7c4 00007fc11d1ae473 00007fc11d1af8c6 00007fc11d1af32c 00007fc11d19b389 00007fc11d19ab53 00007fc11d19ed61 00007fc11d19ed19 00007fc11d19eca9
0709 12:24:09.091850 (+   133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.091981 (+   131us) write_op.cc:454] Released schema lock
0709 12:24:09.092067 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.099184 (+  7117us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.099216 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":22004,"apply.run_cpu_time_us":8442,"apply.run_wall_time_us":1228109,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":7687,"prepare.run_cpu_time_us":6321,"prepare.run_wall_time_us":155463,"replication_time_us":109587,"spinlock_wait_cycles":158447232,"thread_start_us":10732,"threads_started":1}]]}
I20260709 12:24:09.193048  4841 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.226516  4893 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.226922  4898 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.227438  4893 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.229492  4898 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.229753  4893 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.231623  4837 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.231734 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.198437  4811 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.233211 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.225256  4672 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.226219  4876 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.234776 31321 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:09.237138  4897 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.201433  4810 raft_consensus.cc:1081] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.206614  4889 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.249682  4889 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.251842  4857 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:09.252432  4889 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.252506  4857 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.254474  4806 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.255036  4810 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.224912  4711 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.255401 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.255692  4810 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.257347  4711 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.258062  4810 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.259843 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.260907  4803 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.261938  4875 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.261737  4803 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.262614  4875 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.241799  4820 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.265419  4875 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.258102  4672 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.255192  4806 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.268417  4811 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.272219  4882 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.272109  4832 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.273057  4882 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.275267 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.275890 32111 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:09.275985  4806 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.276216  4876 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.276793  4803 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.276723 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:09.277098 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.277467 31423 raft_consensus.cc:606] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.278136  4716 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.278818  4716 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.280927  4716 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.284713  4820 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.285396  4820 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.288601  4897 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.292026  4832 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.293378  4840 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.293606 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.294199 31494 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:09.294960 31423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:09.295287  4840 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.299110 31423 raft_consensus.cc:606] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.299103  4840 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.303107 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.304549  4840 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:09.304499 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 94518.8us
I20260709 12:24:09.305663  4857 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.307104 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.307652 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.246800  4841 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.309882 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.311183  4882 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.300494  4820 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.301808 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.309921  4854 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.313798 31491 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:09.316175 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.302381 31569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1685dea95ca449998eaf8075418fda96"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:09.317239 31569 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.317791 31569 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.319460 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.321134 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.205329  4842 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.327284 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.334132 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.334553 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.335405  4672 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.336443  4837 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.337054  4837 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.339635  4837 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.340588 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.343657 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:09.351429  4811 raft_consensus.cc:993] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.352144  4811 raft_consensus.cc:1081] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.357657  4857 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.359078 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.358430  4857 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.360589 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.356083 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.363778  4854 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.365064  4842 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.365311 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dd7b78d2ef1488c970505878e67c6ca with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:33962
I20260709 12:24:09.366914 31320 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 195) took 1757 ms. Trace:
I20260709 12:24:09.354382  4838 ts_tablet_manager.cc:1929] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:24:09.369884  4838 log.cc:1199] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/36ab0d648ab643bf8d74dbe6ee9503d8
I20260709 12:24:09.371824  4838 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33962 (request call id 1) took 2282 ms. Trace:
I20260709 12:24:09.372203  4838 rpcz_store.cc:276] 0709 12:24:07.106613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.140885 (+ 34272us) service_pool.cc:224] Handling call
0709 12:24:07.418212 (+277327us) ts_tablet_manager.cc:1151] Deleting tablet 36ab0d648ab643bf8d74dbe6ee9503d8
0709 12:24:07.419675 (+  1463us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:09.157935 (+1738260us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:09.354141 (+196206us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:09.371563 (+ 17422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156393,"tablet-delete.queue_time_us":260173,"thread_start_us":209076,"threads_started":1}
I20260709 12:24:09.374282 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 36ab0d648ab643bf8d74dbe6ee9503d8 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:09.374972  4838 tablet_replica.cc:333] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:24:09.374874  4842 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.375556  4897 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.375697  4842 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.376302  4897 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.378733  4822 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.379031  4897 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.379419  4822 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.362397  4857 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.381072  4837 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:09.381588  4822 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.381580  4837 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.386859  4837 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:09.382790 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.388361 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.388787 31565 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:24:09.367363 31320 rpcz_store.cc:276] 0709 12:24:07.609378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:07.609561 (+   183us) service_pool.cc:224] Handling call
0709 12:24:09.366715 (+1757154us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:07.802340 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:07.811863 (+  9523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:07.813795 (+  1932us) write_op.cc:435] Acquired schema lock
0709 12:24:07.814415 (+   620us) tablet.cc:662] Decoding operations
0709 12:24:07.889907 (+ 75492us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:07.893849 (+  3942us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:07.897466 (+  3617us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:07.923704 (+ 26238us) tablet.cc:701] Row locks acquired
0709 12:24:07.927742 (+  4038us) write_op.cc:260] PREPARE: finished
0709 12:24:07.938886 (+ 11144us) write_op.cc:270] Start()
0709 12:24:07.960053 (+ 21167us) write_op.cc:276] Timestamp: P: 1783599847932901 usec, L: 0
0709 12:24:07.971594 (+ 11541us) op_driver.cc:348] REPLICATION: starting
0709 12:24:08.132901 (+161307us) log.cc:844] Serialized 539 byte log entry
0709 12:24:09.232447 (+1099546us) op_driver.cc:464] REPLICATION: finished
0709 12:24:09.255995 (+ 23548us) write_op.cc:301] APPLY: starting
0709 12:24:09.256140 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:09.257425 (+  1285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:09.257563 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:09.258337 (+   774us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:09.258610 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:09.269832 (+ 11222us) write_op.cc:312] APPLY: finished
0709 12:24:09.283173 (+ 13341us) log.cc:844] Serialized 25 byte log entry
0709 12:24:09.283372 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.283496 (+   124us) write_op.cc:454] Released schema lock
0709 12:24:09.283538 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:09.284571 (+  1033us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:09.284602 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":5966,"apply.run_cpu_time_us":3927,"apply.run_wall_time_us":28554,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":148455,"prepare.run_cpu_time_us":4159,"prepare.run_wall_time_us":337587,"replication_time_us":1260535}]]}
I20260709 12:24:09.357061  4841 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.378468  4842 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.399451 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.401690 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:09.406287 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.406836 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.407521 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.408143 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.405310 31569 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.404593  4822 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:09.420948 31569 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.424428 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.418563  4820 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.428856  4820 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.419893  4822 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.420083  4841 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:09.433640  4737 raft_consensus.cc:993] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.427073  4840 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.440771  4840 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.443207  4820 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.444298  4840 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.444917 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.447438  4737 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:09.447603  4811 raft_consensus.cc:1081] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:09.447857  4737 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.448371  4737 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:09.448869 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.450105 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.450766  4841 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.451309 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.436250  4822 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:09.451962 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.466989 32106 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:09.452710 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.454835  4898 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.455555 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.467875 32108 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:09.467988 32111 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:09.456032 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.456367 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.456652 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.469475 32110 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:09.458338  4857 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.475032 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.475029  4898 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.471352  4857 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.480791 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.497386 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.500818 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.502214 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.496910 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.491820  4882 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.503090 31418 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:09.509560 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.505932  4898 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.507510  4882 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.517550 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.508190  4841 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.527639  4857 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.528573 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.529047 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.529346 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.529677 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.533061 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.524956  4767 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:09.535181 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.535288  4767 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.537573  4767 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:09.543380  4737 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.543756 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.544806 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.545080 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.545723 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.546135 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.546986 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.548703 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.549223 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.551555 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.547830 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.552318 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:09.552901 32113 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:09.553247 32113 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:09.552969 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.554142 32113 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.555490 32113 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.555887  4737 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.556296  4882 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.547037 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.559114 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:09.563453 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.577459 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.581270 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.582581 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:09.583084  4838 raft_consensus.cc:2243] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:09.584267  4838 raft_consensus.cc:2272] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:09.584728 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.585409 31492 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:24:09.586436 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.587021 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.588462 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.593469 31387 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:09.594998  4898 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.596181 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.596261  4836 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:09.597328  4836 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.597719  4836 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:09.598469  4801 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:09.599030  4801 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.599499  4801 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:09.601444 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:09.603608 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.604909  4838 ts_tablet_manager.cc:1916] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:09.607020 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.607389 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.609884 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.611466 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.622282  4822 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.630033 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.630564 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:09.631191 31497 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.631470 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.632664 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.635820  4822 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.612000 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.637897 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:09.645841 31497 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:09.649768 32113 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:09.652282 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.655040 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.657011 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.658962 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.659412 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.661049 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:09.662438 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:09.668126  4837 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.668288  4825 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.670181 32107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:36526
I20260709 12:24:09.671258 32107 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:09.671682 32107 raft_consensus.cc:614] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.673349 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.673957  4837 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.674372  4854 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.675231 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.676103  4798 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.684650 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:09.697459 31465 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.689517  4875 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:09.706341 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.712601 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.696707  4811 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.700255  4801 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:09.714543 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 61340.2us
I20260709 12:24:09.714802  4875 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.716939  4801 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.717186  4875 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.717536  4806 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.718612 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:09.719256 31421 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:09.720348 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.721973  4854 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:09.708529  4882 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:09.722365 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.725329  4798 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.712769  4828 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:09.727417 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:09.725234 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.725422  4811 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.728439 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.733034  4811 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.733127  4798 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:09.733381 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:09.736231 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50028.5us
I20260709 12:24:09.736917 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.739369 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.740682 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.740975 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.733601  4798 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.743507 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.744215 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:09.743865 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.738546  4801 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:09.747392 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.748219  4800 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.739437  4857 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:09.748575 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.741246  4832 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.746802  4882 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:09.749928 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.752271 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:09.746553  4897 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:09.744192  4876 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:09.764586  4897 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.760888 31423 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:09.765087  4897 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:09.745764  4798 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:09.767434 31421 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:09.764088 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:09.746297  4801 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.765527  4731 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.752460  4810 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:09.777117 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:09.780809 31423 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:09.753752  4882 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:09.777674  4801 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:09.789652  4847 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.790526  4854 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:09.791148  4854 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:24:09.792342 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77610.7us
I20260709 12:24:09.792227  4854 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.793176 31540 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.789760 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.783239  4882 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:09.795751 31540 raft_consensus.cc:2686] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:09.800431 31540 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:09.802837  4907 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:24:09.808596 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 79512.2us
I20260709 12:24:09.816951 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.817911 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.821692  4800 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.822450  4800 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:09.819814 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.825871  4910 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.825887  4840 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:09.809504  4767 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:09.828953 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.812119 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.841938  4801 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.843515  4909 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.844137  4801 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.844627 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.849169 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:09.855939 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45010.8us
I20260709 12:24:09.853163 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.850924  4894 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:09.875133 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.881139 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:09.885362  4840 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.885839 31422 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:09.820735  4836 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.889184 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:09.889575 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 71714.2us
I20260709 12:24:09.890309 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.891420 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.892053 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.892258 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.884886  4894 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:09.894125 31566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:09.894737 31566 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.894922 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.895133 31566 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:09.895257 32080 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:09.896452 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.897605 31569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:09.897905 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.898124 31569 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.898547 31569 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:09.902961 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.907176 31566 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.894876  4731 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:09.910782  4842 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:09.893610  4911 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:09.915378 31570 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:09.891048  4840 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:09.910104  4897 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.890853  4910 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.895710  4838 ts_tablet_manager.cc:1929] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 12:24:09.919833 31569 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:09.921218 31566 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.895041  4814 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:09.928190  4840 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:09.926728  4836 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.929234  4840 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.929806 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.941874 31570 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:09.938303  4882 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.948153 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.948330  4913 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:09.949467  4913 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:09.949958  4913 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:09.950961 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.951295  4798 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.953241 31322 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 17, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.958441  4913 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.959082 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:09.959937  4913 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:09.960453 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:09.964895  4798 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.972865  4882 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:09.974860  4897 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:09.975920  4838 log.cc:1199] T 9dd7b78d2ef1488c970505878e67c6ca P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/9dd7b78d2ef1488c970505878e67c6ca
I20260709 12:24:09.976089 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.977479 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:09.978248  4875 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:09.978969  4875 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:09.978667 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:09.980014 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:09.980703 31422 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:09.981009 31422 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:09.982990 31420 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:09.983871 31422 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:09.985085 31422 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:10.003427 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.006784 31389 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.006956 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:10.007030 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:10.002445 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 80401.3us
I20260709 12:24:10.013509 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.014091 31569 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:10.007663  4847 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:10.017885 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:10.018575 31540 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.015194  4857 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:24:10.020051 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:10.002249  4875 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:10.017478  4811 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:10.015223  4894 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:10.028035  4895 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:10.025490 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:10.030891 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 9dd7b78d2ef1488c970505878e67c6ca (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:10.034228 31540 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.019233 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.042019 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:10.048390 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:10.052593 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:10.057865 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:10.039008  4894 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:10.061009 31422 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:10.066725 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:24:10.067873 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.040726  4895 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:10.046864  4803 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:10.082046 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.085712 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:10.086398 31497 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:10.087132 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.090515  4914 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:24:10.093007 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.093116 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:10.075522  4908 consensus_queue.cc:1059] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:24:10.099586 31496 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:10.106642  4767 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:10.107069  4767 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.095566  4811 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:10.107930  4767 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.097291 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.109257  4767 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:10.109798  4672 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:10.111308 32110 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:10.102725 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:10.112990 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:10.120841 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.076046  4837 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:24:10.091702  4836 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:10.156772 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 63722.7us
I20260709 12:24:10.096707  4896 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:10.160898 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.163949 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:10.167932 32108 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:10.165115 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.165153 32106 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:10.171181 31497 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:10.172708 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:10.167058  4832 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:10.182596  4894 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:10.185966  4894 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.186847  4894 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.187589  4842 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:10.187752  4800 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:10.188477  4800 consensus_queue.cc:1243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer b6bc3d9dbfb44e81b63071002a011f71 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:24:10.178601  4857 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:10.178300  4882 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:10.188024  4842 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:10.202468 32108 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:10.202903 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:10.182400  4763 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:24:10.208436 31496 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
W20260709 12:24:10.218160 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43709.7us
I20260709 12:24:10.227979 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:10.228919 31421 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:10.228956  4908 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:10.229773  4857 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:10.230140  4908 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:10.230525  4908 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.229808 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.231227  4842 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.232057  4798 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:10.216490  4767 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:10.233198  4767 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.229399 31421 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:10.234282 31421 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:10.235550 31421 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:10.236661 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:10.243008 31496 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:10.253628  4798 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:24:10.234294  4767 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:10.258737  4841 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:10.263010 31420 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:10.270012 31421 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:10.316339  4894 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:10.317536  4894 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:10.317960 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 53695.6us
I20260709 12:24:10.317984  4894 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.325559  4882 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:24:10.335976  4894 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:10.337066 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 75840.1us
I20260709 12:24:10.347169  4731 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:10.350905  4835 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:10.351392  4731 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:10.317936  4841 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:10.354955  4841 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:10.356038  4841 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.357833  4841 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:10.318442  4837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:24:10.337427  4894 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:10.343818  4918 log.cc:927] Time spent T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:24:10.375105  4895 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:10.391036  4895 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.392306  4895 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.393862  4895 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:10.414883  4908 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.418942 31321 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 9 to 10, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 10 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:10.434185 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 66159us
I20260709 12:24:10.357523  4731 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.438882 31421 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:10.441692  4919 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:10.448096 32111 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:10.463150  4731 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:10.453155  4767 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 12:24:10.475493 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100620us
I20260709 12:24:10.517740  4842 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:10.522164  4908 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:10.540870 31492 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:10.545993 32108 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:24:10.558007 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55124.8us
W20260709 12:24:10.553521 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63721.1us
W20260709 12:24:10.553092 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 66971us
I20260709 12:24:10.596187  4801 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:24:10.613445 31421 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:10.615459 31500 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:10.597692  4909 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:24:10.631891  4909 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:10.629410  4814 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:24:10.642019  4833 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:10.632417  4909 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:10.663496  4909 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:10.667770  4909 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:10.674880 31370 auto_rebalancer.cc:629] Failed to schedule move for tablet 19ad016bcdfe4c62a610fe4974bc52c2: Illegal state: Replica 0065979e5b9a477f8abf064563426291 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:10.684450 31320 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 11 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.690012 31320 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.706077 31422 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:10.714056 32108 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:10.719298  4833 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:10.720394  4935 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:24:10.763689 31496 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:10.768666  4820 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:10.803578  4945 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:24:10.806463  4941 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:10.945456 31492 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:11.022104 31573 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:11.024269 31422 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:11.024441  4913 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:11.024298 31463 consensus_peers.cc:597] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ed13c6144834a9a9349865442585b12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.030122  4828 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:11.054555  4919 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:11.055176  4919 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.058066 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:11.058836 31423 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:11.059993 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:11.059860  4919 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:11.060636 31570 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:11.062213 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:11.063129  4919 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:11.063509  4919 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:11.066763  4919 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:11.068372  4913 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.073894 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.091455  4919 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.095870  4919 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:11.096097 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:11.104472 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:11.105468 31423 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:11.104591 31570 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:11.113336 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:11.107537 31422 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.136947 31321 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.156630 31574 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.132787  4919 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:11.167990  4919 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:11.171365  4919 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.172461 31500 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:11.227605  4811 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.228189  4811 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.231670 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:11.230477  4811 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.241870 31320 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 13 to 14, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 14 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:11.253398 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53236.8us
I20260709 12:24:11.255262 31574 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:24:11.257582 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44064.4us
I20260709 12:24:11.263140 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.263751 31496 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:24:11.266305 31422 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:11.267875  4913 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:11.272152 31463 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e61fb74a676405696e2d0e6b9027efe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.272984 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:11.274513  4801 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:11.274992  4875 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:11.275439  4875 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.275784  4875 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.297627  4875 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.303149 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:11.303706 31496 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.306049  4875 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.307488 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:11.309914  4828 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.311771 31496 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:11.312983 31390 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:11.314324  4875 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:11.315554  4875 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:11.316834 31423 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.339849  4875 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.340976 31422 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:11.361320 31320 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.364830 31574 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.402850 31496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:11.403656 31496 raft_consensus.cc:606] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:11.417285 31496 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:11.417881 31496 raft_consensus.cc:606] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:11.419365 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:11.421252 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:11.422032 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.445391 31574 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:11.453392  4962 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:11.452593 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74394.6us
I20260709 12:24:11.457003 31496 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:11.458315  4963 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:11.465307 31322 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 11 to 13, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:11.485260 31387 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08259dcf521e4914917a72febcb040d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.524355  4811 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.532009  4835 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:11.531478 31568 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.532512  4835 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.532733  4909 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.533311  4909 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.535440  4909 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.537125 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:11.537751 32107 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:24:11.538897 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:11.539665  4909 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:11.540056  4909 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.540390  4909 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.558878 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.559358 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.559573 31496 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:11.560034 31492 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:11.564049  4909 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.564818 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:11.565574  4933 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:11.565964  4933 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:11.566311  4933 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.570879  4911 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:11.571447  4911 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.573844  4911 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:11.575428 31322 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 8, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 13 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.580511 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:11.584591  4835 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.585947 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.586057 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:11.586714 31492 raft_consensus.cc:2368] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:24:11.588272 32107 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:11.590670 32080 leader_election.cc:400] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:24:11.591130 32080 leader_election.cc:403] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:11.591769  4919 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:24:11.592087  4909 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.597930 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:11.598516 31492 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.614799 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:11.615427 32108 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.615718  4919 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13.
I20260709 12:24:11.590312  4933 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.622418 32108 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:11.623733 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:11.628160 32107 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:11.626374 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:11.629942 31492 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:11.631361 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:11.629045  4909 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.629171  4933 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.642163  4835 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:11.647156  4967 ts_tablet_manager.cc:933] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:11.665673 31422 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:11.665171  4911 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:11.641355 31492 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:11.696532 31500 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
W20260709 12:24:11.696405 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55468.1us
I20260709 12:24:11.665469  4909 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.680545  4731 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:24:11.703675 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:11.705487  4969 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:11.706127  4969 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:11.707381  4969 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.687269  4911 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.720837  4909 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.722641 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.723366 31492 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:11.724489 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:11.726259 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.727075 31492 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:11.699000  4835 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:11.728395 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:11.735039 32107 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:11.754241 31568 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:11.762995 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:11.718489  4911 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:11.729463  4909 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:11.772063  4909 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.780752  4967 tablet_copy_client.cc:323] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:24:11.785313  4909 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:11.799068 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 1ed13c6144834a9a9349865442585b12 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:24:11.799665 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 1ed13c6144834a9a9349865442585b12 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-1ed13c6144834a9a9349865442585b12
I20260709 12:24:11.784651  4919 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:24:11.813356 32111 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:24:11.828519 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43570.2us
I20260709 12:24:11.834532 31500 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:11.871109  4978 ts_tablet_manager.cc:933] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:11.822814  4835 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.822819  4909 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.886792  4976 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.887413  4976 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.889811  4976 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:11.890503 31510 tablet_copy_source_session.cc:215] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:11.892578 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:11.869050  4960 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.845405  4875 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:24:11.905514 31568 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
W20260709 12:24:11.906420 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63117.5us
I20260709 12:24:11.922245 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:11.907904  4978 tablet_copy_client.cc:323] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:24:11.907732  4981 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:24:11.903106  4960 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:11.946491  4960 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:11.947065 31421 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:11.951222 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:11.951864 32111 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:11.953043 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:11.960350  4811 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:11.960804  4811 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.961138  4811 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:11.963282  4975 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:11.963315 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:11.965435  4976 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:11.965828  4976 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.966148  4976 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:11.968309  4967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed13c6144834a9a9349865442585b12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:11.991400 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 74420.3us
I20260709 12:24:11.989837  4801 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:11.993357  4919 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:12.022804  4835 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.033221 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147886us
I20260709 12:24:12.074616 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.075539 31500 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:12.078809 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 7e61fb74a676405696e2d0e6b9027efe from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:24:12.079530 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 7e61fb74a676405696e2d0e6b9027efe from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-7e61fb74a676405696e2d0e6b9027efe
I20260709 12:24:12.113114 31500 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:12.032882  4835 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.093153  4909 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.027781  4801 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.195483 31510 tablet_copy_source_session.cc:215] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:12.050390  4919 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.121197  4913 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.282094 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.282985 31500 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
W20260709 12:24:12.283286 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 187915us
I20260709 12:24:12.278537  4913 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:12.311916 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 257087us
I20260709 12:24:12.327996  4913 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.313752  4811 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:12.351208  4984 log.cc:927] Time spent T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:24:12.358927  4912 raft_consensus.cc:993] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
W20260709 12:24:12.379163  4983 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:24:12.392470 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:12.393406 31422 raft_consensus.cc:2368] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
I20260709 12:24:12.382439  5000 raft_consensus.cc:1081] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:12.396826 31492 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:24:12.403028 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.403620 31496 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:12.404863  5003 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.406970  5003 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.409158  5003 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:12.390281  4835 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.411011  4811 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.413043 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:12.414094  4835 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:12.414577  4835 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:12.390638  4919 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:12.415467  4835 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.417627  4979 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:12.389258  4801 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.417837 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.420614 31494 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:12.427136 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:12.425866 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:12.428920  4801 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:12.439385  4987 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:24:12.439299  4801 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.441519  4801 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.442057  4989 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:12.442478  4989 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.442842  4989 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:12.443691 31496 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:24:12.426180 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 104961us
I20260709 12:24:12.416025  4976 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.451630 31466 leader_election.cc:400] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
I20260709 12:24:12.465234 31466 leader_election.cc:403] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:12.469789 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.470567 31500 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:12.472982 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.473455 31492 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:12.476171 31422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:12.476707 31422 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:12.477206 31422 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:12.451493  4986 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.479976 32079 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
I20260709 12:24:12.480502 32079 leader_election.cc:403] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:12.482963 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44234.9us
I20260709 12:24:12.485512 31494 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:12.494484 32111 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 18: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:12.497514 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:12.498947  4963 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:12.499611  4963 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:12.501840 31422 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:12.505914 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.506430 31494 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:12.506718 31494 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:12.510273 31422 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:12.518262 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:12.493393  4801 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18.
I20260709 12:24:12.530719 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:12.531351 31565 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:12.514093 31494 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:12.533111 31494 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:12.501647  5011 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:12.484191  4985 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:24:12.519353  4997 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:24:12.542385  4963 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.543576  4978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e61fb74a676405696e2d0e6b9027efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:12.488807  4986 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.549697 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:12.552803  4911 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:12.553261  4911 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.553617  4911 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:12.561585 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:12.562390 32113 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:12.569788 31494 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
W20260709 12:24:12.572075 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 66591.3us
I20260709 12:24:12.574335 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:12.593648 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:12.594656 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:12.596954 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:12.597759 31566 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:24:12.622247 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60204.8us
I20260709 12:24:12.623172 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:12.626979 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54133.8us
I20260709 12:24:12.623121 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:12.641558 32109 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:12.540958  5011 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:12.651232 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.647639 31565 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
W20260709 12:24:12.634567 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 97879.5us
I20260709 12:24:12.664427 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:12.629590  4976 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:12.672739 32110 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:12.656311  5024 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:12.693354  5011 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:12.695657  4986 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.684273  5013 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:12.696894  5013 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.697250  5013 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:12.711526  4989 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.713014 31568 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:12.713979  4989 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.724663  5017 ts_tablet_manager.cc:933] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
W20260709 12:24:12.727299 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67760.5us
I20260709 12:24:12.729776 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.730247 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.730826 31499 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:12.721989 31321 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.764681  4911 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.769563 32107 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:12.772231 31499 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:12.776360 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:12.777307 31568 raft_consensus.cc:2368] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15.
I20260709 12:24:12.780857 31540 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:12.794569 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:12.794865  4933 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:12.796706 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:12.797299 31574 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:12.800544 32079 leader_election.cc:400] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15.
I20260709 12:24:12.800845 32079 leader_election.cc:403] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:12.809055 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.847226 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 102248us
I20260709 12:24:12.847678 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:12.847821 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 192876us
W20260709 12:24:12.854707 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 248611us
I20260709 12:24:12.900733  5020 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:12.901737  5020 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:12.902069  5020 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:12.902887  5020 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.903901 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:12.908107 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.908821 31496 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 18: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:12.908972 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:12.909924 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:12.903949 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:12.847003  5015 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:12.846760  4933 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:12.939679  4933 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.851460  4997 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16.
I20260709 12:24:12.850481  4967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55794 (request call id 1275) took 1130 ms. Trace:
I20260709 12:24:12.943384  4967 rpcz_store.cc:276] 0709 12:24:11.614068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.614186 (+   118us) service_pool.cc:224] Handling call
0709 12:24:11.674860 (+ 60674us) ts_tablet_manager.cc:934] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
0709 12:24:11.900613 (+225753us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:12.700804 (+800191us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:12.700925 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:12.710100 (+  9175us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:12.710403 (+   303us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:12.735572 (+ 25169us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:12.742561 (+  6989us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29511,"tablet-copy.queue_time_us":32452,"thread_start_us":83815,"threads_started":2}
I20260709 12:24:12.945278  4967 tablet_copy_client.cc:806] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:12.945919  4967 tablet_copy_client.cc:670] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:12.853870  5009 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:12.946485  5009 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:12.946974  5009 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:12.854364  4911 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:12.911459  5013 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:12.958334  5013 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:12.959012 31492 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:24:12.978343 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.003413  4990 raft_consensus.cc:993] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:13.005580 31573 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:13.009965 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:12.514932 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.018783  5024 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:13.019855  5024 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:13.029652  5002 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:12.968050  5020 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:13.041285 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 192682us
I20260709 12:24:13.051574 32106 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:13.055371  5015 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15.
I20260709 12:24:13.058971  5017 tablet_copy_client.cc:323] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.193:35273
W20260709 12:24:13.062834 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 170129us
I20260709 12:24:13.064034 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:13.030236  5002 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:13.066654 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 63492.4us
I20260709 12:24:13.068207  5002 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:13.073119  5013 raft_consensus.cc:2764] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:24:13.073525  5009 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:13.075359  4990 raft_consensus.cc:1081] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:13.076804 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:13.089660  4967 tablet_copy_client.cc:538] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:13.091684 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:13.092406 32111 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.093273  5034 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.093901  5034 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:13.098173 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 396592us
I20260709 12:24:13.107336 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:13.104956 31540 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:13.110857 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.113517 32109 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:13.120146  5012 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:13.125401  5012 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:13.131631  5012 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:13.124909  4989 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:13.145393 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:13.165468 32111 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:13.171121 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:13.180080 31433 tablet_copy_service.cc:140] P 0065979e5b9a477f8abf064563426291: Received BeginTabletCopySession request for tablet 08259dcf521e4914917a72febcb040d1 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:50108)
I20260709 12:24:13.180768 31433 tablet_copy_service.cc:161] P 0065979e5b9a477f8abf064563426291: Beginning new tablet copy session on tablet 08259dcf521e4914917a72febcb040d1 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:50108: session id = e166c1cb41f04d55a85e6c0d7966e32e-08259dcf521e4914917a72febcb040d1
I20260709 12:24:13.188648 31419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:13.189208 31419 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.189563 31419 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:13.141053  5010 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:13.192731 32110 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:13.227037 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:13.161579  5034 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:13.267661 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 73731.1us
I20260709 12:24:13.261072 31463 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:13.340246 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 79250.6us
W20260709 12:24:13.341429 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.341761  5013 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:13.342304  5013 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:13.343164  5013 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:13.349891  5009 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:13.352372 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:13.258780 31418 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:13.207664 32109 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:24:13.355965 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 83219.1us
I20260709 12:24:13.365746 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:13.363328 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 165279us
I20260709 12:24:13.379920 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:13.383837 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:13.358644 31419 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:13.387930 32110 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:24:13.390201 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:13.399196 31419 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:13.401005  4981 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:24:13.396236  4968 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:24:13.410717 31571 raft_consensus.cc:2410] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 13 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 12:24:13.414600 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.424947  4967 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:13.433745 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:13.434389 31569 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:13.436417  4978 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55794 (request call id 1276) took 1678 ms. Trace:
I20260709 12:24:13.436846  4978 rpcz_store.cc:276] 0709 12:24:11.758276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.758395 (+   119us) service_pool.cc:224] Handling call
0709 12:24:11.871548 (+113153us) ts_tablet_manager.cc:934] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
0709 12:24:12.530669 (+659121us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:12.994896 (+464227us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:12.995015 (+   119us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:13.435684 (+440669us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:13.435986 (+   302us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:13.436300 (+   314us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:13.436356 (+    56us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":11122,"tablet-copy.queue_time_us":112168,"thread_start_us":125918,"threads_started":2}
I20260709 12:24:13.438481  4978 tablet_copy_client.cc:806] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:13.438999  4978 tablet_copy_client.cc:670] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:13.442621 31569 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:13.444648 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:13.445214 31500 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:13.445488 31500 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:13.446266 31500 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:13.449451 31500 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:13.460099 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.465263 31492 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:24:13.465857 31500 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
W20260709 12:24:13.459136 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60351us
I20260709 12:24:13.468636 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:13.468680 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.471066 31498 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:24:13.478487 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64017.9us
I20260709 12:24:13.474797  5039 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:13.475769  4811 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:13.492393 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:13.492770 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.481797  4919 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:13.488559 31433 tablet_copy_source_session.cc:215] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:13.488829  4994 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.500358  4731 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:13.510373  4994 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:13.518733 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:13.491258  5018 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:24:13.507198  5034 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:13.503892  4811 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:13.517628  4994 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:13.521593  5020 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:13.550658 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57453.5us
I20260709 12:24:13.567910 32113 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:24:13.581574 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88862.1us
I20260709 12:24:13.554842  4969 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:24:13.608909 31499 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:13.586229  4811 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:13.620738  4933 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:13.616951  4972 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:24:13.614729  4980 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:24:13.626418  4989 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:13.683689 31573 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:13.714099 31494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:13.714895 31494 raft_consensus.cc:606] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:13.717036 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 97293.2us
I20260709 12:24:13.719529 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:13.721349 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:13.794451 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:13.797793  4978 tablet_copy_client.cc:538] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:13.868580 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:13.872673 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.927836 31565 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:13.919838 31315 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 16 to 18, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:13.953696  4731 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:13.964205  4981 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:13.964504 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48005.1us
I20260709 12:24:13.975955  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08259dcf521e4914917a72febcb040d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:14.090091 31321 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 292) took 1621 ms. Trace:
I20260709 12:24:14.092334  4978 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:14.096835 31492 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:14.090546 31321 rpcz_store.cc:276] 0709 12:24:12.468822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.468967 (+   145us) service_pool.cc:224] Handling call
0709 12:24:12.719248 (+250281us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5400002210. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663f0b2 00007fc11f5b8759 00007fc11f550a76 00007fc11f521d58 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc
0709 12:24:14.090024 (+1370776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:13.417535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:13.418102 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:13.418139 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:13.418157 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:13.418477 (+   320us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:13.418531 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:13.418556 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:13.418752 (+   196us) tablet.cc:701] Row locks acquired
0709 12:24:13.418765 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:24:13.418907 (+   142us) write_op.cc:270] Start()
0709 12:24:13.419009 (+   102us) write_op.cc:276] Timestamp: P: 1783599853418853 usec, L: 0
0709 12:24:13.419031 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:13.419689 (+   658us) log.cc:844] Serialized 539 byte log entry
0709 12:24:13.715292 (+295603us) op_driver.cc:464] REPLICATION: finished
0709 12:24:13.917588 (+202296us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b1800338c20. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:24:13.917746 (+   158us) write_op.cc:301] APPLY: starting
0709 12:24:13.917841 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:13.978440 (+ 60599us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:13.978466 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:13.979320 (+   854us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:13.979513 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:13.979564 (+    51us) write_op.cc:312] APPLY: finished
0709 12:24:13.979771 (+   207us) log.cc:844] Serialized 25 byte log entry
0709 12:24:13.979942 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.980026 (+    84us) write_op.cc:454] Released schema lock
0709 12:24:13.980067 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:13.980523 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.980555 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":269204,"reported_tablets":1,"spinlock_wait_cycles":5262592,"child_traces":[["op",{"apply.queue_time_us":134900,"apply.run_cpu_time_us":3465,"apply.run_wall_time_us":62739,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":387525,"prepare.run_cpu_time_us":22754,"prepare.run_wall_time_us":132494,"raft.queue_time_us":117865,"raft.run_cpu_time_us":29495,"raft.run_wall_time_us":40474,"replication_time_us":296108,"spinlock_wait_cycles":25151360,"thread_start_us":519136,"threads_started":4,"wal-append.queue_time_us":174630}]]}
I20260709 12:24:14.093714 31320 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 11 to 12, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:14.109670  4967 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:14.110997  4967 tablet_bootstrap.cc:492] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:14.111861  4967 ts_tablet_manager.cc:1403] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.687s	user 0.037s	sys 0.019s
I20260709 12:24:14.117276 31570 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:14.117532  5060 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:24:14.099958  4801 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:14.158349  4801 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:14.162197  5030 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:24:14.218722 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61141.8us
I20260709 12:24:14.230288 31570 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:24:14.239228  5068 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:14.244733  5039 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:24:14.253521  4801 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:14.264432  4967 raft_consensus.cc:359] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:14.265681  4967 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:14.287184  4972 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.312198 31496 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:24:14.315843  5070 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.196s	user 0.003s	sys 0.000s
I20260709 12:24:14.317986  5026 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:14.326056 32111 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:14.327097 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:14.327881 32113 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:14.331632 31320 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 319) took 1296 ms. Trace:
I20260709 12:24:14.307487  4972 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:14.340596  4972 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:14.340706 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:14.266580  4967 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:14.342324 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:14.341382 31569 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:14.342996 31499 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:14.350047 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:14.332033 31320 rpcz_store.cc:276] 0709 12:24:13.034766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.035105 (+   339us) service_pool.cc:224] Handling call
0709 12:24:14.331572 (+1296467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:14.200304 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:14.200849 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:14.200886 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:14.200906 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:14.201254 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:14.201331 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:14.201367 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:14.201547 (+   180us) tablet.cc:701] Row locks acquired
0709 12:24:14.201566 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:14.201710 (+   144us) write_op.cc:270] Start()
0709 12:24:14.201833 (+   123us) write_op.cc:276] Timestamp: P: 1783599854201659 usec, L: 0
0709 12:24:14.201854 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:14.202569 (+   715us) log.cc:844] Serialized 539 byte log entry
0709 12:24:14.230718 (+ 28149us) op_driver.cc:464] REPLICATION: finished
0709 12:24:14.234751 (+  4033us) write_op.cc:301] APPLY: starting
0709 12:24:14.234829 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:14.235599 (+   770us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:14.235694 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:14.236350 (+   656us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:14.236498 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:14.236542 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:14.236717 (+   175us) log.cc:844] Serialized 25 byte log entry
0709 12:24:14.236885 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:14.236967 (+    82us) write_op.cc:454] Released schema lock
0709 12:24:14.237004 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:14.237312 (+   308us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:14.237346 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17133,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":1250,"apply.run_cpu_time_us":2544,"apply.run_wall_time_us":2544,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":94221,"prepare.run_cpu_time_us":2624,"prepare.run_wall_time_us":18226,"replication_time_us":19634,"thread_start_us":79462,"threads_started":1}]]}
I20260709 12:24:14.355477  4967 ts_tablet_manager.cc:1434] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.243s	user 0.005s	sys 0.005s
I20260709 12:24:14.360888 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:14.385586  4937 raft_consensus.cc:993] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:14.386175  4937 raft_consensus.cc:1081] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:14.361657  4972 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:14.391069  4972 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.391415  4972 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:14.392892  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55792 (request call id 1250) took 1966 ms. Trace:
I20260709 12:24:14.393333  5017 rpcz_store.cc:276] 0709 12:24:12.426399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.426535 (+   136us) service_pool.cc:224] Handling call
0709 12:24:12.725109 (+298574us) ts_tablet_manager.cc:934] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
0709 12:24:13.971429 (+1246320us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:14.238848 (+267419us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:14.238994 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:14.392173 (+153179us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:14.392477 (+   304us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:14.392771 (+   294us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:14.392835 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":291,"tablet-copy.queue_time_us":42446,"thread_start_us":372425,"threads_started":2}
I20260709 12:24:14.357959 32109 raft_consensus.cc:1217] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Deduplicated request from leader. Original: 16.8->[16.9-16.9]   Dedup: 16.9->[]
W20260709 12:24:14.394869 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46884.7us
I20260709 12:24:14.401151 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-1ed13c6144834a9a9349865442585b12 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:24:14.401628 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-1ed13c6144834a9a9349865442585b12 on tablet 1ed13c6144834a9a9349865442585b12 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:14.403852 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:14.404500 32109 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:24:14.405498 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 43973.3us
I20260709 12:24:14.408685  4932 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:14.404994 31322 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 18 to 19, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 19 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.415506  4972 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:14.416695 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 55888.2us
I20260709 12:24:14.418265  4828 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:14.418648  4828 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:14.421563  4828 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:14.426847 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 66840.6us
I20260709 12:24:14.394626  5017 tablet_copy_client.cc:806] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.464790 31565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48862
I20260709 12:24:14.465420 31565 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.465770 31565 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:14.466118  5017 tablet_copy_client.cc:670] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.513198 31565 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:14.524910  4972 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:14.529495 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:14.530107 32113 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:14.543975 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:14.544608 31416 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:14.523126  4828 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:14.552652  4828 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:14.554013 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:14.554844 31569 raft_consensus.cc:2368] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:24:14.555986 31465 leader_election.cc:400] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:24:14.556288 31465 leader_election.cc:403] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:24:14.562840 31416 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:14.563979 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:14.565234  4970 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:14.565708  4970 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:14.546887 31565 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:14.572361 31322 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:14.582850 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:14.583500 31496 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:14.583923 32113 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:14.591377 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:14.566568  4970 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:14.595832  5081 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:14.597185  5085 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:24:14.600450 31322 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:14.602664 31322 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 13 to 15, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.605573 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:14.616917 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:14.617717 32106 raft_consensus.cc:2368] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:24:14.625528 31463 leader_election.cc:400] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:24:14.627267  5017 tablet_copy_client.cc:538] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:14.661376 31496 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:14.660107  5060 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:14.663409  5087 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14.
I20260709 12:24:14.682807  5060 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:14.683825  5060 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:14.704362 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48469.3us
I20260709 12:24:14.715621 31499 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:14.716068 31499 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:14.719137  5017 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:14.721323 31499 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:14.730793 31499 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:14.735308 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135834us
I20260709 12:24:14.746862 31499 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:14.777215 31574 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
W20260709 12:24:14.785890 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 180411us
I20260709 12:24:14.830951  5030 raft_consensus.cc:1064] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:14.835404 31315 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 13 to 14, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 14 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.844429  5030 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 7, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:14.908715 32113 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:14.909380 31565 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:14.911430 31418 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:14.918946  5087 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:14.921327 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57295.9us
I20260709 12:24:14.924793  4932 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:14.925616 31322 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.932591  5030 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:15.044317 31416 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:24:15.066356  5094 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:24:15.072602  4937 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:15.089794 31418 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:15.101382 31320 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.103708  4978 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.104911  4978 tablet_bootstrap.cc:492] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:15.105633  4978 ts_tablet_manager.cc:1403] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 1.014s	user 0.053s	sys 0.012s
I20260709 12:24:15.120886 31497 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:24:15.111945 31565 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:15.108709  4978 raft_consensus.cc:359] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:15.130582 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.128482  4978 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:15.139868  4970 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:15.139807  4978 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:15.170526 31322 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:15.176581  4978 ts_tablet_manager.cc:1434] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 12:24:15.178390 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-7e61fb74a676405696e2d0e6b9027efe received from {username='slave'} at 127.0.0.1:48102
I20260709 12:24:15.178805 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-7e61fb74a676405696e2d0e6b9027efe on tablet 7e61fb74a676405696e2d0e6b9027efe with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:15.230182 32106 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:24:15.234532  5038 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:24:15.275291 31499 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:24:15.282044 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:15.282670 31416 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:15.304206 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:15.304870 31416 raft_consensus.cc:606] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:15.281368  5096 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:24:15.328199 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:15.328786 31416 raft_consensus.cc:606] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:15.332147 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:15.334226 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:15.376154 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 107976us
I20260709 12:24:15.374045 32106 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:15.435312  5104 log.cc:927] Time spent T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:24:15.483186  5017 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.484383  5017 tablet_bootstrap.cc:492] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:15.485178  5017 ts_tablet_manager.cc:1403] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.771s	user 0.037s	sys 0.030s
I20260709 12:24:15.489213 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.512171 32106 raft_consensus.cc:1217] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEARNER]: Deduplicated request from leader. Original: 12.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 12:24:15.620108  5017 raft_consensus.cc:359] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:15.621206  5017 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
W20260709 12:24:15.630218 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 82995.3us
W20260709 12:24:15.644393 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95004.2us
I20260709 12:24:15.628273  5017 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:24:15.714035 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62406.3us
W20260709 12:24:15.716396 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 67577.7us
W20260709 12:24:15.721968 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 146174us
W20260709 12:24:15.772959 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57751.3us
W20260709 12:24:15.780990 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59383.9us
W20260709 12:24:15.793123 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 74440.4us
W20260709 12:24:15.829629 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 46764.7us
W20260709 12:24:15.896747 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 65001.8us
W20260709 12:24:15.901757 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 179941us
W20260709 12:24:15.899160  5112 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:15.969017 32113 raft_consensus.cc:1217] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:24:15.964593  5017 ts_tablet_manager.cc:1434] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.479s	user 0.012s	sys 0.004s
W20260709 12:24:15.990309  5017 ts_tablet_manager.cc:1467] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Tablet startup took 504ms
W20260709 12:24:16.068634 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 150287us
W20260709 12:24:16.011250  5017 ts_tablet_manager.cc:1469] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Trace:
0709 12:24:12.426399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.426535 (+   136us) service_pool.cc:224] Handling call
0709 12:24:12.725109 (+298574us) ts_tablet_manager.cc:934] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273)
0709 12:24:13.971429 (+1246320us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:14.238848 (+267419us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:14.238994 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:14.392173 (+153179us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:14.392477 (+   304us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:14.392771 (+   294us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:14.392835 (+    64us) inbound_call.cc:177] Queueing success response
0709 12:24:14.714379 (+321544us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:15.485556 (+771177us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:15.486092 (+   536us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:15.486662 (+   570us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":291,"mutex_wait_us":21544,"raft.queue_time_us":32515,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":23970,"tablet-copy.queue_time_us":42446,"tablet-download-pool.queue_time_us":1311,"tablet-download-pool.run_cpu_time_us":1394,"tablet-download-pool.run_wall_time_us":128599,"thread_start_us":372425,"threads_started":2}
W20260709 12:24:16.089433 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 166245us
W20260709 12:24:16.107652  5116 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.262s	user 0.003s	sys 0.000s
I20260709 12:24:16.145820  5024 raft_consensus.cc:993] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:16.146319  5024 raft_consensus.cc:1081] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:16.196949 31433 tablet_copy_service.cc:342] P 0065979e5b9a477f8abf064563426291: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-08259dcf521e4914917a72febcb040d1 received from {username='slave'} at 127.0.0.1:50108
I20260709 12:24:16.197470 31433 tablet_copy_service.cc:434] P 0065979e5b9a477f8abf064563426291: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-08259dcf521e4914917a72febcb040d1 on tablet 08259dcf521e4914917a72febcb040d1 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:16.228767 31500 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:16.232477 31492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:16.233137 31492 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:16.233528 31492 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:16.242312 31492 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:16.274286 31574 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:16.284911 31492 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:16.289086 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:16.289671 31574 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:16.297911 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:16.298497 31416 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:16.298803 31416 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:16.285496  5136 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:24:16.306419 31574 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:16.308199 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:16.309626 31416 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:16.313166 31416 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:24:16.313594  5018 consensus_queue.cc:1175] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 10 } }
I20260709 12:24:16.329511  4811 raft_consensus.cc:993] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:16.330229  4811 raft_consensus.cc:1081] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:16.333989  5118 raft_consensus.cc:993] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:16.334486  5118 raft_consensus.cc:1081] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:16.336057 31492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:16.336596 31492 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:16.336910 31492 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:16.343182  5127 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:16.343778  5127 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:16.344570  5127 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:16.354050  5087 raft_consensus.cc:1064] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:16.353026 31492 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:16.367571 31571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:16.368186 31571 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:16.368508 31571 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:16.369902 31416 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:16.371981 32107 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:16.375276  5128 raft_consensus.cc:1064] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:24:16.375695  5128 raft_consensus.cc:1068] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Unable to promote non-voter e166c1cb41f04d55a85e6c0d7966e32e: Service unavailable: leader transfer in progress
I20260709 12:24:16.385368  5087 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 5, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:16.395253  5115 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:16.406898 31492 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:16.410794 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:16.411563 31565 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:16.423741 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:16.424304 31415 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:16.424580 31415 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:16.435274 31565 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:16.440681 31492 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:16.421870 31571 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:16.442639 31465 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:16.478344 31571 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:16.497394  5090 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:16.498032  5090 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:16.499034  5090 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:16.535964 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:16.536705 31499 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:16.548847 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73161.6us
I20260709 12:24:16.558041 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:16.558660 31421 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:16.558957 31421 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:16.470494 31415 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:16.569665 31415 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:16.591346  5108 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:16.597915 31421 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:16.596096 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 47901.5us
I20260709 12:24:16.630342 31421 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:16.615427 32113 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:16.673506 31499 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:16.676842 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:16.682626 31421 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
W20260709 12:24:16.635097  5141 consensus_queue.cc:1175] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b6bc3d9dbfb44e81b63071002a011f71" responder_term: 14 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:16.702577  5126 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:16.744050  5126 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:16.745008  5126 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:16.728048 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53923.8us
I20260709 12:24:16.739295 31415 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:24:16.788849 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 139765us
W20260709 12:24:16.821589  5149 log.cc:927] Time spent T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:24:16.815990  5148 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:24:16.904821 31569 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:16.924624 31569 raft_consensus.cc:2955] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:16.957381 31321 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:16.969571 31415 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:17.003997 31569 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:16.930944  5154 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:24:17.022537 32107 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEARNER]: Advancing to term 14
I20260709 12:24:17.022727  5139 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:17.025060 32113 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:24:17.030447 32107 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:24:17.062631 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58680.8us
I20260709 12:24:17.063829 31320 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 10 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:17.078263 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 98351.6us
W20260709 12:24:17.082625 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 114996us
I20260709 12:24:17.089529 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ed13c6144834a9a9349865442585b12 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.103394 31417 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:17.077469  5153 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:24:17.188301 31421 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:17.190554 31315 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.194408  5153 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:24:17.217724 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:17.203915  5033 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:24:17.295399 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 60610.1us
I20260709 12:24:17.299693 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:17.315392 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 44042.8us
W20260709 12:24:17.320838 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 99430.1us
W20260709 12:24:17.342931 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70762.9us
W20260709 12:24:17.353541  5166 log.cc:927] Time spent T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:17.342499  5153 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:24:17.342741  5164 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:17.357451  5164 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:17.360030  5164 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:17.368175 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:17.369076 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:17.370805 31421 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:17.374354  5053 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:17.378932 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:17.476421 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 63242.1us
I20260709 12:24:17.442371  5157 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:17.480402  5170 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:17.580741  5090 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:24:17.578517  5115 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 12:24:17.671128 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49958.2us
I20260709 12:24:17.691956 31417 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:17.704439  5178 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:17.743808 31491 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:24:17.742058 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 153729us
I20260709 12:24:17.760986 32110 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:17.791085  5108 raft_consensus.cc:1064] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:17.793311  5108 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:17.817363  5039 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:17.818055  5039 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:17.823277 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:17.822516  5039 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:17.843550 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:17.845175 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:17.849274 31387 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:17.849750 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed13c6144834a9a9349865442585b12 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:17.859020 31320 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 13 to 14, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:17.905320 31565 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:17.881464  5128 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:17.913841  5125 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:24:17.958923 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:17.959555 31417 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:17.959890 31417 raft_consensus.cc:614] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:17.995702  5195 tablet_replica.cc:333] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:17.996891  5195 raft_consensus.cc:2243] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.997906  5195 raft_consensus.cc:2272] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.000726 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:18.001638 31417 raft_consensus.cc:606] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:18.037856 31499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:18.051477  5195 ts_tablet_manager.cc:1916] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.052608 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:18.053215 31417 raft_consensus.cc:606] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:18.066461 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:18.068222 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:18.069005 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:18.068364 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106838us
I20260709 12:24:18.107364 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:18.110921 31322 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.115469 31417 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:18.131018 32110 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:18.132000  5186 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:18.141083 31499 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:18.150157  4937 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:18.186372  5136 raft_consensus.cc:993] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:18.195398  4937 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:18.192345  5108 raft_consensus.cc:1081] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:18.199844 31417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:18.200377 31417 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.200698 31417 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:18.202731  5108 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 8 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.230765 31499 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.237198 32107 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.239692 31415 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:18.241441  5136 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:18.243820  5195 ts_tablet_manager.cc:1929] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 12:24:18.248728 32111 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:18.283671  5195 log.cc:1199] T 1ed13c6144834a9a9349865442585b12 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/1ed13c6144834a9a9349865442585b12
I20260709 12:24:18.284039  5185 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:18.259058  5186 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.260842 31421 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.289717 32107 raft_consensus.cc:2955] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.295382 31492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:18.295980 31492 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Received request to transfer leadership
I20260709 12:24:18.295918 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 1ed13c6144834a9a9349865442585b12 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
W20260709 12:24:18.300645 31307 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 08259dcf521e4914917a72febcb040d1 already in progress [suppressed 12 similar messages]
I20260709 12:24:18.276273 31322 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 8 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.257500 31417 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.309387 31418 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:18.312942  5185 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:18.313757  5108 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:18.314167  5108 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:18.315146  5108 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.316546  5108 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:18.322350 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e61fb74a676405696e2d0e6b9027efe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:18.323040 31492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:18.323724 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:18.326557 31492 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Received request to transfer leadership
I20260709 12:24:18.326969 31492 raft_consensus.cc:614] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:18.334491 31320 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 8 to 9, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:18.342319 31370 auto_rebalancer.cc:893] Removing replace marker failed: Replica b6bc3d9dbfb44e81b63071002a011f71 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:18.342799 31370 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:24:18.343079 31370 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:24:18.348990 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:18.349624 32107 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:18.350651 31574 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.354915 31417 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:18.366655 32107 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:18.367668 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:18.379098  5018 raft_consensus.cc:993] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:18.379679  5018 raft_consensus.cc:1081] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:18.381148 31491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:18.381670 31491 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.381989 31491 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.389031 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e61fb74a676405696e2d0e6b9027efe with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33962
I20260709 12:24:18.414662 31491 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.435869 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:18.436524 31417 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:18.436934 31417 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:18.439903  5206 tablet_replica.cc:333] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:24:18.440570 31491 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:18.440209 31417 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.442831 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:18.442057 31417 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.443394 32111 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.449963 31417 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:18.451082 31499 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:18.452028 32111 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:18.453099 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:18.454180  5185 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:18.454720  5185 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:18.455686  5185 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.458221  5206 raft_consensus.cc:2243] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.459017 31390 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:18.459342  5206 raft_consensus.cc:2272] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.460368  5018 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:18.461679  5018 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:18.462634  5018 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.478361 31322 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 10 to 8, term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.491643  5206 ts_tablet_manager.cc:1916] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.524979 31321 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 8 to 10, term changed from 15 to 14, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:18.534312 31322 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.564008  5164 raft_consensus.cc:993] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:18.571070  4988 raft_consensus.cc:1081] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
W20260709 12:24:18.579797 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65844.7us
I20260709 12:24:18.581892 31499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:18.582437 31499 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.582793 31499 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.587621 31499 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.593425 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:18.593802 31499 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:18.593968 32111 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.597302 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:18.597869 31417 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:18.598157 31417 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:18.601219 31417 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.602084 31417 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:18.602649 32111 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:18.604357 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:18.606911  5206 ts_tablet_manager.cc:1929] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 12:24:18.607381  5206 log.cc:1199] T 7e61fb74a676405696e2d0e6b9027efe P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/7e61fb74a676405696e2d0e6b9027efe
I20260709 12:24:18.609041 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 7e61fb74a676405696e2d0e6b9027efe (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:18.612701  5108 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:18.613284  5108 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:18.614113  5108 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:18.624797 31417 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:18.656950 31322 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.897220 32111 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:24:18.899029  5185 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:19.022837 32107 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:19.051978  4988 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:19.085533 31417 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:19.085721 31500 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:19.097553  5214 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:19.108891  5018 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:24:19.116163 32113 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:19.140450  5186 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:19.142808  5215 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Committing config change with OpId 14.10: config changed from index 8 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:19.148265 31421 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:24:19.151401 31322 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:19.152539  5186 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:19.161979 31574 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:19.290849 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 83466.4us
I20260709 12:24:19.317147 31574 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:24:19.367926 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 77720us
I20260709 12:24:19.372972  5213 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:19.497110 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.776904 31567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:19.777810 31567 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:19.784195 31500 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:19.784837 31500 raft_consensus.cc:606] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:19.789748 31494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:19.790431 31494 raft_consensus.cc:606] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:19.791977 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:19.793874 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:19.794886 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.800750  5199 raft_consensus.cc:993] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:19.801270  5199 raft_consensus.cc:1081] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:19.804625 31417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:24:19.805332 31417 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.805769 31417 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:19.874598  5186 raft_consensus.cc:993] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:19.875373  5234 raft_consensus.cc:1081] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:19.882921 31421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:19.883522 31421 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.883868 31421 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:19.902264 31567 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:19.948873 31416 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:19.967760 32108 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:19.972085  5209 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:19.996450 31417 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:20.004635 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:20.004897 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:20.005534 31566 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:20.005856 31566 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:20.006744 31566 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:20.006125  5164 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:20.008025 31566 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:20.021793  5223 raft_consensus.cc:993] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:20.022344  5229 raft_consensus.cc:1081] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:20.023140 31566 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:20.036185 32111 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:20.065915 31415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:20.066596 31415 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.066979 31415 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:20.019101 31421 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:20.083514 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:20.084070 31421 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:20.084184 31494 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:20.084726 31494 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:20.085551 31494 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:20.086501 31494 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:20.100611 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 85331.7us
I20260709 12:24:20.106763  5228 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:20.110528 31494 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:20.113885 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:20.115747  5209 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:20.120743  5209 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:20.126318  5209 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:20.134430 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 82780.4us
I20260709 12:24:20.145548 31417 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:20.178141 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:20.179453  5228 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:20.180224  5228 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:20.167812 31415 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:20.213714 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:20.214325 31567 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:20.222018 31415 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:20.221315 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:20.235276 31500 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:20.235736 31500 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:20.235823 31320 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 13 to 14, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 14 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.236847 31500 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:20.238134 31500 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:20.235543 31418 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:20.249617 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:20.250231 31566 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:20.250509 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:20.251032 32111 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:20.255375 31567 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:20.249778 31570 raft_consensus.cc:2955] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:20.262020 31566 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:20.267343 31566 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:20.278426 31494 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:24:20.181280  5228 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:20.297436 32111 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:20.345247 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08259dcf521e4914917a72febcb040d1 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:20.353149 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 94761.6us
I20260709 12:24:20.310488  5199 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:24:20.359639 31500 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:20.380060 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:20.389962  5201 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:20.398874  5244 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:20.399528  5244 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:20.400491  5244 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:20.410786 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 64656.7us
W20260709 12:24:20.394485 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88216.2us
I20260709 12:24:20.489634 31315 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 10 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:20.553159 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55263.3us
I20260709 12:24:20.562048  5264 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.575385 31566 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:24:20.587085  5209 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:20.588101 31500 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.593817 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 08259dcf521e4914917a72febcb040d1 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:20.596815 31418 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.637770  5269 tablet_replica.cc:333] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:24:20.638046 31492 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:20.638928  5269 raft_consensus.cc:2243] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:20.622097 31537 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8f83500bdaf49a8ac53bb5ba49c3529. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:20.646165 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 43508.9us
I20260709 12:24:20.650604  5269 raft_consensus.cc:2272] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:20.648025 31315 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 10, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.652853 31320 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 17 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.656244 31320 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 19 to 20, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 20 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.718623 31499 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:24:20.726513  5164 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:20.735949 31463 consensus_peers.cc:597] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68a65ccf8d5e42c1aa51a8761a850dd7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:20.742475 31570 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:20.745007  5258 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:20.760985 31567 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:20.777822 31418 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:20.780838  5229 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:20.783154  5261 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:20.793555  5274 ts_tablet_manager.cc:933] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:20.793607  5229 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.817078 32110 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:20.833819  5244 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:20.828819 31567 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.848637  5269 ts_tablet_manager.cc:1916] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:20.879796 31315 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.889719 31492 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:20.903638 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:20.907111  5269 ts_tablet_manager.cc:1929] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:24:20.907776  5269 log.cc:1199] T 08259dcf521e4914917a72febcb040d1 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/08259dcf521e4914917a72febcb040d1
I20260709 12:24:20.869647  5274 tablet_copy_client.cc:323] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:24:20.911108 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 08259dcf521e4914917a72febcb040d1 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:20.913519 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet b8f83500bdaf49a8ac53bb5ba49c3529 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:24:20.914220 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet b8f83500bdaf49a8ac53bb5ba49c3529 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-b8f83500bdaf49a8ac53bb5ba49c3529
I20260709 12:24:20.916898 31500 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:20.924397 31418 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:20.925848  5228 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:20.925858  5223 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:20.929793 31585 tablet_copy_source_session.cc:215] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:20.965775 31565 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:24:20.973987  5274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f83500bdaf49a8ac53bb5ba49c3529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:20.982075 31419 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:20.999289  5258 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:21.045604 31565 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:24:21.052003 31419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:21.052960 31419 raft_consensus.cc:606] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:21.092531  5209 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:24:21.098196 31463 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41d7370a77bc48eaaa344ded5091445b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:21.128525  5234 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.134213 31419 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
W20260709 12:24:21.141148 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 61715.3us
I20260709 12:24:21.166635  5244 raft_consensus.cc:993] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:21.167645  5244 raft_consensus.cc:1081] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:21.221062 31567 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.258273  5274 tablet_copy_client.cc:806] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:21.259030  5274 tablet_copy_client.cc:670] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:21.264509  5274 tablet_copy_client.cc:538] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:21.269789 31315 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.275414 31567 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:21.298534  5274 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
W20260709 12:24:21.318475 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 174893us
I20260709 12:24:21.330102 31574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341ae51396d44edeba0872b9567766e7"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:21.336946 31574 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.337381 31574 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:21.341104 31499 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:21.346124 31419 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:21.348552  5264 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:21.350482  5264 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:21.346128 31574 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.368651 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:21.369393 31419 raft_consensus.cc:3055] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:21.369745 31419 raft_consensus.cc:740] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:21.370638 31419 consensus_queue.cc:260] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.375479 31419 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:21.392653 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:21.393280 32114 raft_consensus.cc:3060] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:21.393472 31574 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:21.401463 32114 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
W20260709 12:24:21.402071 31537 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19ad016bcdfe4c62a610fe4974bc52c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:21.413527  5265 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.415280 31421 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.416411 31537 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:21.421095  5201 raft_consensus.cc:2804] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:21.421577  5201 raft_consensus.cc:697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:21.422364  5201 consensus_queue.cc:237] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.427248 31419 raft_consensus.cc:2468] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:21.440882 31320 catalog_manager.cc:5697] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 19 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.449525  5274 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:21.450523  5274 tablet_bootstrap.cc:492] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:21.451263  5274 ts_tablet_manager.cc:1403] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.153s	user 0.035s	sys 0.010s
I20260709 12:24:21.453622 31574 raft_consensus.cc:1240] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:21.456879 31499 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.464582  5302 ts_tablet_manager.cc:933] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:21.482337  5302 tablet_copy_client.cc:323] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:24:21.485308 31320 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 9, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:21.487923 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:24:21.488533 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 68a65ccf8d5e42c1aa51a8761a850dd7 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-68a65ccf8d5e42c1aa51a8761a850dd7
I20260709 12:24:21.454212  5274 raft_consensus.cc:359] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:21.491241  5274 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:21.491991  5274 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:21.508857 31510 tablet_copy_source_session.cc:215] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:21.510295 31419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:21.510932 31419 raft_consensus.cc:606] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:21.519484  5274 ts_tablet_manager.cc:1434] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:24:21.519814  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a65ccf8d5e42c1aa51a8761a850dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.528240 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-b8f83500bdaf49a8ac53bb5ba49c3529 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:21.528772 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-b8f83500bdaf49a8ac53bb5ba49c3529 on tablet b8f83500bdaf49a8ac53bb5ba49c3529 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:21.533973  5274 ts_tablet_manager.cc:933] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:21.569643 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:21.571421 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:21.572320 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.602766  5274 tablet_copy_client.cc:323] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.194:40303
I20260709 12:24:21.605590 31510 tablet_copy_service.cc:140] P b6bc3d9dbfb44e81b63071002a011f71: Received BeginTabletCopySession request for tablet 41d7370a77bc48eaaa344ded5091445b from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:48102)
I20260709 12:24:21.606056 31510 tablet_copy_service.cc:161] P b6bc3d9dbfb44e81b63071002a011f71: Beginning new tablet copy session on tablet 41d7370a77bc48eaaa344ded5091445b from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:48102: session id = e166c1cb41f04d55a85e6c0d7966e32e-41d7370a77bc48eaaa344ded5091445b
I20260709 12:24:21.622802 31510 tablet_copy_source_session.cc:215] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:21.639031  5302 tablet_copy_client.cc:806] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:21.642380  5302 tablet_copy_client.cc:670] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:21.646157  5274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d7370a77bc48eaaa344ded5091445b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.655082  5302 tablet_copy_client.cc:538] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:21.719770  5302 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:21.741259  5274 tablet_copy_client.cc:806] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:21.762972  5274 tablet_copy_client.cc:670] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:21.770767  5274 tablet_copy_client.cc:538] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:21.799808  5274 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:21.804244 32114 raft_consensus.cc:1217] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:24:21.867995  5302 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:21.868991  5302 tablet_bootstrap.cc:492] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:21.869791  5302 ts_tablet_manager.cc:1403] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.150s	user 0.029s	sys 0.005s
I20260709 12:24:21.873027  5302 raft_consensus.cc:359] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:21.873904  5302 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:21.874992  5302 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:21.878975  5302 ts_tablet_manager.cc:1434] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 12:24:21.880712 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-68a65ccf8d5e42c1aa51a8761a850dd7 received from {username='slave'} at 127.0.0.1:48102
I20260709 12:24:21.881091 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-68a65ccf8d5e42c1aa51a8761a850dd7 on tablet 68a65ccf8d5e42c1aa51a8761a850dd7 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:21.909449  5228 raft_consensus.cc:993] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:21.910199  5228 raft_consensus.cc:1081] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:21.912827 31494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:21.913360 31494 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:21.913666 31494 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:21.915808  5302 ts_tablet_manager.cc:933] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:21.924113 31494 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.932117 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:21.932775 31421 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:21.933064 31421 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:21.933878 31421 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.932947 31494 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:21.935108 31421 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:21.939376 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:21.939926 32107 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:21.945381  5302 tablet_copy_client.cc:323] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:24:21.949393 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet 19ad016bcdfe4c62a610fe4974bc52c2 from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:24:21.949733 31421 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:21.949993 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet 19ad016bcdfe4c62a610fe4974bc52c2 from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-19ad016bcdfe4c62a610fe4974bc52c2
I20260709 12:24:21.955173 32107 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:21.956177 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:21.957043  5306 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:21.957566  5306 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:21.958436  5306 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:21.961820 31585 tablet_copy_source_session.cc:215] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:21.981482  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19ad016bcdfe4c62a610fe4974bc52c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:21.965071 32107 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:21.985798  5265 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:22.061352  5274 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:22.072188 31320 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 13 to 14, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:22.085640  5274 tablet_bootstrap.cc:492] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:22.086373  5274 ts_tablet_manager.cc:1403] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.287s	user 0.036s	sys 0.004s
I20260709 12:24:22.093461  5274 raft_consensus.cc:359] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:22.094131  5274 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:22.094630  5274 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
W20260709 12:24:22.091066 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 74711.8us
I20260709 12:24:22.099362 32114 raft_consensus.cc:1217] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:24:22.115391  5274 ts_tablet_manager.cc:1434] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:24:22.120270 31419 raft_consensus.cc:1275] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:24:22.129163  5311 consensus_queue.cc:1048] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:22.171938 31510 tablet_copy_service.cc:342] P b6bc3d9dbfb44e81b63071002a011f71: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-41d7370a77bc48eaaa344ded5091445b received from {username='slave'} at 127.0.0.1:48102
I20260709 12:24:22.173053 31510 tablet_copy_service.cc:434] P b6bc3d9dbfb44e81b63071002a011f71: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-41d7370a77bc48eaaa344ded5091445b on tablet 41d7370a77bc48eaaa344ded5091445b with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:22.175866  5302 tablet_copy_client.cc:806] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:22.207384  5302 tablet_copy_client.cc:670] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:22.212039  5302 tablet_copy_client.cc:538] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:24:22.226591 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45507.9us
I20260709 12:24:22.254869  5315 raft_consensus.cc:1064] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:22.254930 32110 raft_consensus.cc:1217] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:24:22.264236  5315 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:22.267658  5302 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:22.320217 31421 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:22.323189 31494 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:22.336297  5201 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:22.337514 32110 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:22.340036  5315 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:24:22.364033  5201 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:22.418756  5310 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.423355 31419 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.440527 32110 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.461412 31492 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.478055 31419 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:22.478430 31322 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 10 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.480572  5306 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:22.504330 31570 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:22.515720 31421 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:22.519387 32110 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:22.525868  5306 raft_consensus.cc:1064] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:22.531327  5264 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:22.528752  5306 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:22.554100  5264 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.562198 31421 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:22.568166  5315 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:22.570139 31570 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:22.573555  5223 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.575719 31421 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.584463 32110 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:24:22.586059 32110 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:22.592311  5306 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:22.594619  5306 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.596186  5223 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:22.602170 32110 raft_consensus.cc:2955] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.651760  5223 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.672991 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.685343 31322 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:22.687271 32108 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.691605 31415 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.707746 31574 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:22.738251 31320 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 9 to 10, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:22.744874 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59734.8us
I20260709 12:24:22.782294  5302 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:22.783550  5302 tablet_bootstrap.cc:492] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:22.789598  5302 ts_tablet_manager.cc:1403] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 0.522s	user 0.043s	sys 0.008s
I20260709 12:24:22.791952 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f83500bdaf49a8ac53bb5ba49c3529 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40804
W20260709 12:24:22.805872 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 168439us
I20260709 12:24:22.806852 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8f83500bdaf49a8ac53bb5ba49c3529 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:22.873392  5335 raft_consensus.cc:1064] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:22.888675  5335 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:22.914345 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 137510us
I20260709 12:24:22.943894  5302 raft_consensus.cc:359] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:22.944780  5302 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:22.947788  5302 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:22.956099  5302 ts_tablet_manager.cc:1434] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.166s	user 0.007s	sys 0.000s
I20260709 12:24:22.971027  5345 tablet_replica.cc:333] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:24:23.197389 32107 raft_consensus.cc:1217] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 12:24:23.283493 31567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:23.284173 31567 raft_consensus.cc:606] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:23.268290 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 194285us
I20260709 12:24:23.358892 31492 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:23.411417 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 163072us
I20260709 12:24:23.431627  5345 raft_consensus.cc:2243] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:23.432572  5345 raft_consensus.cc:2272] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:23.449716  5345 ts_tablet_manager.cc:1916] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:23.469575 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52279.2us
W20260709 12:24:23.479933 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 151670us
I20260709 12:24:23.480912 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:23.483420 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:23.484342 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:23.483690 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 129177us
I20260709 12:24:23.500875 32108 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 LEARNER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:24:23.505688 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.016s
W20260709 12:24:23.506070 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.000s	sys 0.016s
I20260709 12:24:23.509997 32107 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:23.518095  5358 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:23.596312 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 229138us
W20260709 12:24:23.705802 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 219444us
I20260709 12:24:23.528427  5223 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
W20260709 12:24:23.725237 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 234195us
I20260709 12:24:23.731663 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-19ad016bcdfe4c62a610fe4974bc52c2 received from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:23.749148 31569 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:23.749233 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-19ad016bcdfe4c62a610fe4974bc52c2 on tablet 19ad016bcdfe4c62a610fe4974bc52c2 with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:23.765924  5356 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:23.766805  5356 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:23.769722  5356 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:23.783648 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 307009us
W20260709 12:24:23.803099 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 71995.2us
W20260709 12:24:23.809016 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53286.4us
W20260709 12:24:23.815198 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 59874.6us
W20260709 12:24:23.819733  5351 log.cc:927] Time spent T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.334s	user 0.000s	sys 0.003s
W20260709 12:24:23.825305 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87636.5us
I20260709 12:24:23.838404 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:23.855629 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.009s	sys 0.037s
W20260709 12:24:23.856021 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.010s	sys 0.037s
W20260709 12:24:23.856302 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 908778us
I20260709 12:24:23.874931  5346 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:23.909758 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75674.4us
I20260709 12:24:23.935141 31415 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:23.878634  5346 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:23.936360  5372 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:24.046840 31415 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:24:24.076334 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 135670us
I20260709 12:24:24.089964 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.044263  5346 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.106730 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.099107  5264 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.242731  5337 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.243398  5337 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.105952  5346 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:24.312618  5345 ts_tablet_manager.cc:1929] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:24:24.315711  5345 log.cc:1199] T b8f83500bdaf49a8ac53bb5ba49c3529 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/b8f83500bdaf49a8ac53bb5ba49c3529
I20260709 12:24:24.317929  5345 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40804 (request call id 9) took 1532 ms. Trace:
I20260709 12:24:24.390565  5348 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.391425  5348 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.269083  5264 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.362710  5346 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.394498  5380 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:24.319965  5345 rpcz_store.cc:276] 0709 12:24:22.785304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.785421 (+   117us) service_pool.cc:224] Handling call
0709 12:24:22.970538 (+185117us) ts_tablet_manager.cc:1151] Deleting tablet b8f83500bdaf49a8ac53bb5ba49c3529
0709 12:24:22.970622 (+    84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:24.301119 (+1330497us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:24.312431 (+ 11312us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:24.317823 (+  5392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112116,"tablet-delete.queue_time_us":177896,"thread_start_us":160019,"threads_started":1}
I20260709 12:24:24.395809  5291 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.480122  5354 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.480959  5354 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.485018  5337 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.463687  5377 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:24.486508  5377 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.491019 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.493220 32108 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:24.503866 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.511152  5381 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.493920  5223 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.553133  5223 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.555233  5387 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.555859  5387 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.556944  5223 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.557359  5357 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.557902  5357 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.558914  5382 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:24.560256  5379 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.560775  5379 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.562667  5369 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.562839  5386 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.563254  5369 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.563562  5386 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.557853 31315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 330) took 1092 ms. Trace:
I20260709 12:24:24.570894 31315 rpcz_store.cc:276] 0709 12:24:23.465138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.465297 (+   159us) service_pool.cc:224] Handling call
0709 12:24:24.557757 (+1092460us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":2944}
I20260709 12:24:24.608438  5369 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.515069  5380 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.493080  5291 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.608446  5377 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.617489 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:24.647001 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 130682us
I20260709 12:24:24.616593  5264 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.651702  5344 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:24.654328  5291 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.655123 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.655946 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.658224  5380 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.660414 31421 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:24.661775 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.628340  5386 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:24.660801 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.004s
W20260709 12:24:24.665421 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.005s
W20260709 12:24:24.666016 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 554379us
I20260709 12:24:24.666114 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.666970 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.624099  5354 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.547353  5381 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.671988 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.673334 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.673821  5381 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.624990  5348 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.674774  5388 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.675308  5388 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.677445  5388 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.678045  5385 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.678586  5385 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.621229  5346 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.682452  5362 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.683022  5362 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.685359  5362 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.641666  5357 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.686794  5362 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.687366  5362 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.688038  5234 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.640743  5387 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.688665  5234 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.698872 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.699478 31497 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:24.700263  5234 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.700511 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.701843 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet b8f83500bdaf49a8ac53bb5ba49c3529 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:24.702818 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.703433 31493 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:24.705226 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.691785  5362 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.692687  5380 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:24.706507  5380 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.708705  5380 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.693244 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:24.693679 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.649147  5369 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.680784  5385 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.710565  5380 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:24.624176  5379 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.698254 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.711179  5380 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.711920  5380 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:24.710532  5369 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.713689  5369 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.716627 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.716981 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.722293 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.722975 31574 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:24.723963  5265 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.724510  5265 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.726445  5265 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.722352 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:24.743664 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68744.2us
W20260709 12:24:24.743891 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 75884.4us
I20260709 12:24:24.742825  5311 raft_consensus.cc:993] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:24.748005  5311 raft_consensus.cc:1081] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:24.748088 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.752172 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.754118 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.755016 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.756623 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.755074 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.759109 31568 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:24.775074 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.776235 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.776834 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.777817 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.778298 31574 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:24:24.779045 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.780233 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.782612  5348 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.783133  5348 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.785032  5348 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.785493  5348 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.785925  5348 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.788414 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.789078 31421 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:24.791836 31390 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:24.808650 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.810248  5395 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.810916  5395 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.813288  5395 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.797619  5348 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.790444  5380 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.831652 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.806450 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.807467 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.832974  5380 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.833618  5380 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:24.814851  5310 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:24.836376  5310 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.838541  5310 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:24.817233  5291 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:24.839200  5316 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.839906  5316 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:24.842346  5316 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.826146 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:24.827257 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.843271  5335 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:24.843629  5335 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.843868 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.829242 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.830524 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.845570  5256 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:24.834457 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 178845us
I20260709 12:24:24.834802  5347 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:24.849987  5347 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.852125  5347 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:24.807580 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.852839 32108 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:24.835567 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:24.839293  5291 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.855832 32080 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:24.824862 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.844059  5335 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:24.856603  5389 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:24.857005  5389 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.824820 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.857376  5389 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:24.855909  5291 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:24.863583 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.865299 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.869757 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.870077 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.870219 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.870983 31419 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:24.874155  5291 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.880017 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:24.828018 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.881986  5347 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:24.882958 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55037.5us
I20260709 12:24:24.883805  5291 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.885504 31417 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:24.887253 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.888105 31389 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.889179  5347 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:24.889549  5347 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:24.889786  5348 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:24.889952  5347 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:24.890921 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.891494 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:24.883944  5335 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.894302 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.890373  5348 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.896325 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.896673  5348 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.898509 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.903316 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.903414  5347 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.905380 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:24.905735 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.905007 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:24.906524  5335 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:24.907306 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.908653 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:24.909915 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:24.955652 32113 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:24.910175 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:24.918118 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:24.928432 31322 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.930907 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:24.932032 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.935623  5310 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:24.958215 31416 raft_consensus.cc:2393] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:24.958521  5310 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:24.958847 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.960064  5316 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:24.960203 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.878000  5389 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:24.952661  5397 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:24.958952  5310 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:24.963585  5310 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:24.936406 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.960728  5316 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:24.962113  5291 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:24.965651  5394 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:24.967875 32113 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:24.972316  5310 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:24.975497 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.976637 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.977453  5378 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:24.978080  5378 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:24.979423 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.979681 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.980268  5394 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:24.980505  5316 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:24.980926 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.981724  5316 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:24.982085 31387 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.983486 31387 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.986759 31419 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:24.984562 31569 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:24.984206 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:24.988903 31389 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.989913  5291 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:24.989971 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:24.990701  5291 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:24.990824  5380 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:24.990795  5316 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:24.993130 31466 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.012951 32107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55788
I20260709 12:24:25.013715 32107 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.014175 32107 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:24.994128  5316 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.015211  5342 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:25.015350  5316 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:25.017052  5342 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:24.993515 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:25.002920 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.003228 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:25.006090 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:25.025050 31387 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.018946  5223 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:25.026446  5223 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:25.027338  5223 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.028937  5223 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:25.030831  5353 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.031358  5353 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.002446  5335 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.032567  5338 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.033085  5335 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:25.033275  5338 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.034794  5357 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.035300  5357 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:24.991365  5291 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:25.036913  5291 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:25.037894  5291 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.001942  5348 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.043092  5348 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.018179  5342 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:25.052006  5380 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:24.990911  5347 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 10 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.071110 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:25.071734 31569 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:25.073062  5335 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.074932 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.075709  5348 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:25.079739 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.080127  5357 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.085132  5353 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:25.088624 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.089380  5348 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.092696  5348 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.094074 31569 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:25.098079  5348 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:25.096794  5316 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.101765 32107 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.102934 31416 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:25.104079 32107 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.101409 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.069012  5389 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.105684 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.107003  5378 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.108546 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:25.109179 31569 raft_consensus.cc:3055] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:25.109591 31569 raft_consensus.cc:740] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:25.110911  5340 consensus_queue.cc:1059] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:25.111701  5340 consensus_queue.cc:1243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:24:25.112133  5340 raft_consensus.cc:3055] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:25.119643 32111 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:24:25.120973 31419 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:25.125912  5338 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.127871 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.128324  5349 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:25.112406  5369 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:25.132622  5316 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.133862 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:25.134974 32111 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:25.137540 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.138023 32114 raft_consensus.cc:1240] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:25.142442 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:25.120047 31569 consensus_queue.cc:260] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.144573 31569 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:25.121088  5340 raft_consensus.cc:740] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:25.147825 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.148394  5340 consensus_queue.cc:260] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.149152  5338 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:25.159286 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.149744  5338 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.149791  5340 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:25.149648  5362 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.183637 31320 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 17 to 18, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.189291 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.192152  5348 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:25.203704  5338 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.203606 32111 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:25.185469 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.211902 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.212651  5223 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:25.219656 31569 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:24:25.220376 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.229640  5360 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.230254 32079 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:25.230345  5360 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.233548  5360 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.234108  5338 raft_consensus.cc:2804] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:25.233974 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.235620  5338 raft_consensus.cc:697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:25.236565  5338 consensus_queue.cc:237] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.240477  5340 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.241057  5340 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.243330  5340 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.246500  5353 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:25.248080 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.249056  5353 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:25.249493  5353 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.249912  5353 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:25.255538 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.256445  5357 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.258184 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.275754 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.277844 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.279889  5348 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:25.284322 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.290760 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.277292  5357 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:25.294131 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:25.295320 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.290793  5348 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:25.301748 31573 raft_consensus.cc:2393] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:25.309091 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:25.317014 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.303553 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.320456 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.326993  5378 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:25.335772  5340 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.335315  5359 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:24:25.359270  5223 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:25.341152  5353 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.367435  5353 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.369562 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:25.370131 31417 raft_consensus.cc:3060] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:25.370745 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.371389  5223 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.373349  5223 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.373468 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.374060 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.374781 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.374963 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.375193 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.375380 31497 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:24:25.375941 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.376983 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.379541 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.381654 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:25.385281 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.398115  5342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40804 (request call id 10) took 2448 ms. Trace:
I20260709 12:24:25.381954  5256 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:24:25.428341 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 105040us
I20260709 12:24:25.429141 31417 raft_consensus.cc:2468] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:24:25.430076 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.414815  5359 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:25.441000  5353 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:24:25.467914 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 126661us
I20260709 12:24:25.471276 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.455924  5359 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.474217  5359 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.483032 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:25.403762  5342 rpcz_store.cc:276] 0709 12:24:22.954479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.954736 (+   257us) service_pool.cc:224] Handling call
0709 12:24:23.353876 (+399140us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54002f0420. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196e0520 00007fc119769b42 00007fc119768800 00007fc1197619fa 00007fc11e7294c9 00007fc117ca5c54 00007fc117ca5be2 00007fc117ca5b11 00007fc117ca5a8c 00007fc117ca4d42
0709 12:24:23.361884 (+  8008us) log.cc:844] Serialized 508 byte log entry
0709 12:24:23.392707 (+ 30823us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18003be5a0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc116678a40 00007fc1166734e4 00007fc116673455 00007fc1196bcb0b 00007fc119741b63 00007fc119769752 00007fc1197619fa
0709 12:24:25.397991 (+2005284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26510,"raft.queue_time_us":40492,"raft.run_cpu_time_us":1241,"raft.run_wall_time_us":2111,"spinlock_wait_cycles":63673984}
I20260709 12:24:25.485117 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41d7370a77bc48eaaa344ded5091445b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.463157  5353 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:25.491981  5353 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:25.497584 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.500137 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.504086  5316 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:25.435954  5256 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.510366  5256 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:25.510881  5389 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:25.517424 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:25.518637 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:25.518959 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47736.9us
I20260709 12:24:25.524417 31500 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:25.527464  5389 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.527068  5316 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:24:25.529546 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.529897 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.531042 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.535826  5416 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:25.536262  5416 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:25.538448  5416 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.539659  5416 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:25.539996  5353 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.561190 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:25.563120 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:25.574368 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.575973 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:25.576355 32111 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:25.577790 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.578888 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.584167  5342 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:25.584975  5342 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.585819  5256 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:25.579319  5353 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:25.591578 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:25.578960 32080 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.605614 31320 catalog_manager.cc:5697] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 10 to 11, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.608963  5353 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.609494 32080 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.610222  5353 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:25.618811 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:25.622725 31315 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 10 to 11, term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to <none>, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New cstate: current_term: 15 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:25.610647 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.631669 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:25.632586  5416 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:25.635393  5415 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:25.637315 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.642732  5415 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:25.643149 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 41d7370a77bc48eaaa344ded5091445b with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:33962
I20260709 12:24:25.644021 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.645123 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.645505  5353 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:25.641716 32107 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:25.647235  5291 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:25.655673 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:25.654892  5389 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.657238  5389 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:25.663491 32111 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:24:25.673427  5419 tablet_replica.cc:333] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:24:25.680528 31417 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:25.674582  5419 raft_consensus.cc:2243] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.700192  5419 raft_consensus.cc:2272] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:25.680189  5369 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:24:25.701495  5394 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:25.701896  5394 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:25.702796  5394 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.704167  5394 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:25.723589 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:25.724838  5415 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:25.727928  5415 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:25.734220 32106 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:25.749179  5419 ts_tablet_manager.cc:1916] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:25.758124  5418 log.cc:927] Time spent T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.123s	user 0.004s	sys 0.000s
I20260709 12:24:25.764810 31573 raft_consensus.cc:1275] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:25.766494  5415 consensus_queue.cc:1048] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:24:25.805420  5369 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:24:25.819150  5369 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:25.819550  5369 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:25.820390  5369 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:25.821905  5369 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:25.870339  5419 ts_tablet_manager.cc:1929] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:24:25.911391  5419 log.cc:1199] T 41d7370a77bc48eaaa344ded5091445b P 8553a13b444649b9a19e5488aabaf1c5: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/wals/41d7370a77bc48eaaa344ded5091445b
I20260709 12:24:25.913689 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 41d7370a77bc48eaaa344ded5091445b (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:26.219213 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.273546  5409 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.274163  5409 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:26.277969 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:26.278649 31498 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:26.279083 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:26.279716 31416 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:26.280931 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:26.282478  5369 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:26.282912  5369 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.276609  5409 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:26.283219  5369 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:26.293226  5369 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:26.295365  5369 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:26.320667 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:26.321388 31416 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:26.324206 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:26.324883 31498 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:26.330597 31416 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:26.355832 31540 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:26.361759  5427 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:26.362329  5427 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:26.363309  5427 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:26.360342 31498 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:26.406268 31315 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.426421 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:26.427029 31416 raft_consensus.cc:606] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:26.428709 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:26.430537 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:26.437265 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.611913  5316 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.612455  5316 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.619956  5360 raft_consensus.cc:993] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:26.620474  5360 raft_consensus.cc:1081] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:26.621644 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:26.622341 31498 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 10.
I20260709 12:24:26.623574  5316 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:26.625201 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:26.626608 31573 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 9.
I20260709 12:24:26.628602 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:26.665400 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47725.9us
I20260709 12:24:26.667934 31498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:26.668147 31390 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:26.668527 31498 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.668937 31498 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:26.668943  5362 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:26.698521  5362 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.699316  5362 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.716406  5362 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.718904 31498 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.726199 31498 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:26.727351 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:26.727994 31416 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:26.728296 31416 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:26.729017 31416 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.730279 31416 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:26.727411 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:26.732147 32106 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:26.735261 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:26.735914 31500 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.745606 32106 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:26.759881 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:26.760824  5412 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:26.761346  5412 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:26.762187  5412 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.752718 31500 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:26.754839 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:26.767629 31573 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.757015 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:26.770946 32107 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:26.781967 31573 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:26.785722 32107 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 11.
I20260709 12:24:26.788553 31387 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:26.789690  5433 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:26.790226  5433 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:26.791015 31416 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:26.791141  5433 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.801976 31315 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 14 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.757709  5362 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:26.879074 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 99823.4us
I20260709 12:24:26.887739 32106 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEARNER]: Advancing to term 17
I20260709 12:24:26.895962 31417 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:26.896461 32106 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:24:26.899082  5409 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:26.935809  5409 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:26.966567  5435 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.974489  5435 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:26.976981  5435 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:26.889912 31315 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 8 to 7, term changed from 9 to 11, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:26.981509 31498 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:24:26.972568 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61204.1us
I20260709 12:24:26.999346 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:27.000018 32107 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:27.000946 31463 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:26.997011  5409 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.004334  5412 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:27.003029  5360 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.012750 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:27.022416  5409 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.032353  5409 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.028851  5360 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.024010  5412 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.037797  5360 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.038094  5412 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:27.038455 31421 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:27.007485  5394 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:24:27.078307 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:27.079367 32111 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:27.085156 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:27.085779 31421 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:27.085538 31387 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:27.093513 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 86519.2us
W20260709 12:24:27.107309 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 104192us
I20260709 12:24:27.108034  5433 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:27.118332 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:27.117930 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 89541.3us
I20260709 12:24:27.089637  5362 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:27.108860  5433 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.119095 32112 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:27.106033  5256 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:27.124436 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:27.139984  5454 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:27.140466  5454 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.140810  5454 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:27.148658  5454 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.150724  5454 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.123363  5433 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:27.123083  5362 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.171718  5362 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.163111 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:27.176812 31417 raft_consensus.cc:606] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Received request to transfer leadership
I20260709 12:24:27.154860  5412 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.190402 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:27.129421  5256 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.231137 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:27.263065 32106 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:27.271292 31500 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:27.274901  5256 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.280894  5433 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.284339  5412 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.303056 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:27.303855 31421 raft_consensus.cc:606] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Received request to transfer leadership
W20260709 12:24:27.326110 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 93644.6us
I20260709 12:24:27.333333  5451 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.333971  5451 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.336494  5451 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:27.337568 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:27.338271 31573 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:27.339892 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:27.340289 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 201157us
I20260709 12:24:27.346390 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:27.347102 31573 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:27.348731  5451 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:27.349212  5451 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.349568  5451 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:27.356745 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:27.357726 31568 raft_consensus.cc:2368] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:27.359266  5433 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:27.364876 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 62372.2us
W20260709 12:24:27.368055 31307 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 68a65ccf8d5e42c1aa51a8761a850dd7 already in progress
I20260709 12:24:27.367947 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:27.368782 32106 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:27.370966 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:27.371783 31500 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:27.373845 31568 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:27.375560 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:27.377445 31416 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:27.375761 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:27.376302 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:27.373988 31417 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:27.383458  5455 raft_consensus.cc:1064] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
W20260709 12:24:27.384155  5455 raft_consensus.cc:1068] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: Unable to promote non-voter e166c1cb41f04d55a85e6c0d7966e32e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:27.391601 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:27.392282 32108 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:27.393323 32106 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:27.408811 31389 leader_election.cc:400] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:27.409181 31389 leader_election.cc:403] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.410279  5447 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:27.406266 32108 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
W20260709 12:24:27.413111 31307 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 45084.4us
I20260709 12:24:27.413153 31465 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:27.425145  5412 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:27.425661  5412 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:27.426182  5412 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:27.442150 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:27.445457 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108864us
I20260709 12:24:27.430624  5447 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:27.453642 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:27.456487 31493 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:27.452692  5427 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:27.461910 31387 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:27.446022  5362 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:24:27.465484  5444 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:27.466028  5444 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:27.466873 31497 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:27.467031  5444 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.470110 32108 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:27.471010 31466 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:27.475701 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:27.478754  5256 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:27.492787 31416 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:27.483222  5435 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:27.487680  5443 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:24:27.500849  5451 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.503363 32112 raft_consensus.cc:2368] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16.
I20260709 12:24:27.505051  5451 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:27.505210  5412 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.483465  5427 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:27.507220 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:27.508138 31573 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:27.495958  5440 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:24:27.511629 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:27.507547 31463 leader_election.cc:400] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16.
I20260709 12:24:27.518103 31497 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:27.516889 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69813.1us
I20260709 12:24:27.524780 31573 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:27.526435 32112 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:27.525955 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:27.540822  5316 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:27.546402  5427 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.542778  5452 raft_consensus.cc:1064] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:27.530959  5353 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:27.571260 31416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:27.571913 31416 raft_consensus.cc:606] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Received request to transfer leadership
W20260709 12:24:27.588402 31370 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:27.588840 31370 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 68a65ccf8d5e42c1aa51a8761a850dd7 already in progress
W20260709 12:24:27.589109 31370 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 68a65ccf8d5e42c1aa51a8761a850dd7 already in progress
I20260709 12:24:27.572414  5353 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:27.591825  5353 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.586414 31497 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:27.596153  5441 raft_consensus.cc:993] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:27.596598  5452 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:27.596647  5441 raft_consensus.cc:1081] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
W20260709 12:24:27.643396 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112203us
I20260709 12:24:27.653262 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:27.629643  5412 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:27.660871 31497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:27.662385 31497 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:27.662983 31497 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:27.674916 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:27.713359 31497 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:27.728773 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.774983 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 77664.9us
I20260709 12:24:27.786114 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:27.786890 31573 raft_consensus.cc:2368] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16.
I20260709 12:24:27.796309 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:27.861915 31497 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:27.968924  5466 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 12:24:27.988700 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 193709us
I20260709 12:24:27.993223 31465 leader_election.cc:400] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16.
I20260709 12:24:27.993578 31465 leader_election.cc:403] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.994144  5481 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16.
I20260709 12:24:28.058485 31322 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 11 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:28.100795 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115210us
W20260709 12:24:28.117036  5444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.004s	sys 0.020s
I20260709 12:24:28.137106 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:24:28.141451  5444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.004s	sys 0.020s
W20260709 12:24:28.206310 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.002s
W20260709 12:24:28.206760 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.002s
W20260709 12:24:28.215143 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54676.8us
W20260709 12:24:28.217080 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64883.3us
I20260709 12:24:28.218467 31500 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:28.220567 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:28.221319 31417 raft_consensus.cc:606] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:28.235272  5467 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:28.238971 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 48531.2us
W20260709 12:24:28.241300 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87953.3us
W20260709 12:24:28.244015 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95595.9us
I20260709 12:24:28.249962 31574 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:24:28.319088 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 72750.9us
I20260709 12:24:28.321013 31416 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:24:28.323925 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 66914.8us
I20260709 12:24:28.324782 31416 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:28.356812 32113 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:24:28.354501 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108623us
I20260709 12:24:28.358376  5463 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:28.361183  5453 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:24:28.329861  5479 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:24:28.380287  5447 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:28.473392 32108 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:24:28.478055 32107 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:28.480139 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:28.480666 32107 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:28.485868  5460 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:28.511885 32107 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:28.549541  5409 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:24:28.555225  5476 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:24:28.594149 32107 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:28.668860  5494 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 9 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:28.679086 32107 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 9 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:28.681586  5360 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:28.682502  5360 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:28.683524 32109 raft_consensus.cc:2955] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:28.691025  5474 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:28.780474 31418 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:28.780949 31418 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:28.781720 31418 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:28.833896 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 356) took 1190 ms. Trace:
I20260709 12:24:28.834380 31322 rpcz_store.cc:276] 0709 12:24:27.643361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.643495 (+   134us) service_pool.cc:224] Handling call
0709 12:24:27.721327 (+ 77832us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5400002210. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663f0b2 00007fc11f5b8759 00007fc11f550a76 00007fc11f521d58 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc
0709 12:24:28.833812 (+1112485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:28.190810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:28.191447 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:28.191488 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:24:28.191507 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:28.191882 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:28.191944 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:28.191973 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:28.192166 (+   193us) tablet.cc:701] Row locks acquired
0709 12:24:28.192184 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:28.192326 (+   142us) write_op.cc:270] Start()
0709 12:24:28.192439 (+   113us) write_op.cc:276] Timestamp: P: 1783599868192280 usec, L: 0
0709 12:24:28.192461 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:28.193205 (+   744us) log.cc:844] Serialized 603 byte log entry
0709 12:24:28.458263 (+265058us) op_driver.cc:464] REPLICATION: finished
0709 12:24:28.467618 (+  9355us) write_op.cc:301] APPLY: starting
0709 12:24:28.467698 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:28.468813 (+  1115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:28.468916 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:28.469601 (+   685us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:28.469788 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:28.469832 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:28.470001 (+   169us) log.cc:844] Serialized 25 byte log entry
0709 12:24:28.470154 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.470228 (+    74us) write_op.cc:454] Released schema lock
0709 12:24:28.470262 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:28.470579 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.470605 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":10108160,"child_traces":[["op",{"apply.queue_time_us":9060,"apply.run_cpu_time_us":2964,"apply.run_wall_time_us":2969,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":90474,"prepare.run_cpu_time_us":2825,"prepare.run_wall_time_us":34161,"raft.queue_time_us":139338,"raft.run_cpu_time_us":4830,"raft.run_wall_time_us":120111,"replication_time_us":178130,"thread_start_us":121266,"threads_started":3,"wal-append.queue_time_us":7403}]]}
W20260709 12:24:28.853127 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.862447 31320 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.883277  5362 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:28.884001  5362 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:28.895483  5494 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:28.913277  5494 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:28.915792  5494 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:28.907078  5507 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:28.916778  5507 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:28.886664  5362 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:28.920145  5507 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:28.923372  5440 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:28.926658  5440 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:28.930327  5440 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:28.960734  5494 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:28.961297  5494 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:28.964483  5494 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:28.974795  5494 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:28.975412  5494 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:28.977839  5494 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.000856  5522 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:29.001557  5522 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.004086  5522 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.015910  5256 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.016583  5256 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.004604  5522 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:29.033901 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.010s	sys 0.007s
W20260709 12:24:29.034392 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.010s	sys 0.007s
W20260709 12:24:29.034754 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 809837us
I20260709 12:24:29.031852  5522 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.037725  5522 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:29.038357  5522 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.039214  5522 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.040236  5256 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:29.040813  5256 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.030977  5445 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:29.047209  5445 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.049968  5445 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.041289  5256 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.054776  5522 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.056130  5256 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:29.050592  5445 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:29.060063  5445 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.063655  5445 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.066664 31497 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:24:29.077309 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 70011.6us
I20260709 12:24:29.074787 31497 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 9 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:29.079052 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.170185 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.170964 31568 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
W20260709 12:24:29.259212 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 223470us
I20260709 12:24:29.263672 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.265398 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.266453 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.268445 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.269801 31418 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:29.279150  5433 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:29.280071  5433 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.283320 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.287931  5433 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.290352  5316 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:29.291280  5316 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.293015 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.293313  5360 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:29.297019 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:29.299372 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.300729 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.286152 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.294354  5360 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.303526 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.294327  5316 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.314165 31496 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:29.327162 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.330315 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.338049  5444 raft_consensus.cc:993] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:29.338775  5444 raft_consensus.cc:1081] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:29.340832  5524 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:29.342469  5524 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.342933  5524 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:29.349963  5338 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:29.356509  5360 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:29.357254 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.369135 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.371107  5467 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.372094  5467 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.375447 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.377485 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.378394  5489 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.379346  5489 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.381830 31498 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:29.383457 31498 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:29.378736 31418 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:29.377425  5467 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.387684  5443 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.388321  5443 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.388895  5489 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:29.395329 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 47417.3us
I20260709 12:24:29.389032 31418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 4061) took 1252 ms. Trace:
I20260709 12:24:29.403504 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.399506 31418 rpcz_store.cc:276] 0709 12:24:28.136765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.136889 (+   124us) service_pool.cc:224] Handling call
0709 12:24:29.267962 (+1131073us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b58007f5ed0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1196bf0aa 00007fc119741447 00007fc119759fe7 00007fc11975b7de 00007fc11976727c 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c
0709 12:24:29.388831 (+120869us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400448ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:29.388950 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544902656}
I20260709 12:24:29.326478 31320 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 11 to 10, term changed from 15 to 16, leader changed from <none> to 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) added, now has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } attrs { replace: true } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:29.423739 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.428678 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:29.447990  5529 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.448944  5529 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.452090  5529 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.458534  5443 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.461652 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:29.458827 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 69019.3us
W20260709 12:24:29.475828 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54818.7us
I20260709 12:24:29.476804 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.478531 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.479161 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.478780 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.482265 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.493294 31466 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.494402  5526 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:29.497200 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.494966  5524 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.498283 32107 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:29.498960 31496 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:29.499768  5524 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:29.476800 31387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.497174 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.508080 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.509127  5489 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:29.518539 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.521453 31492 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:29.521369 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.524777  5526 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.525429  5526 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.526021 31466 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.524999 31418 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 9 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:29.529135  5526 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:29.535512 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.536422 31415 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:29.536617  5488 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.537240  5488 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.542261  5488 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.543021  5488 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.543619  5488 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.545843  5488 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.547588  5488 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.549156  5488 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.551710  5488 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.552629  5524 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:29.552814 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.553272 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.567301  5524 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:29.568848  5524 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.587082 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.590250  5529 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:29.609157 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:29.610886 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.611397  5360 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:29.611629 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.611536 31424 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:29.615163 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.615070 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.617141 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.619401 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.615051 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.620714  5480 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:29.621371 31573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08259dcf521e4914917a72febcb040d1"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:29.622145  5433 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:29.622553  5433 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:29.623428 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.623677  5433 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.625118  5443 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:29.625130  5433 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:29.637107  5528 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.622169 31573 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:29.637883  5528 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.638600 31573 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:29.657887 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.658914  5362 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:29.674640 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.674048 31573 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.686547 31573 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:29.687805 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59753.1us
I20260709 12:24:29.691920  5528 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:29.684090  5480 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:29.693399 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:29.694695  5488 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:29.695362 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:29.696806 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.697572  5489 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:29.698012  5489 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.698437  5489 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:29.702749  5488 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:29.705818 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.711376 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.711402 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.713064 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:29.713598 32107 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:29.717898 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.718057 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.718928  5453 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.719147 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.719533  5453 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.721833  5453 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.722725  5467 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.723304  5467 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.725405  5467 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.730005  5488 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:29.734459 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:29.735590 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.740350 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:29.741072 32106 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:29.747228 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:29.746920 32107 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:29.752525 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.758643 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.758733 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.753644 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.761469 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.773221 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.773851 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.779722 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.780196 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.780845  5362 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:29.781054 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.782063  5362 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:29.786161 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.788122  5524 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:29.790138 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.803843 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.807252 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.808343  5316 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:29.807096  5444 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:29.811719  5409 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.812336  5409 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.815218 31537 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:29.816526 31540 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.817564  5484 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:29.817760  5467 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:29.818077  5484 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:29.819365  5484 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.802174  5489 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.827491  5528 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:29.851769 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.856895  5526 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:29.856951 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.858304 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.858938  5526 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:29.860930  5409 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.862501 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.866036 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:29.866809 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:29.870712  5524 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:29.871519  5442 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:29.872355  5488 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:29.881565 31463 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:29.882360  5443 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:29.883059  5524 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:29.883087  5443 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:29.886570  5443 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:29.896399 31463 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:29.911729 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.915531 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:29.916160 31415 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:29.916440 31415 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:29.916469 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.917320 31415 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:29.919080 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.920255 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:29.924137  5489 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:29.918527 31415 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:29.941179 31415 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:29.940768 31322 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 14 to 16, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:29.943218 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080036f100 after lost signal to thread 30274
I20260709 12:24:29.943351 31322 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: config changed from index 9 to 11, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:29.944713 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080036eca0 after lost signal to thread 31356
W20260709 12:24:29.946333 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080019ecc0 after lost signal to thread 31449
W20260709 12:24:29.953864 31521 debug-util.cc:398] Leaking SignalData structure 0x7b08001bde60 after lost signal to thread 31524
I20260709 12:24:29.955014 31569 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
W20260709 12:24:29.962646 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080005ba60 after lost signal to thread 31599
W20260709 12:24:29.964213 31521 debug-util.cc:398] Leaking SignalData structure 0x7b0800380460 after lost signal to thread 32138
W20260709 12:24:29.966398 31521 debug-util.cc:398] Leaking SignalData structure 0x7b080004ba80 after lost signal to thread 32139
I20260709 12:24:29.974053 31315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 357) took 1062 ms. Trace:
I20260709 12:24:29.975093 31315 rpcz_store.cc:276] 0709 12:24:28.911598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.975172 (+ 63574us) service_pool.cc:224] Handling call
0709 12:24:29.973842 (+998670us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317355,"reported_tablets":2}
I20260709 12:24:29.996109 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 243) took 1152 ms. Trace:
I20260709 12:24:30.003091 31322 rpcz_store.cc:276] 0709 12:24:28.843909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.857613 (+ 13704us) service_pool.cc:224] Handling call
0709 12:24:29.996010 (+1138397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:29.948145 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:29.948745 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:29.948784 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:24:29.948801 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:29.949221 (+   420us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:29.949273 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:29.949293 (+    20us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:29.949490 (+   197us) tablet.cc:701] Row locks acquired
0709 12:24:29.949506 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:24:29.949625 (+   119us) write_op.cc:270] Start()
0709 12:24:29.949710 (+    85us) write_op.cc:276] Timestamp: P: 1783599869949590 usec, L: 0
0709 12:24:29.949723 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:24:29.950183 (+   460us) log.cc:844] Serialized 989 byte log entry
0709 12:24:29.952102 (+  1919us) op_driver.cc:464] REPLICATION: finished
0709 12:24:29.952515 (+   413us) write_op.cc:301] APPLY: starting
0709 12:24:29.952606 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:29.954008 (+  1402us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:29.954193 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:29.955508 (+  1315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:29.955696 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:24:29.955743 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:29.964639 (+  8896us) log.cc:844] Serialized 33 byte log entry
0709 12:24:29.965471 (+   832us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.965570 (+    99us) write_op.cc:454] Released schema lock
0709 12:24:29.965616 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:29.965985 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.966016 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41872,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":4056,"apply.run_wall_time_us":13429,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":461,"prepare.run_cpu_time_us":2435,"prepare.run_wall_time_us":2435,"replication_time_us":2263}]]}
I20260709 12:24:29.992268 31320 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 10 to 11, VOTER 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) evicted, no longer has a pending config: VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193), VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194), VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:30.044581 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 195792us
I20260709 12:24:30.086403  5545 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:30.086923 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 176705us
I20260709 12:24:30.087183  5545 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:30.093474 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:30.094565 31497 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:30.101110  5545 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:30.101594 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:30.109344 31569 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:30.110670 31559 tablet_service.cc:1558] Processing DeleteTablet for tablet 41d7370a77bc48eaaa344ded5091445b with delete_type TABLET_DATA_TOMBSTONED (TS 8553a13b444649b9a19e5488aabaf1c5 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:33962
I20260709 12:24:30.110939 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:30.111837 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.112937 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.114048  5467 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:30.115761  5467 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:30.116959 31422 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:30.119900 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.121292  5484 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:30.122710 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.123958  5526 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:30.122756 31421 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:30.076814 31322 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 11 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.136189 32107 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:30.141182  5484 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:30.142707 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.144146  5541 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:30.145735 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:30.146410  5453 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:30.146919  5453 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:30.147738  5453 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:30.152901 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:30.158128 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:30.179590  5526 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:30.196216 31306 catalog_manager.cc:5028] TS 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): tablet 41d7370a77bc48eaaa344ded5091445b (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:30.209448 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:30.210990 31321 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.211796  5526 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:30.212849 31422 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:30.239674 31569 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:30.247762 32107 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:30.249559 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:30.252403  5544 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:30.252943  5479 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:30.256234  5524 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:30.281466 31322 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 15 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.283470  5484 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:30.286175  5484 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.298557 31422 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.334203 31320 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 reported cstate change: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.368446 31483 tablet_service.cc:1558] Processing DeleteTablet for tablet 19ad016bcdfe4c62a610fe4974bc52c2 with delete_type TABLET_DATA_TOMBSTONED (TS b6bc3d9dbfb44e81b63071002a011f71 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40804
I20260709 12:24:30.379772 31422 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:30.391249  5409 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:24:30.455708 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19ad016bcdfe4c62a610fe4974bc52c2 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:30.474225 31497 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:30.482254 32106 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:30.484915  5555 tablet_replica.cc:333] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:24:30.486177  5555 raft_consensus.cc:2243] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.493144 31568 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:30.498287 32107 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:30.506593 32106 raft_consensus.cc:2955] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.498726  5453 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:30.504488  5555 raft_consensus.cc:2272] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.504670  5526 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:30.526105  5555 ts_tablet_manager.cc:1916] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:30.543358  5445 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.558427 31568 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.565189  5526 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:30.578966 32107 raft_consensus.cc:2955] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 8 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:30.583863 31307 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:30.604095 31497 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:30.605899  5544 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:30.620247 31322 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index 8 to 11, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.655122 31421 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:30.656714  5489 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:30.658610 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet 68a65ccf8d5e42c1aa51a8761a850dd7 with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:30.745664  5555 ts_tablet_manager.cc:1929] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:24:30.706264  5559 tablet_replica.cc:333] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:30.747998  5555 log.cc:1199] T 19ad016bcdfe4c62a610fe4974bc52c2 P b6bc3d9dbfb44e81b63071002a011f71: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/wals/19ad016bcdfe4c62a610fe4974bc52c2
I20260709 12:24:30.750351 31307 catalog_manager.cc:5028] TS b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): tablet 19ad016bcdfe4c62a610fe4974bc52c2 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:30.783787  5559 raft_consensus.cc:2243] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:30.784694  5559 raft_consensus.cc:2272] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:30.788862  5559 ts_tablet_manager.cc:1916] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:31.305527 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:32.088071 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800342d00 after lost signal to thread 30274
W20260709 12:24:32.089486 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800301a80 after lost signal to thread 31356
W20260709 12:24:32.205052 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 1.35449e+06us
I20260709 12:24:32.215890  5526 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.216539  5526 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.222930  5409 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.237015  5409 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.274652  5568 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.275547  5568 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.237669  5544 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.277287  5526 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.291011  5526 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.291525  5526 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.291710  5568 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.291775  5409 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.318441  5453 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.319270  5453 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.285560  5544 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.339359  5544 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:32.333851 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 1.47956e+06us
I20260709 12:24:32.335181  5570 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.286567  5541 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.360975  5496 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.362577  5479 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.362700  5543 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.374723  5559 ts_tablet_manager.cc:1929] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:24:32.383008  5559 log.cc:1199] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/68a65ccf8d5e42c1aa51a8761a850dd7
I20260709 12:24:32.390285  5453 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.371413  5541 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.385654  5526 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.375032  5479 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.409729  5479 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.375581  5496 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.412168  5496 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.399501  5568 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.414994  5568 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.416966  5568 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.365633  5570 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.418869  5563 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.419400  5570 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.419745  5564 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.420382  5564 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.394460  5445 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.429720  5445 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.430473  5544 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.431033  5544 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.431926  5445 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.404939  5541 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.433182  5544 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.405431  5575 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.434619  5575 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.435964  5564 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.407552  5338 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.439121  5338 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.436959  5575 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.384008  5543 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.438328  5562 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.443133  5338 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.453115  5575 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.453756  5445 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.471143  5338 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.472779  5496 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.458742  5572 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.462168  5443 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.419431  5563 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.469055  5561 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.476282  5559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48288 (request call id 13) took 1807 ms. Trace:
I20260709 12:24:32.476150  5480 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.475706  5409 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.478060  5568 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.461058  5562 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.478777  5575 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.495831  5496 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.518961  5585 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.495731  5338 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.504792  5445 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.529742  5489 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.523722  5409 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.519268  5443 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.576826 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.537376  5582 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.579627  5567 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:32.587224 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800315100 after lost signal to thread 31449
W20260709 12:24:32.588480 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08000646c0 after lost signal to thread 31524
W20260709 12:24:32.589686 31353 debug-util.cc:398] Leaking SignalData structure 0x7b080004aa60 after lost signal to thread 31599
I20260709 12:24:32.579535  5489 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.580152  5581 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.580631  5530 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.580761  5583 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.513753  5572 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.607398 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.581292  5592 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:32.591380 31353 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd040 after lost signal to thread 32138
I20260709 12:24:32.593432 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.534792  5568 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.532788  5480 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.533111  5561 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.608001 31573 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:32.592113  5582 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.609831  5571 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.610303  5576 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.611900  5496 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.612051  5562 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.610339  5594 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.609877  5601 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.572499  5585 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.638657  5570 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.614919  5587 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:32.616966 31353 debug-util.cc:398] Leaking SignalData structure 0x7b0800361860 after lost signal to thread 5528
I20260709 12:24:32.616868 31572 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:32.644688 31573 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:32.595865  5543 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.512518  5559 rpcz_store.cc:276] 0709 12:24:30.652815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.658315 (+  5500us) service_pool.cc:224] Handling call
0709 12:24:30.705143 (+ 46828us) ts_tablet_manager.cc:1151] Deleting tablet 68a65ccf8d5e42c1aa51a8761a850dd7
0709 12:24:30.705200 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:30.833500 (+128300us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:32.364890 (+1531390us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:32.459645 (+ 94755us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28008,"tablet-delete.queue_time_us":45878,"thread_start_us":25483,"threads_started":1}
I20260709 12:24:32.614362  5443 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:32.689957 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 85582us
I20260709 12:24:32.707049  5541 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.660286  5338 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.595484  5567 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.665599  5526 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.665958  5453 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.718607 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.690626  5479 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.639462  5592 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.608633  5530 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.713871  5580 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.707304  5579 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.606251  5581 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.715425  5562 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.723179  5543 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.670058  5583 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.668857  5571 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.707773  5576 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.723817  5526 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.727226  5453 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.708854  5587 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.710604  5570 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.745893  5580 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.734375  5598 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.755872  5588 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.771135  5604 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.771459  5609 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.771647  5582 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.691442  5594 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.753427  5577 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.689976  5601 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.788383  5409 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.788574  5612 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.788933  5567 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.789515  5567 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.789193  5612 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.789932  5601 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.790037  5567 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.753301  5584 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.772228  5561 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.740677  5479 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.797040  5577 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.797307  5598 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.798604  5479 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.799531  5577 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.799693  5598 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.795527  5605 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.800263  5588 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.800948  5605 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.772683  5586 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.802115  5586 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.802611  5568 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.804036  5530 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.804181  5586 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.804399  5572 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.804585  5530 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.784821  5543 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.805146  5530 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.806049  5605 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.772877  5480 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.807003  5480 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.807150  5543 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.807677  5615 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.807533  5480 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.808503  5565 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.808871  5526 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.809088  5565 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.809689  5480 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.773012  5564 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.723129  5541 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.773218  5607 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.753805  5589 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.746939  5611 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.756999  5573 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.745251  5443 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.756283  5595 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.754283  5608 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.755471  5590 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.754792  5602 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.736924  5338 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.773512  5445 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.771754  5591 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.790886  5604 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.791996  5576 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.783282 31572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:32.785969  5496 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.792996  5612 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.792011  5619 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.783536  5562 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.771219  5544 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.890821  5619 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.793468  5613 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.891847  5613 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.892328  5562 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.893155  5619 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.819666  5589 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.795792  5571 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.795476  5609 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.894251  5613 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.795686  5570 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.795967  5584 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.890039  5603 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.801455  5592 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.895810  5617 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.895967  5589 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.896503  5565 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.896387  5617 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.896735  5584 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.797480  5583 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.772363  5489 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:32.847007 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 106217us
I20260709 12:24:32.814968  5581 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.793437  5594 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.898072  5628 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:32.754669 30276 debug-util.cc:398] Leaking SignalData structure 0x7b0800327300 after lost signal to thread 32079
I20260709 12:24:32.898972 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:32.789532  5563 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.851573  5530 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.891024  5544 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.899794  5563 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:32.899884 31465 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:32.900226  5563 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.900655  5563 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:32.815369  5582 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.902099  5594 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:32.774056  5579 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.902544  5594 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.902190  5582 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.902972  5594 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:32.904170  5579 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.819444  5564 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.793015  5585 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.894349  5580 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.906265  5564 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.800999  5567 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.906836  5576 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.907361  5576 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.908934  5622 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.909126 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.909615 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.909473  5622 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.909878 31569 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:32.898653  5628 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.895524  5603 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.910866 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.911480 31574 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:32.901651  5544 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.911798  5628 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.854703  5480 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.912474  5603 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.912846  5445 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.913427  5445 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.914155  5623 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.914709  5623 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.898554  5617 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:32.916069  5604 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.916659  5616 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.917162  5616 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.904497  5582 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.918754  5591 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:32.919117 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.820372  5572 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:32.921640 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.921481  5572 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.922248  5562 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.819612  5607 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.878384  5496 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.838507  5443 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.854353 31572 raft_consensus.cc:606] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:32.820303  5575 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.956707 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.971650 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.972834 31568 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:32.980428 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.980645 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.951534  5453 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:32.987771 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:32.947064  5617 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.954013  5545 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.922782  5562 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.071692 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.878360  5409 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:32.953166  5578 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.950556  5614 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.948454  5609 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.920974  5541 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.949932  5601 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.912922  5480 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.952701  5630 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:33.078898 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.079406 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.003530 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.818748  5615 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:33.071131 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 83477.6us
I20260709 12:24:33.071419 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.851573  5588 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:32.959491  5444 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.980979  5592 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:33.005064 31491 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:32.959089  5565 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:32.854226  5586 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:33.110491 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.072419 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.108258 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.079614 31492 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:32.855903  5338 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.984930  5530 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:33.139897 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.080132 31496 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:33.077776 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.140997 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:33.103614 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.820461  5611 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.111285 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.110872 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.135071 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.103708  5631 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:32.854048  5595 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.138171 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.138298  5586 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.072479  5409 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.109341  5583 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:33.111379  5594 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.075192  5545 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.109117 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:33.100937 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.101583 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.143162 31573 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:33.136499 31465 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:33.104703 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.852046  5573 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.104177 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:32.851112  5608 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.111941 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.105436 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:32.856267  5590 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:32.946828  5602 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.106947  5630 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.144191 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.121392  5622 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.381392 31570 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:33.080035  5567 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:33.132314  5572 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.150774 31572 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:33.382210  5567 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.197607 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.383133  5443 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.132084  5623 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.072748  5617 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.131294  5480 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.132385  5620 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:33.138434  5444 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.384233  5562 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.103741  5563 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.100710  5496 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.123675  5607 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.130165  5445 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.385655  5545 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.385604  5338 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:33.143978  5565 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.099495  5614 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.240684 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.387856 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:33.389721 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.144744  5578 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.197265 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.391368 31499 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:33.391057 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.108712  5615 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:33.392377 31565 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:33.393303 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.394045  5595 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.120350  5610 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:33.395440  5591 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.238904 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.400779 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.142194 31419 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
W20260709 12:24:33.401177 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 264735us
I20260709 12:24:33.144985  5592 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.210783 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.564478 31492 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:33.565637 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.404179  5561 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:33.404708 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.404625  5631 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.407267 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.553404 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.556046 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.468973 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.399541  5616 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.268486 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.493129 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.535442 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.457144 31493 raft_consensus.cc:2393] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:33.529244 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.459585 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.610119 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.577281 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.610318 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.633298 31569 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 11.
I20260709 12:24:33.579999 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.587046 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.128150  5606 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:33.569509 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.537465 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.576653 31415 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:33.577389 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.634444 31419 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:33.585079 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet 68a65ccf8d5e42c1aa51a8761a850dd7 (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:33.577741 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.633790 31573 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:33.588044 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.582656 31497 raft_consensus.cc:1240] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:33.443320 31418 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:33.578018 31465 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:33.245280  5633 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:24:33.568954 31423 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:33.637728 31492 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
W20260709 12:24:33.657079 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 82041.4us
W20260709 12:24:33.643918 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69721.1us
I20260709 12:24:33.647185 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.651060 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.652184 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:33.639648 31307 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54593us
I20260709 12:24:33.470134  5567 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.660480 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.346632  5587 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:33.243113  5575 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:33.647652 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.539388  5630 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.637182 31420 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:33.468633  5611 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.239254  5576 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.668390 31415 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:33.675087 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.675364 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.675784 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.676154 31492 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:33.674450 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.571231  5561 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:33.680055 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.579720  5631 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.245502  5601 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.573215  5620 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:33.607728  5590 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.606353  5594 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.677213 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.572229  5610 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.680555 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.682976 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.595405  5409 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:33.684636 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.684964 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.608953  5592 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.601186  5573 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.608631  5608 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.651365  5586 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.244117  5530 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.582064  5444 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.411530  5583 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:33.648569  5606 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:33.694415 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.737540 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.939121 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.686094 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.950582 31500 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:33.734434 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:33.954023 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.602646  5602 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:33.668489  5562 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:33.958451 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.959125 32106 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:33.959256 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.955600 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.960358 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.960981 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.683934  5561 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:33.963835 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.964389 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.964907 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.966500 31418 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:33.950874  5620 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:33.967424 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.969422 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.968739 31422 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:33.970505 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.972895 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.973165 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.973495 31421 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:33.961068  5562 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:33.971982 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.679754  5575 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:33.975793 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.978641 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.979144 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.979259 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.980913 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.985526 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:33.970247  5563 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:33.987174 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:33.989073 31423 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:33.987013 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:33.990240 31574 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:24:33.975690  5562 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:33.986152 32112 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:34.009370 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.100626 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.077844 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.082056 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.086822 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.047070 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.104413 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.105650 31415 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:34.044123 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.108155 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.043654 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.110177 32110 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 12.
I20260709 12:24:34.111598 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.100514  5578 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.113631 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.113749 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.047049  5565 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.018018  5617 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.111271  5409 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.117223 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.117408  5618 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.121014 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.067957  5583 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.118424 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.118875 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.118930 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.117823  5530 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.121886 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.111325  5596 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.123521 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.122812 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.122227 31565 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:34.124580 31574 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:34.123564 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.125797 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.126824  5596 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.127020  5618 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.129076  5596 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.129319  5618 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.130183 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.130333 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.122785  5409 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.133198  5409 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.135447 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.136093 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.136994 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.137266 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.124361 32114 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:34.137823 32111 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:34.139051 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.140724  5613 raft_consensus.cc:993] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:34.140836 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.141300  5613 raft_consensus.cc:1081] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:34.142915 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.143407 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.144212 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.145996 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.146306 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.147048  5601 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.145510 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.150318 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.145143 31574 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:34.150941 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.151304 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.151428  5606 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.124974  5614 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.151953 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.152225 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.157987 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.162933 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.163862 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.163925 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.167836 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.163904 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.165365 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.165369 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.164439 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.169479 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.164618 32079 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:34.171425 31496 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 21: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:34.169013 32112 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:34.171887 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.169459 31567 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:34.171837 32079 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:34.173847 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.173995 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.176643  5617 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.176774  5563 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.180521 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.175959 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.183462 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.185292 31465 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.187368 31492 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:34.187299 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.188501 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.189792 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.188256 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:34.193729 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.194550 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:34.178259  5578 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:34.196197 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.198748 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.196398 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.193770 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.177270  5563 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.172138  5575 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.179399  5567 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.190793  5592 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:34.197690  5590 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:34.187964  5617 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:34.201146  5444 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:34.204919 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.205210 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.205399 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.202791  5567 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.208279 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.192768  5614 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.207190 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.210448 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.211781 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.206571  5444 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.211253  5567 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.206636  5590 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.213183  5444 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:34.213517  5590 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.213553  5594 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:34.214360  5594 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.214778  5594 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:34.204726  5592 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.199529  5578 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.203795  5563 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.206859  5617 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.222890  5617 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:34.219198 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.219250  5592 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:34.192668  5601 consensus_queue.cc:1059] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:24:34.227648 31494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48628
I20260709 12:24:34.224722 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.228206 31494 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:34.228610 31494 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.226604 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.211272  5614 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.235936 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.235224 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:34.234612  5601 raft_consensus.cc:3055] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:34.238446  5614 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.245687  5601 raft_consensus.cc:740] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.245872  5613 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.246333  5613 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.246753  5613 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.238476  5610 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.249642  5620 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.250406  5567 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.252067  5620 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.253141  5567 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.253448  5614 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.246729  5601 consensus_queue.cc:260] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.261294  5561 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.263404 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.287698 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.265321 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.289143 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.289290 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.264070 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.290732 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.291405 32114 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:34.291788 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.292202 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.293176 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.225849  5578 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:34.266956 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.266209 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.294812 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.268662 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.269914  5444 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.271451 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.279147 31387 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.290498 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.299537  5573 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.299847 31387 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:34.300252  5444 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.300812  5444 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.281466  5590 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.277043 31494 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.293346 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.265991 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.301184  5578 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.268010 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.302619  5590 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:34.287907 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 93425.2us
I20260709 12:24:34.300716 31387 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:34.277427 31540 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:34.294395 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.303442 31494 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:34.314879 31537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.586s (SENT)
I20260709 12:24:34.314278 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:34.340988 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63633.9us
I20260709 12:24:34.328492 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.308125  5617 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.306097 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.301220  5444 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.306138 31499 raft_consensus.cc:1240] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.314699 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.349280 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.350126 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.348086 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.344729 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.326216 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:34.338357 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 141985us
I20260709 12:24:34.350870 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.350461 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:34.370404 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64383.7us
I20260709 12:24:34.357051 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:34.373844 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45441.9us
I20260709 12:24:34.378206 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.380059 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.381631 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.382555 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.303388  5578 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.378973 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:34.387960 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.320727  5614 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.357316 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.395208 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.396063 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.396306 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.390727 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.391495 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:34.392447 31387 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:34.397496 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 193442us
I20260709 12:24:34.397821 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.304131  5601 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:34.415091 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.415453 31492 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:34.415685 31568 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:34.393579 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.305884  5561 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.400899 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.419294 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.414597 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.420030 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.342072  5575 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.386534  5590 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:34.416029 31568 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:34.403218 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:34.416713 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.401762 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.328359  5583 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:34.414914 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.312729  5613 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.422252 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.387316  5444 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.390193  5602 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:34.307006  5563 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.436275  5583 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.438781  5583 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.423156  5409 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:34.440073  5563 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.440251  5409 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.440821  5409 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.440292 31568 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.441123  5567 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:34.441497 31568 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.423929  5595 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.443225  5595 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.443590  5595 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:34.446331 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.424154  5590 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.448451  5590 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:34.352136  5562 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.451697 31500 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.452353  5617 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.452732  5562 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.455158 31568 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:34.425252 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.309719  5592 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.400511  5606 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:34.431990 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 117157us
I20260709 12:24:34.421094 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.362480  5596 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:24:34.321305  5594 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.419211  5565 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:24:34.436990 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 240233us
I20260709 12:24:34.394564  5586 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.423271  5575 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.456164 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:34.488488 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67868us
I20260709 12:24:34.463363  5613 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.468183  5594 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.427624  5635 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.459915  5636 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:34.469031  5565 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.499522  5565 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:34.470187  5592 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:34.479106 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.506281  5590 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.481313  5618 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:34.481911 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60879.7us
I20260709 12:24:34.489706  5575 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.488066  5586 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.491184  5530 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.524415  5530 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.524842  5530 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.492578 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.527339  5586 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.532452  5409 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.534569 31566 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:34.537778  5409 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.493798 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.495122  5595 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:34.509002 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 118536us
I20260709 12:24:34.492806 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.511487 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.458866 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.520148 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:34.512187 31573 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.540593  5565 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.544831  5595 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.545570 31565 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.546761  5575 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.547096  5595 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:34.552736  5595 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.553210  5595 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:34.547356 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:34.555712 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162225us
I20260709 12:24:34.556052 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:34.555749 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 63013.5us
W20260709 12:24:34.556479 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97736.5us
I20260709 12:24:34.557418 31387 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.550602  5565 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.558106 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.558164 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.558980  5613 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:34.560819  5592 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:34.561614  5409 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:34.561964  5592 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:34.562042  5409 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.561079  5640 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.558871  5635 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:34.561069  5618 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:34.557437  5578 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:34.562595  5409 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.558451 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.582937 31569 raft_consensus.cc:1240] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:34.572954 31540 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.586050 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.566411 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.586560 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.586836 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.580070  5590 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.587635  5610 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.588156  5578 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.588830  5565 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.589258  5578 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:34.566470  5586 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.589659  5578 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.590934  5635 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:34.591527  5635 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.590610  5578 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.591853  5635 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.588362  5643 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.592743 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:34.592764 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 85008.5us
I20260709 12:24:34.593175 31387 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.593855  5618 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:34.594295  5610 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.593793  5578 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.596015 31537 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.597044 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.598232 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.562490  5592 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.604169  5567 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:34.604879  5592 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.605376 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.606096  5592 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.606956 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.607573  5613 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.608889 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.604264  5608 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:34.609997  5617 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.610368  5617 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.610733  5617 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.610846  5594 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:34.611264  5594 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.611618  5594 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.612146  5608 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.612828  5608 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.617558 31463 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:34.617612 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.618630  5567 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:34.594514  5595 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.619058  5567 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.619465  5567 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:34.619799  5575 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.619957  5596 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.620710  5595 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.620967 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.621729  5642 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:34.622102  5642 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.622465  5642 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:34.623152  5409 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.627862 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.629063  5573 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:34.629760 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.630841  5601 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:34.631194  5562 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:34.631623  5562 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:34.631999  5562 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.632710  5601 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:34.630378  5594 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.633044  5618 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:34.612387  5530 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.634589  5594 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.636018  5530 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.632076 31387 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.637714 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.638832  5601 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:34.639508  5601 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.641770  5573 consensus_queue.cc:1059] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:34.642843  5573 raft_consensus.cc:3055] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:34.643205  5573 raft_consensus.cc:740] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.643967  5573 consensus_queue.cc:260] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.644918  5635 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.645272  5573 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.659605 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.660792 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.661437 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.663759 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.648522  5565 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:34.651098  5642 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.688735  5642 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.652693 32112 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21. Ops: []
W20260709 12:24:34.651800 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55621.3us
I20260709 12:24:34.689760 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.652884 32109 raft_consensus.cc:1240] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:34.692118 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 96175.2us
I20260709 12:24:34.595811  5640 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.653820 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:24:34.654470 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 50304.2us
I20260709 12:24:34.655700 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.663945 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.692416 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.579901  5444 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.667130  5606 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:34.660682  5631 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:24:34.699985  5606 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.667692  5562 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.700466  5578 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:34.700839  5578 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.701676  5578 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.653352  5610 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:24:34.702790  5444 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.702998  5610 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:34.700430  5606 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.703392  5610 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.704353  5610 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.705691  5610 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.668778  5617 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.649093  5567 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.708259  5617 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.708235  5635 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.652735  5643 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.711009  5606 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.711272  5643 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.676183 31492 raft_consensus.cc:1240] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:34.677735 31500 raft_consensus.cc:1240] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:34.679368 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:34.681085 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.682927  5586 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.714870 31423 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:34.684252  5409 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.595013  5583 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.692835 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.693506  5640 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:34.693748 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.695850 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.695371  5638 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.695528  5636 consensus_queue.cc:1059] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:24:34.696362 31417 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:34.709882  5567 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.693259 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.693895 31420 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:34.721606 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.721611 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.702105  5562 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.667933 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.721262  5583 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.721679  5640 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.722074  5636 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.722457 32080 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.727262  5636 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:34.699148 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 103646us
I20260709 12:24:34.727692 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.728253 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.729348 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.729810  5645 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.730818  5636 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.730932  5583 consensus_queue.cc:1059] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:34.731246  5530 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:34.719947 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.732059  5583 consensus_queue.cc:1059] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.732460  5636 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:34.732937 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.733505 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.723436  5643 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.721365  5613 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.732901  5636 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.734314  5643 raft_consensus.cc:3055] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:34.730463  5645 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.725955  5638 raft_consensus.cc:3055] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:34.734742  5643 raft_consensus.cc:740] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.735106  5638 raft_consensus.cc:740] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:34.735114  5636 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.735834  5643 consensus_queue.cc:260] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.736232  5638 consensus_queue.cc:260] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.736932  5636 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.737301  5643 raft_consensus.cc:3060] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:34.737599  5638 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.733767  5646 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:34.738893  5578 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:34.733741  5583 raft_consensus.cc:3055] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:34.741473  5583 raft_consensus.cc:740] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.725297 31418 raft_consensus.cc:2468] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
W20260709 12:24:34.743546 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50371.5us
I20260709 12:24:34.744206 31537 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:34.723956 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64425.6us
I20260709 12:24:34.745795  5635 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:34.746816  5646 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.747728  5646 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.748463  5646 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:34.744690 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.748883 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.749997  5618 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:34.750308  5631 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.750811  5631 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.750715  5562 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:34.751385  5631 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.750479  5618 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:34.752511  5618 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.753500 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.753759  5618 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:34.754902  5562 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:34.755541  5606 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.757740  5592 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:34.756136 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.759217 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.759550  5583 consensus_queue.cc:260] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:34.774441 31537 consensus_peers.cc:597] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 -> Peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Couldn't send request to peer e166c1cb41f04d55a85e6c0d7966e32e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d54aaf3e560149eca7c259e9a3b7e37e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.775612  5583 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.775941  5635 consensus_queue.cc:1059] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.777060  5635 raft_consensus.cc:3055] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:34.777441  5635 raft_consensus.cc:740] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.760272 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.760311 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.780195 32080 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.760735  5592 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:34.780864  5592 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.765381 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.782421  5592 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.784605 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.785602  5594 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.786528 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.788825  5610 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.768615 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.770290 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.771904  5606 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:24:34.778481  5635 consensus_queue.cc:260] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.796347  5606 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:34.796701  5606 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.797227  5635 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:34.797757  5606 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.799434  5606 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:34.781220 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.807709 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.781358  5530 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:34.812070 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.812573  5530 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.812763 32080 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.813015  5530 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:34.814433 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.815866 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.816620 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:34.816963  5578 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:34.817574 31492 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:34.817530  5578 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.818131  5578 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:34.782917 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.820106  5617 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:34.781241  5608 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.820755  5617 consensus_queue.cc:1059] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:34.821290  5561 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:34.822031  5594 raft_consensus.cc:3055] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:34.821866  5617 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:34.822367  5561 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:34.822453  5594 raft_consensus.cc:740] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:34.822909  5561 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:34.823292  5641 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:34.823700  5641 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:34.824087  5638 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.790115 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.790812 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.824769 32109 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:34.825150 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 79768.1us
I20260709 12:24:34.825340 31466 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.825887 31389 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.826097  5617 raft_consensus.cc:2804] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:24:34.792340 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.826594  5647 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:34.827391  5617 raft_consensus.cc:697] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:34.765962  5646 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:34.828624 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:34.828922 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.829687 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.830179 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:34.830852 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.831229  5586 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.831940  5586 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.831983 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.832657  5586 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.833380  5586 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:34.821617 31420 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:34.824714  5641 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.768206  5640 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.827113  5647 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.835107  5641 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:34.837297  5647 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.791287 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:34.839562 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48363.5us
I20260709 12:24:34.839856  5640 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:34.775934 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.840394 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.823642  5594 consensus_queue.cc:260] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.841269  5590 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:34.841676  5594 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:34.841980  5590 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.841269  5592 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.823855  5561 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.763485  5631 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.828373  5617 consensus_queue.cc:237] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.849665  5561 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:34.846992 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.851809  5631 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:34.852201  5562 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:34.847573  5638 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:34.853049 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.855593 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:34.840301  5530 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:34.857860 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 81933.7us
I20260709 12:24:34.863101 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.863399 31537 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:34.866441 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.867393 31492 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:34.867950 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.868454 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.869319 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.808279  5610 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:34.860301 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.861346 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.862067 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.870534 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.858098 32109 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:34.872313 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.873670 31492 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:34.874504 31422 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:34.876282 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.877811 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.880717 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.866089  5409 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:34.885288 31420 raft_consensus.cc:1240] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.863034  5562 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:34.886860 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.886559  5562 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:34.880427  5645 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:34.888978  5562 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.886533 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.885959 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:34.896085  5606 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:34.899943 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:34.900660 31421 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:34.902874  5592 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.907331  5530 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.915192 31569 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:34.917886 31423 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 21.
I20260709 12:24:34.907331 31492 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:34.915591 31416 raft_consensus.cc:2468] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:34.922914 31500 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:34.928789 31494 raft_consensus.cc:1240] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:34.932816  5643 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:34.933354  5643 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.879805  5610 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.935102  5610 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:34.937654 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.938786  5594 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:34.940994 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.941309  5647 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:34.942606  5647 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:34.943058  5647 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.944044  5647 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.945458  5647 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.951604 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.956069 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.958401 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.960866 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.963263 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.966213 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.968607 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.971439 31565 raft_consensus.cc:1240] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:34.972105 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:34.973750 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:34.973827  5567 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.977164  5409 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:24:34.977824 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 163468us
I20260709 12:24:34.978391  5409 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:34.978767 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.978895  5409 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:34.934402  5643 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:34.980093  5651 raft_consensus.cc:2764] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:24:34.980192  5409 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.981379  5645 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:34.981734  5409 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.982247 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.982483  5646 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:34.980233  5618 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:34.983116  5646 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:34.983187  5651 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:34.984454 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.985122  5651 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:34.985514  5651 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:34.985846  5651 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:34.989024 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:34.991192  5646 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.993074 31387 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.993979 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:34.993245  5651 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:34.996151  5567 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:34.996726  5651 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:34.997170  5567 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:34.999012  5645 consensus_queue.cc:1059] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:34.999182  5567 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.000234  5613 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:35.000653  5613 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.001480  5613 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.003187  5613 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.008850 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.011441 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.012534 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:34.982926  5643 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:35.013592  5561 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.013829 32080 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.015117  5530 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.015213 32080 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.015996  5592 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:35.017084 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.017820  5530 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.017995 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:35.018159 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.018913  5530 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:35.019205  5561 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:35.019371  5530 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:35.020085  5530 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:35.020223  5561 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.021226  5561 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.024595 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.026304 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.027720  5583 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.029075  5583 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:34.996748  5646 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.030839 31389 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.019182 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.027716 31492 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:35.034365  5653 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:35.034955  5583 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:35.034420 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.038985 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.040148 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.041208 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.042826 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.044095 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.044356 32106 raft_consensus.cc:1240] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:35.045465 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.045528 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.046334 32107 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:35.048851 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.049598 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.050101 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.051491 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.053666 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.054081 31389 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.054821 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.055366 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.013576  5631 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:35.065657 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.056603  5409 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:24:35.069209  5610 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.070763  5635 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.072360 31416 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:35.030375  5613 consensus_queue.cc:1059] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:24:35.074863 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.076808  5645 consensus_queue.cc:1059] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:35.077693 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.079118 32110 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:35.080438 32112 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:35.080945 32110 raft_consensus.cc:1240] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:35.083331  5409 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:35.083815  5409 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.083917 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.084460  5613 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:35.084964  5613 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.085197 31540 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.084872  5409 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.085848  5613 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.086802  5409 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:35.087337 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.087843  5596 raft_consensus.cc:2804] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:35.088799  5575 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:35.089146  5575 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.089346  5583 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:35.089748 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.089995  5583 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.090328  5606 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.034970  5653 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.090003  5575 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.092120  5575 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.091694  5653 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.086848  5644 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:35.096163 32109 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:35.102284 31320 catalog_manager.cc:5697] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.082381 32106 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:35.116860  5596 raft_consensus.cc:697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.115206  5635 consensus_queue.cc:1059] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:24:35.118005 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.118466  5647 raft_consensus.cc:3055] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:35.118778  5606 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:35.118891  5647 raft_consensus.cc:740] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:35.119967  5647 consensus_queue.cc:260] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.120343 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.118188  5596 consensus_queue.cc:237] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.121162  5606 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.121428  5647 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:35.122742 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 63251.8us
I20260709 12:24:35.080780  5578 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.123988 32105 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:35.114521  5643 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:35.127314 31416 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:35.130240  5645 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:35.131469  5645 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:35.132282  5645 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.134310  5645 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.135036  5613 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.135735  5645 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.139298 31537 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.139892 32111 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:35.143488  5657 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.143896  5610 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:35.146042 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.114089 32107 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:35.147509 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.150198 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.156062 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.156978 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.160423 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.160732 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.162751  5646 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.163453 31421 raft_consensus.cc:1240] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:35.163579  5646 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:35.163972 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.164350  5578 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:35.167704 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.169342 32112 raft_consensus.cc:1240] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:35.171422 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.175602 31463 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.177141 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.178802 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.179698 31418 raft_consensus.cc:2468] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:35.184933  5641 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.191673 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.192907 31463 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.193277 32108 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:35.195936 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.197949 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.199084 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.194113  5594 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:35.200439 31418 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:35.200997 31463 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.195417  5590 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.195253  5530 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.202831  5562 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:35.203924  5530 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:35.205152 31321 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.195608  5561 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.199996  5641 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:35.206801 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.207383 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:35.201586  5617 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:35.220700 31569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:35.221324 31569 raft_consensus.cc:606] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:35.222949 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:35.227255 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:35.228091 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.228241  5617 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:35.230654  5618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48058 (request call id 2) took 2588 ms. Trace:
I20260709 12:24:35.231757  5617 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:35.232599 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.232950  5641 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:35.233320 32108 raft_consensus.cc:2393] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:35.231115  5618 rpcz_store.cc:276] 0709 12:24:32.642291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.642434 (+   143us) service_pool.cc:224] Handling call
0709 12:24:32.724708 (+ 82274us) log.cc:844] Serialized 513 byte log entry
0709 12:24:35.230558 (+2505850us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219027,"raft.queue_time_us":230255,"raft.run_cpu_time_us":2502,"raft.run_wall_time_us":373516,"thread_start_us":185393,"threads_started":1,"wal-append.queue_time_us":246461,"wal-append.run_cpu_time_us":12255,"wal-append.run_wall_time_us":1927954}
I20260709 12:24:35.233711 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.234411 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.233314  5641 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.236315  5641 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.237607  5641 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:35.240542 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.242123 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.246090 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.240830 32112 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:35.247769 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.248570 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.248925 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.250121 31422 raft_consensus.cc:1240] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:35.255082 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.243620 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.249797 31537 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.267087  5590 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:35.268785 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:35.269590 32107 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:35.271677 32110 raft_consensus.cc:1240] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:35.273396 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.274211 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:35.274163  5578 consensus_queue.cc:1059] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:35.279358  5578 raft_consensus.cc:3055] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:35.279772  5578 raft_consensus.cc:740] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.271535 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.280730  5578 consensus_queue.cc:260] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.282251  5578 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.275296  5608 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.248628  5634 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.277832  5613 raft_consensus.cc:3060] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:35.284929 32113 raft_consensus.cc:1240] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:35.287753 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.270928 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.289096 32105 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:35.294144 32109 raft_consensus.cc:2468] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:35.272541  5562 consensus_queue.cc:1059] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:24:35.296204 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.298583 32111 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:35.301250 32114 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:35.304585  5409 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:35.303864  5590 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:24:35.307973 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 64439.5us
I20260709 12:24:35.310078 32080 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.311383 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.315114  5610 raft_consensus.cc:2804] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:35.315399  5561 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:24:35.316296  5634 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:35.316766  5561 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:35.316956  5634 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.317276  5561 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.315754  5610 raft_consensus.cc:697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.319770  5610 consensus_queue.cc:237] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.310891  5653 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.324388 31569 raft_consensus.cc:3060] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.318248  5634 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.330696 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.335173 31569 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:35.336457  5530 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:24:35.345171 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.348876  5592 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:35.352053 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.346017  5663 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.354600 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.356834  5631 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:35.349532  5590 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.357337  5663 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:35.345822  5651 consensus_queue.cc:1059] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:24:35.353259  5617 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260709 12:24:35.362663 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.362921  5653 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:35.363446  5653 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.364360  5562 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:35.364837  5562 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.364907  5664 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:35.365418  5664 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.367158  5664 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:35.368129  5658 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:24:35.372574 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.371758 31322 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 20 to 21, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 21 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.364401  5653 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.370461  5664 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:35.356055  5530 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.375373 31315 catalog_manager.cc:5697] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 19 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.376339  5653 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.377355  5613 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:35.382448  5641 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:35.386651 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.318295  5561 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.400182 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.405449  5646 raft_consensus.cc:993] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:35.405997  5646 raft_consensus.cc:1081] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:35.411368  5651 raft_consensus.cc:3055] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:35.411808  5651 raft_consensus.cc:740] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.412679  5651 consensus_queue.cc:260] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.413837  5651 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:35.414918 31424 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:24:35.415648 31424 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.416078 31424 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:35.416145  5592 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:35.417549 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.366127  5562 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.423763  5608 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:35.424153  5608 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.424757  5636 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.425132 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.425051  5608 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.426201  5530 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:35.426318 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.426503  5608 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:35.427799 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:35.428563  5561 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.430891  5636 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:35.432160  5575 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:35.432687  5575 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.433532  5575 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.443655 31569 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:35.445732  5664 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:35.455410 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.455487  5645 consensus_queue.cc:1059] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:35.456676  5645 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.457304  5618 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:35.457715  5618 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.458523  5618 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.459728  5618 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:35.456646 31537 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:35.461611 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:35.463238 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:35.470042  5613 raft_consensus.cc:2804] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:35.472959  5646 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:35.475271  5613 raft_consensus.cc:697] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.476409 31569 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:35.476184  5613 consensus_queue.cc:237] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.470615  5657 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:24:35.479980 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 125526us
I20260709 12:24:35.481278 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:35.484378 31424 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.496368 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:35.478386  5608 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:24:35.480366  5657 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:35.486322  5664 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:35.501276 31424 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:35.501859 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:35.507082 32111 raft_consensus.cc:2393] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 19: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:35.486763  5617 consensus_queue.cc:1059] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:24:35.518003 31416 raft_consensus.cc:1275] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:35.519588  5666 raft_consensus.cc:3055] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:35.520063  5666 raft_consensus.cc:740] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.520929  5666 consensus_queue.cc:260] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.523703  5666 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.517428  5657 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.529490 31418 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:35.553612 31492 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:35.553797 32111 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:35.555274  5635 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:35.564371  5664 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:35.565713  5664 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.575789 31418 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:35.535356  5667 consensus_queue.cc:1048] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:24:35.575402  5635 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.599167  5608 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:35.611462 31418 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:24:35.587250  5561 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:24:35.648787 31574 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:35.651542 31494 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:35.622562  5562 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.607298  5635 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.623087  5636 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:24:35.690084  5578 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:35.698611 31494 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:35.681886  5674 ts_tablet_manager.cc:933] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:35.720994 32111 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:24:35.722741  5575 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:24:35.751535  5636 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:35.752064  5636 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:35.753032  5636 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:35.757191  5636 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:35.765259  5635 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:35.772171 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:35.774963 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:35.775749 31573 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
I20260709 12:24:35.776978 31389 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:35.772799 31500 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
I20260709 12:24:35.794369 31574 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:24:35.799072  5610 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 12:24:35.794103  5685 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:35.805459  5685 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.805814  5685 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:35.808101  5643 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:35.824479 31416 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:24:35.848742 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56386.2us
I20260709 12:24:35.850028 31419 raft_consensus.cc:1275] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:35.848269  5610 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:24:35.865568 31569 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:35.892277  5645 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:35.892930  5645 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.895783  5645 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:35.900345 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:35.901248 31494 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:35.860515  5646 consensus_queue.cc:1048] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:24:35.926972 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:35.927796 31419 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:24:35.931373  5687 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:35.933794 31421 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:35.934643  5685 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.936887  5685 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:35.937472 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:35.938035 31494 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:24:35.939574  5686 log.cc:927] Time spent T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:35.950775  5613 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:35.951363  5613 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.953577  5613 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:35.943307 31494 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:35.956275 31390 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:35.957078  5685 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:35.957784  5685 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:35.958601  5685 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:35.997267 31421 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:35.999783 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.000476 31494 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:36.000581 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:36.002497 31569 raft_consensus.cc:1275] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:36.003125 31565 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:36.004488 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:36.005247 31571 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:36.015692 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:36.016515 31424 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:36.017508 31573 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:36.020617  5643 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:36.031935  5643 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:36.032835  5643 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.034783 32114 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:24:36.035851 32111 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:36.034834 32109 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:36.040892 32113 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:36.044070  5578 consensus_queue.cc:1048] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:36.050225 31571 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:36.051981  5409 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:36.052775 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:36.056931 31421 raft_consensus.cc:3060] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:36.057835 32105 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:35.919549  5674 tablet_copy_client.cc:323] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.143.195:34217
I20260709 12:24:36.071905  5677 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:36.073916  5677 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:36.074497 31585 tablet_copy_service.cc:140] P 8553a13b444649b9a19e5488aabaf1c5: Received BeginTabletCopySession request for tablet d54aaf3e560149eca7c259e9a3b7e37e from peer e166c1cb41f04d55a85e6c0d7966e32e ({username='slave'} at 127.0.0.1:58364)
I20260709 12:24:36.075102 31585 tablet_copy_service.cc:161] P 8553a13b444649b9a19e5488aabaf1c5: Beginning new tablet copy session on tablet d54aaf3e560149eca7c259e9a3b7e37e from peer e166c1cb41f04d55a85e6c0d7966e32e at {username='slave'} at 127.0.0.1:58364: session id = e166c1cb41f04d55a85e6c0d7966e32e-d54aaf3e560149eca7c259e9a3b7e37e
I20260709 12:24:36.082410  5409 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:36.086263 31421 raft_consensus.cc:1275] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:24:36.089303 31585 tablet_copy_source_session.cc:215] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:36.091610  5409 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:36.095129 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:36.109231 31322 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 17, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.105825  5575 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:36.095889  5613 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:36.122670 31322 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: config changed from index -1 to 12, NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) added. New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } } }
I20260709 12:24:36.124478 31322 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.125993 31322 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 17 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:36.088146  5646 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:24:36.127614 31322 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.159188 31322 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 14 to 15, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:36.180181  5409 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.181039  5409 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.119871  5575 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.121037  5613 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.116956  5676 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:24:36.117661  5666 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:24:36.191109  5409 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.188486  5613 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:36.187633  5575 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.219002 32105 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:36.219604  5645 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.220153  5645 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.222213  5645 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.223752  5562 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:36.203306  5674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54aaf3e560149eca7c259e9a3b7e37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:36.240008  5685 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.325069  5567 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.325802  5567 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.328493  5567 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.329178 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.329684 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.330360 32105 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:36.331849 31387 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:36.333161  5567 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:36.333876  5567 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.334501  5567 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:36.405673 31572 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:24:36.369773 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 50429.4us
I20260709 12:24:36.428313 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.429306 31500 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
W20260709 12:24:36.363549  5662 log.cc:927] Time spent T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:24:36.418161  5409 consensus_queue.cc:1048] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:36.347927  5695 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.461336 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.466578 32114 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:36.460773 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.465930  5409 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.468407  5409 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.348243  5685 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.366490  5590 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:36.464653  5666 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:36.458547  5645 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:36.526770  5409 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.469699  5643 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.478404  5685 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:36.523933  5707 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.416s	user 0.002s	sys 0.000s
I20260709 12:24:36.504805  5690 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:36.587404 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 128015us
I20260709 12:24:36.491012  5695 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.565439  5653 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.575892  5701 log.cc:927] Time spent T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:24:36.603984 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 137076us
I20260709 12:24:36.545310  5590 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.605417  5690 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:36.610430  5710 log.cc:927] Time spent T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:36.612475  5562 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.613282  5690 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:36.613008  5562 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.619520  5562 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.626653  5635 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.635082  5635 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.637398  5635 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:36.638469  5657 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.639112  5657 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.641245  5657 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.579349  5685 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.646095 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:36.567384  5645 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.661037  5562 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:24:36.642655  5653 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.689344  5653 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:36.676599  5590 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.691169  5590 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.563405  5666 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.691745  5590 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.693186  5666 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:36.693747  5711 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:36.695374  5613 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.664317  5664 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:36.696552  5664 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.697371  5613 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:36.573282  5643 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.699203  5664 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:36.699751  5643 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.700637  5590 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.701867  5685 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.704073  5685 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.722918  5643 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.714286  5635 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.729727  5635 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.730590  5645 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:36.732699 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 144433us
I20260709 12:24:36.737519  5409 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.738116  5409 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.723513  5643 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.655135  5719 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.686075  5695 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.738868  5590 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.655310  5575 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:36.743151  5409 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:36.743330 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:36.747162  5719 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.747452 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.749267  5719 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.750353  5712 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:36.750124  5590 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.750924  5712 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.751401  5712 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.751477  5575 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:36.727947  5721 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.662708  5567 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.759358 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.765097 31568 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:36.745740  5635 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.752421  5590 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:36.785259 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:36.798629 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.799057 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.799295 31572 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:36.799877 31569 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:36.798408 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.801590 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:36.802070 31566 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:36.804126 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.778295  5592 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:36.807435  5592 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.811935  5636 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:36.812389  5636 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.812754  5636 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:36.778481  5653 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:36.818425 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:36.819067 31422 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:36.758015  5721 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.824992 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:36.825732 31416 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:36.826699 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.826748 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:36.827384 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.827404 31574 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:36.815124  5723 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.830086 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:36.820140  5653 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.832494 31566 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 20: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:36.832451 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:36.834612 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:36.835448 31571 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:36.834434 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:36.839293 31423 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:36.842024 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:36.884739 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:36.888648  5409 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.836663  5695 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:36.847503  5727 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:36.847929  5676 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:36.891186  5409 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.848062  5725 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:36.890928  5722 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.917006 31416 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:24:36.924182 31571 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:36.899319  5695 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:36.907509  5720 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:36.934643 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.938472 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:36.898627 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 56493.1us
W20260709 12:24:36.929347 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 144160us
I20260709 12:24:36.933441 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.933751 31500 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:36.934283 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:36.886620  5690 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:24:36.924228  5713 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.285s	user 0.000s	sys 0.008s
I20260709 12:24:36.930454 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:36.939193 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:36.988267 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.986249 32109 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:37.033629 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.994546 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.003070 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.100631 31494 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:37.104336  5409 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:37.115799 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 185423us
I20260709 12:24:36.938719 31498 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:37.117141 32111 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:36.939122 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:37.016491 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:37.030823 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 95313.9us
I20260709 12:24:36.995103 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.101622 31416 raft_consensus.cc:2393] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 13: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:37.118966 31571 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:37.018182 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:24:37.120123 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102056us
I20260709 12:24:37.122886 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.032938 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:36.930919  5725 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.123694 31422 raft_consensus.cc:2393] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:37.124213 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.032603 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.126611 32106 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 20: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:37.126609 31494 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:37.128461 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:36.939731  5695 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:37.129973 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 113416us
I20260709 12:24:37.127876 31498 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:37.129242 31494 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:36.937816  5677 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.033474  5651 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.134349 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:36.995999  5653 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.135226 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.135928 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.136641 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.049027  5732 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.038864  5730 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.930779  5727 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.937892  5578 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:36.930385  5676 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.946250  5643 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.115119  5610 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.110776 32107 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 13: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:37.138878 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:36.930015  5590 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.157493 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.219249 31494 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:37.114703  5738 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.140821  5645 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:37.141448  5737 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.216650 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78118.3us
I20260709 12:24:37.231798 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.135784  5667 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:37.114774  5717 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:37.106940  5567 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.115170  5641 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.997157 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.227900 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.229910 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.235868 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1638) took 1143 ms. Trace:
I20260709 12:24:37.140758  5725 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.176965  5721 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.248535 31498 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:24:37.214216  5676 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:37.175482  5727 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:37.260416 31495 raft_consensus.cc:2393] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:37.248799 32113 rpcz_store.cc:276] 0709 12:24:36.083623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.084142 (+   519us) service_pool.cc:224] Handling call
0709 12:24:36.101541 (+ 17399us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b58001f3598. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11663eb71 00007fc11663ea22 00007fc11f5578d9 00007fc11e6b1ee0 00007fc11e77b0ab 00007fc11e77b131 00007fc11e73cfc0 00007fc11e727929 00007fc11e7273d2 00007fc117c9ebd4
0709 12:24:36.101713 (+   172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.102050 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.102076 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.108642 (+  6566us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.405682 (+297040us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:36.405743 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.405827 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.753605 (+347778us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:24:37.226707 (+473102us) raft_consensus.cc:1685] finished
0709 12:24:37.226731 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.226847 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":504,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11223,"spinlock_wait_cycles":29056768,"thread_start_us":230920,"threads_started":1,"wal-append.queue_time_us":480312}
I20260709 12:24:37.226130  5645 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.238479  5734 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:37.270872 31492 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:37.238588  5745 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.175403  5651 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:37.259192 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 140159us
I20260709 12:24:37.237228  5667 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:36.994942  5722 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.168073  5677 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.247700  5646 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:36.994818  5720 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.313505 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.315682 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.316298 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.225986  5610 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.227391  5590 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.215683  5732 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:36.836397  5723 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.312068 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:37.268357  5530 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.378242 32106 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:37.273860  5645 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:37.424782 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 170677us
W20260709 12:24:37.379421 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 245131us
I20260709 12:24:37.287923 31498 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:37.380005 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.248680  5636 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.272800  5734 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.238042  5578 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.384428 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.256163  5641 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.422233 31494 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
I20260709 12:24:37.258813  5721 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:24:37.272531  5726 raft_consensus.cc:476] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Not starting pre-election -- already a leader
W20260709 12:24:37.392904 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80939.5us
I20260709 12:24:37.322631  5667 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.378230 32113 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:37.353696  5646 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.248844  5717 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.224090  5730 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.272403  5631 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.382723  5690 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.437588 32105 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:37.236549  5738 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.365346  5747 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:37.435091 31496 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:37.436592 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:37.475031 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 153926us
I20260709 12:24:37.430228  5530 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.432950  5751 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.239418  5737 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.442176 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.444072 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.449242 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.450659 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:37.451222 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66907.8us
W20260709 12:24:37.440670  5731 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.511s	user 0.001s	sys 0.000s
I20260709 12:24:37.455148 32114 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:37.437036  5716 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:37.459795 31491 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:37.438647  5734 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:37.440303  5743 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.453823  5643 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.481225 31421 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:37.310231  5745 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.489482 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.492492 31493 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:37.464771  5646 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:37.468288  5567 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:37.522856  5567 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.523051  5745 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.523329  5567 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:37.492862  5751 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.523854  5730 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.524658 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 3710) took 1120 ms. Trace:
I20260709 12:24:37.525352  5751 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.526042  5651 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:37.526328  5729 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:37.464702  5749 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.526583  5739 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:37.527034  5739 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.526955  5749 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.527484  5739 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:37.527531 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 3713) took 1122 ms. Trace:
I20260709 12:24:37.528030 31565 rpcz_store.cc:276] 0709 12:24:36.404966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.458648 (+ 53682us) service_pool.cc:224] Handling call
0709 12:24:36.458946 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.459257 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.459284 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.492413 (+ 33129us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.844522 (+352109us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:36.844570 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.844641 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.527339 (+682698us) raft_consensus.cc:1685] finished
0709 12:24:37.527359 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.527473 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87089,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":17097,"thread_start_us":298210,"threads_started":1,"wal-append.queue_time_us":765676}
I20260709 12:24:37.529126  5749 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.507558  5578 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.475010  5747 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.530093  5747 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:37.512871  5743 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.531845  5717 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.532501 31422 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:37.531860  5592 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.533165  5743 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.533501  5530 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.540588 31463 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:37.541761 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:37.511323 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.491483  5750 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.517755 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 417147us
I20260709 12:24:37.549239 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.475417  5690 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.519361  5641 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.520340  5636 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.515915  5643 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:37.562774 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112450us
I20260709 12:24:37.541813  5646 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.525013 31573 rpcz_store.cc:276] 0709 12:24:36.404130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.404248 (+   118us) service_pool.cc:224] Handling call
0709 12:24:36.404550 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.404879 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.404906 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.435965 (+ 31059us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.786794 (+350829us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:36.786849 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.786915 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.524411 (+737496us) raft_consensus.cc:1685] finished
0709 12:24:37.524431 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.524554 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":456,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":60315,"thread_start_us":263237,"threads_started":1,"wal-append.queue_time_us":348173}
I20260709 12:24:37.544250  5738 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.545043  5562 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:37.545526  5743 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:37.548031 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.584897 31569 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:37.508589 31499 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:37.549649 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.553771  5409 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:37.586124  5409 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.586628 31390 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.587827  5746 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:37.588033  5409 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.588227  5746 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.588608  5746 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:37.556241 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 104385us
I20260709 12:24:37.553057 31500 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:24:37.479255  5631 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:37.561474 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 112697us
I20260709 12:24:37.552165  5745 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:37.594087 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.593266 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:37.598395 32111 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:37.596072 31424 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:37.598620 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.562263  5717 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:37.538439  5734 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:37.604732 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 114403us
I20260709 12:24:37.584583  5562 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.591833  5730 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:37.608582 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.611869 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.612593 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.593988  5651 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.594003  5756 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.615058 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.600504  5592 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.622594 31498 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:37.597712  5745 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.631449 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.600291  5636 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.633967 31573 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 17: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:37.601219  5722 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:37.613823  5712 consensus_meta.cc:287] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.862s	user 0.012s	sys 0.000s
I20260709 12:24:37.637977 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.638376 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.640916 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:37.661665 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.663584 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.664168 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.639081 32111 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:37.664618 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:37.604157  5530 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.621271  5562 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:37.657691 31565 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:37.595867  5743 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.624405  5738 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.633167 31495 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:37.596482  5567 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.683601 31498 raft_consensus.cc:2393] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:37.684017 31574 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:37.686630 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.688387 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.553081  5750 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.691388 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.692370 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.697710 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.622421  5677 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.668895  5745 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:37.715128  5643 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.686416  5757 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.715960  5757 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.718135  5757 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.658308  5590 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.689814  5749 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:37.632532  5725 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.721443  5725 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.722131 31420 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:37.703401 31565 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:37.723171  5567 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.723543 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.724145 31565 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:37.692463  5732 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.704509 31497 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:37.735677  5727 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.707635  5734 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.708789  5631 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.697324  5758 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:37.747905  5758 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:37.748800  5758 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.637826  5756 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.690232  5712 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.751407  5690 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.708709  5743 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.697635  5723 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.752450  5756 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.752465  5712 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.692724  5530 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.755115  5732 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.689312  5720 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.740682  5745 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.742810  5722 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:24:37.744098  5737 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.745290  5646 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.746269  5746 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.705164 31572 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:37.758312 31574 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:37.755661  5732 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.613657  5717 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.807103 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:37.807156 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47769us
I20260709 12:24:37.772877 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.808147 31565 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:37.763250 31566 raft_consensus.cc:2368] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14.
W20260709 12:24:37.763062 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 176491us
I20260709 12:24:37.763653 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.807757 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:37.809897 31498 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:37.633363  5651 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.765784 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.808436 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:37.815301 31495 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:37.767350 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.674589  5636 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.767959 31416 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:37.657244  5592 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.639428  5716 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:37.773662 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.703939  5760 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:37.809983 31572 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:24:37.765363 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 139620us
W20260709 12:24:37.812335 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 261472us
I20260709 12:24:37.767033  5530 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.768213  5766 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.824271 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 234870us
I20260709 12:24:37.766325  5749 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:37.705452  5738 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.831312 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.833055 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:37.839392 31415 raft_consensus.cc:3060] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:37.769229  5741 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.504s	user 0.004s	sys 0.000s
W20260709 12:24:37.823603  5728 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.017s
I20260709 12:24:37.836864 31498 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:37.829349 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.858909 32113 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 13.
W20260709 12:24:37.858500 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 192112us
I20260709 12:24:37.835278 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:37.840847 31465 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.860805 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 2523) took 1041 ms. Trace:
I20260709 12:24:37.824738  5734 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:37.861203 31423 rpcz_store.cc:276] 0709 12:24:36.819511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.819654 (+   143us) service_pool.cc:224] Handling call
0709 12:24:37.860642 (+1040988us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540024fc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:37.860751 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26611072}
I20260709 12:24:37.863065 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.862700 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.864543 32105 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:37.859935 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.865053 31498 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:37.813123  5631 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.865741 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 270122us
I20260709 12:24:37.841997  5643 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:37.864437 32079 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:37.871819 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.874109 32112 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:37.872505 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:37.860982  5728 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.018s
I20260709 12:24:37.837802  5636 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:37.869755 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.875447 32109 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:37.872968 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.881708 32106 raft_consensus.cc:2368] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:37.868644 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.882086 32108 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:37.877063 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:37.870741 31389 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:37.878022 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:37.882839 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:37.878088 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.877894 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.883476 32105 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:37.886653 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.885607 32079 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:37.887589 31493 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:37.889366 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.889534 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:37.890101 31493 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:37.894026 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.863853  5734 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.859843  5737 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:37.875808 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:37.882989 31574 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:37.880163 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:37.902422 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.897166 32079 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:37.880793  5643 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.907497 32114 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:37.872310  5756 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:37.876670 31387 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:37.867194  5773 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:37.914386 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.921945 31499 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:24:37.923136 31496 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:37.921651 31415 raft_consensus.cc:2468] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:37.914304 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.924638 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.885088  5775 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:37.905107  5720 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:37.903628  5636 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:37.903483  5712 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:37.915443  5764 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:37.877609  5631 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:37.909096  5674 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.003s
I20260709 12:24:37.837765  5760 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.949011 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:37.907418  5734 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:37.932747  5695 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
I20260709 12:24:37.922330  5643 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:37.948738 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.936997  5784 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:37.949271  5720 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.916230  5737 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.968593 31493 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:37.915203  5777 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:37.928323  5773 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.961561 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:37.922531  5761 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:37.860276  5766 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.905055  5739 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.913772  5645 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.966858 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 2520) took 1145 ms. Trace:
I20260709 12:24:37.956174 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:37.954159  5764 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.885226  5567 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:24:37.949689  5636 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:37.932230  5756 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.974696  5761 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.044315  5761 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:38.045296  5756 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:38.056617  5737 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.057544  5753 raft_consensus.cc:2804] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:38.058243  5753 raft_consensus.cc:697] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:38.059343  5753 consensus_queue.cc:237] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.060935  5776 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:38.062988  5592 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.041250  5636 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:38.064815  5778 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:37.937533  5716 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:37.957630  5712 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:38.067579  5712 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.070096  5674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55788 (request call id 1618) took 2597 ms. Trace:
I20260709 12:24:38.070592  5674 rpcz_store.cc:276] 0709 12:24:35.472798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.472946 (+   148us) service_pool.cc:224] Handling call
0709 12:24:35.721173 (+248227us) ts_tablet_manager.cc:934] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
0709 12:24:36.121605 (+400432us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:37.103199 (+981594us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:37.119641 (+ 16442us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:37.966933 (+847292us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:38.036038 (+ 69105us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:38.069878 (+ 33840us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:38.069974 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":548,"tablet-copy.queue_time_us":117826,"thread_start_us":232804,"threads_started":2}
I20260709 12:24:38.072613  5674 tablet_copy_client.cc:806] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:38.073272  5674 tablet_copy_client.cc:670] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:38.077761  5766 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:38.078614  5732 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.079306  5746 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.971313  5747 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.966163  5695 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:38.085558  5695 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.086252  5695 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:37.982944  5651 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.986616  5767 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:38.137012 31417 raft_consensus.cc:2368] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:38.082360  5747 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.061487  5776 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:37.952168  5775 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:37.974483  5773 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:37.968060  5664 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:37.992535 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:37.971238  5720 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:38.039633 31497 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:37.973281  5667 consensus_meta.cc:287] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
W20260709 12:24:38.042255 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 165653us
I20260709 12:24:38.001765 31419 rpcz_store.cc:276] 0709 12:24:36.818383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.818553 (+   170us) service_pool.cc:224] Handling call
0709 12:24:36.818866 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.820377 (+  1511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.820411 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.823255 (+  2844us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.915234 (+ 91979us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:36.915289 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.915378 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.755597 (+840219us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:24:37.959382 (+203785us) raft_consensus.cc:1685] finished
0709 12:24:37.959407 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.964033 (+  4626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1160,"raft.queue_time_us":2223,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7942,"spinlock_wait_cycles":41816448,"thread_start_us":88609,"threads_started":1,"wal-append.queue_time_us":400482}
I20260709 12:24:38.086879 31418 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:38.088858  5567 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:38.038820  5727 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.091203  5631 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:37.972519 31496 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:38.094048 31572 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:37.932226 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.125237 32114 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:38.224941 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:38.226022 32114 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 20: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:37.976747  5745 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:37.957391  5749 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.140420 31495 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
W20260709 12:24:38.140116 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 188206us
I20260709 12:24:38.151423  5767 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:38.091612  5729 log.cc:927] Time spent T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:24:38.151163 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 254080us
I20260709 12:24:38.039727  5750 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.182492 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.262199 32079 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:38.262595 32079 leader_election.cc:403] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.262836 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.151562  5664 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.263455  5664 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:38.263703 31422 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:38.264617 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.041559  5764 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:38.136732  5666 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.267418  5666 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:38.269523  5666 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.203428 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.270430 32105 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 20: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:38.205509 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.206954 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:38.272332  5758 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:38.208741 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:38.273365 32106 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:38.273125  5758 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.207121 31540 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:24:38.274628 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 67632.7us
I20260709 12:24:38.227211 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:38.276325  5789 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:24:38.147778 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 225084us
I20260709 12:24:38.277802 31415 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:38.043289  5562 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.231071 31390 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:38.233305 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:38.240446 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.282305 32109 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:38.233755 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:38.286305 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:38.240043 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.239354 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.276163  5646 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:38.229226 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:38.276198 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:24:38.330145 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54035.1us
W20260709 12:24:38.339303 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108326us
W20260709 12:24:38.343447 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90013.5us
I20260709 12:24:38.344931 32079 leader_election.cc:400] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14.
I20260709 12:24:38.345384 32079 leader_election.cc:403] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.344779 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:38.341003 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45487.4us
W20260709 12:24:38.347457 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 61261.2us
I20260709 12:24:38.150619  5776 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:38.229692  5738 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.363449 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.364017 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:38.364822 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:38.282331  5767 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:38.325487  5646 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.418201 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.432472 31422 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:38.420646 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.394309 31495 raft_consensus.cc:2368] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:38.422454 31566 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:38.441416 31572 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:24:38.441941 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 93081.6us
I20260709 12:24:38.442198 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.443058 31415 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:38.443960 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.444708 32114 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 13.
I20260709 12:24:38.445152 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:38.443764 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:38.218616  5667 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:38.459649 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.345989  5750 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:38.488822 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.355298  5651 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:38.508347 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.509114 31422 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:38.393442  5592 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14.
W20260709 12:24:38.444911  5676 consensus_meta.cc:287] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 1.174s	user 0.010s	sys 0.003s
I20260709 12:24:38.424996  5784 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:38.346352  5575 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:38.491150 32106 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:38.393759 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:38.503480 31415 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 12.
I20260709 12:24:38.346225  5727 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:38.503489 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57186.3us
I20260709 12:24:38.489552 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.515345 31572 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:38.338037  5631 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:38.531370 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 3073) took 1412 ms. Trace:
I20260709 12:24:38.444281  5646 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:38.426811  5745 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:38.572834 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.594514  5745 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:38.595178 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:38.595733 31415 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:38.596591  5745 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.598160  5760 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.578482 31491 rpcz_store.cc:276] 0709 12:24:37.104084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.104198 (+   114us) service_pool.cc:224] Handling call
0709 12:24:38.516351 (+1412153us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54002e5754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:38.516547 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705420672}
I20260709 12:24:38.575522 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:38.580811  5798 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:38.545388  5756 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:38.581986  5645 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.545145  5575 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.547168  5676 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.587656 31416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 4197) took 1151 ms. Trace:
I20260709 12:24:38.590121  5768 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:38.612635 31492 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:38.579329 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.589351  5796 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:38.597137  5791 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:38.582922  5739 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:38.639503 32111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.012s	sys 0.007s
W20260709 12:24:38.660722 32111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.012s	sys 0.007s
I20260709 12:24:38.581161  5788 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:38.531046  5750 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:38.610146  5643 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.004s
I20260709 12:24:38.649003 31416 rpcz_store.cc:276] 0709 12:24:37.436238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.436357 (+   119us) service_pool.cc:224] Handling call
0709 12:24:38.587414 (+1151057us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540010b654. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:38.587581 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671855488}
I20260709 12:24:38.662510 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.665422 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
W20260709 12:24:38.665859 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 325412us
I20260709 12:24:38.650900 31415 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:38.671787 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:38.651983  5575 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:38.680815 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.678201 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:38.677116 31491 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:38.683440 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:38.684499 31466 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:38.699031 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:38.609153  5727 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:38.558976  5784 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.705507 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.637806  5631 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.770974 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.773325 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:38.774008 32111 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:24:38.759480 31494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 3082) took 1532 ms (client timeout 1569 ms). Trace:
I20260709 12:24:38.707588  5739 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:38.654801  5756 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.697136  5760 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:24:38.783869 31494 rpcz_store.cc:269] 0709 12:24:37.226801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.227568 (+   767us) service_pool.cc:224] Handling call
0709 12:24:38.759317 (+1531749us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400023fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:38.759422 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326321536}
W20260709 12:24:38.789389 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 441726us
I20260709 12:24:38.794386 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.795189 31572 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:38.796818 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.798668 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.800474 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:38.801250 31497 consensus_meta.cc:287] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.001s
I20260709 12:24:38.802037 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.804296 31497 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:38.706537  5759 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:38.680291  5643 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.814731 32114 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:38.805073 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:38.816398 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.818435 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:38.691584  5788 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.707792  5791 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:38.675951  5768 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.791373  5760 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.826802 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:38.812839  5712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.024s	sys 0.032s
I20260709 12:24:38.807000 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:38.822894  5636 consensus_meta.cc:287] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 12:24:38.809777  5759 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.835089  5760 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:38.837817 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:38.839432 31420 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:38.808288  5792 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:38.837852  5666 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:38.838300  5801 log.cc:927] Time spent T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:24:38.836470  5712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.025s	sys 0.032s
I20260709 12:24:38.848276 32111 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:38.831938  5562 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.864868 31387 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:38.845356  5759 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:38.858435  5802 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:24:38.844774  5667 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:38.872617 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 86029.7us
I20260709 12:24:38.846565  5636 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.851073  5666 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.871690  5808 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:24:38.909739  5764 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.642s	user 0.002s	sys 0.005s
I20260709 12:24:38.891839  5727 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.910064  5717 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.911237  5575 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:38.911883  5734 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.944s	user 0.010s	sys 0.000s
I20260709 12:24:38.912125  5676 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:38.931887 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92345.8us
I20260709 12:24:38.913362  5768 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.914548 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.916272 31420 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
W20260709 12:24:38.916788 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 112772us
I20260709 12:24:38.933310 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:38.888134  5712 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:24:38.926594  5776 consensus_meta.cc:287] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.002s
I20260709 12:24:38.885890  5813 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:38.913079  5643 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.895746  5774 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:38.896864  5750 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:38.955880 31537 leader_election.cc:400] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:38.925050 32107 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:38.956261 31537 leader_election.cc:403] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.943689 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:38.944393 31416 raft_consensus.cc:2393] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:38.906320  5646 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.927973  5764 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:38.950304  5805 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:24:38.950366  5719 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:38.943399 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:38.957806 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:38.931602  5720 consensus_meta.cc:287] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.008s
I20260709 12:24:38.983507  5720 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:38.987177  5806 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:24:38.989185  5784 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:38.989475  5812 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:24:38.989886  5804 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:24:38.990664  5816 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:38.991899 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:38.927217  5808 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:38.972668 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:38.960386 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.976039 31496 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:38.971791  5717 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 13. Current term is 14.
I20260709 12:24:38.978513  5719 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.989913  5812 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:38.999148  5812 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.000084  5764 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:38.972652 31418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55332 (request call id 2528) took 2034 ms (client timeout 1868 ms). Trace:
I20260709 12:24:38.994158 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 2543) took 1112 ms. Trace:
W20260709 12:24:39.002691 31418 rpcz_store.cc:269] 0709 12:24:36.938460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.939001 (+   541us) service_pool.cc:224] Handling call
0709 12:24:38.972479 (+2033478us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540022f954. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:38.972585 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253925120}
I20260709 12:24:38.941227  5712 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.011092  5712 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:39.011179  5756 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:39.012287  5803 log.cc:927] Time spent T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:24:39.013046  5666 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.013491  5808 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.962425  5776 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.001348  5774 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.016837 31419 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:38.997251 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:39.018144 32105 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:39.008550  5818 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:38.893297  5791 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:38.956146  5768 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.028007 31571 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 14: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:24:39.011662  5664 consensus_meta.cc:287] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.001s
I20260709 12:24:38.992393  5631 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.018040 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:38.940383  5734 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:39.029783 31389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.003s	sys 0.021s
I20260709 12:24:38.941123  5727 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.002843 31498 rpcz_store.cc:276] 0709 12:24:37.879173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.880514 (+  1341us) service_pool.cc:224] Handling call
0709 12:24:37.881019 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.325129 (+444110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.325176 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.331041 (+  5865us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.655632 (+324591us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:24:38.655757 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.656068 (+   311us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.991792 (+335724us) raft_consensus.cc:1685] finished
0709 12:24:38.991810 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.991961 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25221,"raft.queue_time_us":67287,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5785,"thread_start_us":726386,"threads_started":2,"wal-append.queue_time_us":453842}
I20260709 12:24:38.931406  5760 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.026372 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:39.030108 31389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.003s	sys 0.021s
I20260709 12:24:39.000466  5719 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:39.035231 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 589629us
I20260709 12:24:39.027814  5809 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.024922  5776 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.050170 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.031286 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:38.991349  5816 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.047101 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:39.026083  5716 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.035913 31389 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:39.056893 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:39.031513  5610 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.054778  5613 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.062794  5613 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.063488  5716 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.065733  5716 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.066725  5613 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.072216  5758 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.073680  5759 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.036131  5727 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.076040  5760 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.078028  5575 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.078421  5788 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.034197  5664 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.080425  5664 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.081136 31493 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:39.053576 31390 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.090785 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.094921 31416 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.096338 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.096648 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:39.097520 31499 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:24:39.098469  5764 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.098985  5764 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.099496 32105 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:39.061597  5792 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:39.061911 31418 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:24:39.101177  5764 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.101814 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.103269 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:39.100494  5792 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.103953  5792 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:39.106657 31499 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
I20260709 12:24:39.107100 31418 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:24:39.110432 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 53640.1us
W20260709 12:24:39.110756 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57286us
I20260709 12:24:39.112689 31390 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:39.113639 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:39.039244  5818 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:39.111608 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:39.119395 31416 raft_consensus.cc:2468] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:39.120253 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.120759 31418 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:39.124306 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.124451 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.125144 31491 raft_consensus.cc:2393] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:39.125280  5750 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:39.125965 31498 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:39.125170  5818 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.127951  5646 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:39.115356  5767 consensus_meta.cc:287] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.005s
I20260709 12:24:39.130349 31496 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:39.031100  5768 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.136468 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.082486  5776 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:24:39.116806  5773 consensus_meta.cc:287] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.928s	user 0.000s	sys 0.011s
I20260709 12:24:39.138855 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.134511  5764 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.093591  5720 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.138846 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.142134 31390 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:39.157344 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 115593us
I20260709 12:24:39.118896  5722 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.143952 31571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:39.144661 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.140185  5747 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:39.148095  5776 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.137315  5750 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.152779  5799 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.118331  5743 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:39.117170  5575 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:38.977116  5813 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.130276  5719 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:39.118234  5808 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:39.161068 31499 raft_consensus.cc:2368] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14.
I20260709 12:24:39.161365 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:39.161996 31571 raft_consensus.cc:606] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:39.136134  5646 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:39.129369  5767 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.153934  5792 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.156991  5636 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:39.160604  5761 consensus_meta.cc:287] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 1.116s	user 0.012s	sys 0.000s
I20260709 12:24:39.167598  5799 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.186374  5727 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.174409  5808 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.185738  5776 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.159703  5772 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.166422  5747 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.188416  5812 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.160182  5764 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.166330  5743 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.173885  5717 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:39.193156 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.193809 31390 leader_election.cc:400] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14.
I20260709 12:24:39.208585 31390 leader_election.cc:403] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.189014  5761 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.209456  5749 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 13. Current term is 14.
I20260709 12:24:39.169121  5750 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.209461 31420 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:39.167551  5790 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:39.211661  5790 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 21 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.199184 31494 raft_consensus.cc:2368] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21.
I20260709 12:24:39.061450  5809 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.172040 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:39.200526 32108 raft_consensus.cc:2368] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
I20260709 12:24:39.163755  5643 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:24:39.218856  5728 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:39.219403  5728 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:39.158165  5773 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.221108 31423 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:39.163486  5722 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:39.188335  5796 consensus_meta.cc:287] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 12:24:39.231341  5813 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.234433  5722 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.234758 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 1514) took 1574 ms. Trace:
W20260709 12:24:39.216351 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44387.6us
I20260709 12:24:39.236177  5774 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.236021 31417 rpcz_store.cc:276] 0709 12:24:37.660521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.666573 (+  6052us) service_pool.cc:224] Handling call
0709 12:24:39.234555 (+1567982us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540010bb54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.234705 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986550144}
I20260709 12:24:39.238857  5618 raft_consensus.cc:993] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:39.239346  5618 raft_consensus.cc:1081] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:39.240581 31423 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 1521) took 1337 ms. Trace:
I20260709 12:24:39.221383  5816 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.207741  5743 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:39.242100 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:39.244813 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.245577 31415 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:39.246168 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.247049 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.247668 31572 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:39.248625 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.249321 31567 raft_consensus.cc:2368] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17.
I20260709 12:24:39.249500 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.217756  5761 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.220995 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:39.205859 31424 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 4199) took 1766 ms (client timeout 2151 ms). Trace:
I20260709 12:24:39.250092 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.250415 31492 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:39.240976 31423 rpcz_store.cc:276] 0709 12:24:37.903687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.915615 (+ 11928us) service_pool.cc:224] Handling call
0709 12:24:39.240444 (+1324829us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003ed354. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.240538 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2884795648}
I20260709 12:24:39.250792 31418 raft_consensus.cc:2393] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 14: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
W20260709 12:24:39.250449 31424 rpcz_store.cc:269] 0709 12:24:37.441827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.441939 (+   112us) service_pool.cc:224] Handling call
0709 12:24:39.205739 (+1763800us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003ee254. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.205815 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267254656}
I20260709 12:24:39.174198  5575 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.199791  5808 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:39.226171  5734 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.226543  5613 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:39.226987  5773 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.182576  5646 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.191397  5664 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.234543 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 1640) took 1363 ms. Trace:
I20260709 12:24:39.235221  5747 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.254067 32079 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.273862  5530 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:39.274223 32079 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.274554 31492 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:39.275229 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.260217 31491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c28624eba07742ab91e568bf551106a4"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:39.275934 31491 raft_consensus.cc:606] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:39.276085 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.276373 31491 raft_consensus.cc:614] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:39.276199 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.277678 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.277966 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.278524 31423 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:39.278769 31571 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:24:39.264816 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:39.264605 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.255136 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:39.260879  5799 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.220274  5728 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.270108 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.264623  5777 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:39.259178 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.268679 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.279843 31424 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:39.261246  5796 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:39.271858 32110 rpcz_store.cc:276] 0709 12:24:37.871148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.871766 (+   618us) service_pool.cc:224] Handling call
0709 12:24:37.872032 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.875289 (+  3257us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:38.195036 (+319747us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.505330 (+310294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.505385 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:38.505434 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.234322 (+728888us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b5400781754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:39.234366 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.234487 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42490,"prepare.queue_time_us":207679,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":29995,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6774,"spinlock_wait_cycles":6932224,"thread_start_us":600721,"threads_started":2,"wal-append.queue_time_us":451704}
I20260709 12:24:39.212462  5790 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.285701 31568 raft_consensus.cc:2410] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:24:39.262950  5758 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:39.290344 31567 raft_consensus.cc:2410] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:24:39.281868 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.293742  5575 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.276453  5530 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:39.253196  5712 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.283440  5773 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:39.285542  5761 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:39.283418  5777 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.314975 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.327814 31572 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:39.271569  5613 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.297421  5743 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.338356 31565 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:39.339084 31421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50108 (request call id 1513) took 1788 ms. Trace:
I20260709 12:24:39.322433 31571 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:39.277245  5664 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.339557 31421 rpcz_store.cc:276] 0709 12:24:37.551042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.623087 (+ 72045us) service_pool.cc:224] Handling call
0709 12:24:37.625197 (+  2110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.709053 (+ 83856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.709087 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.709133 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:37.709167 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.338893 (+1629726us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54002125d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:39.338938 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.339039 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192364928}
I20260709 12:24:39.344204 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:39.345321  5821 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.283s	user 0.004s	sys 0.005s
I20260709 12:24:39.344929 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.347998 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.351603 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.351891 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.352686 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.352843 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:39.353008 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.353389 31565 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 21: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:39.353694 31569 raft_consensus.cc:2393] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:39.354303 31416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:24:39.354445 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:39.354820  5617 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:39.354852 31416 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:39.355403  5617 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:39.355484 31416 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:39.355917  5617 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:39.360451 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:39.361644 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:39.361706 31466 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.362356 32110 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 20: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:39.363340 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.364054  5677 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:39.364216 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:39.364826  5677 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:39.366662 32109 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:39.367539 31493 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 3094) took 1135 ms. Trace:
I20260709 12:24:39.367993 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:39.368714 32114 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:39.368853 31416 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.368077 31493 rpcz_store.cc:276] 0709 12:24:38.231935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.233493 (+  1558us) service_pool.cc:224] Handling call
0709 12:24:39.367177 (+1133684us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400361d54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.367339 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834514816}
I20260709 12:24:39.369832 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 1586) took 1169 ms. Trace:
I20260709 12:24:39.370337 32107 rpcz_store.cc:276] 0709 12:24:38.200721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.200898 (+   177us) service_pool.cc:224] Handling call
0709 12:24:39.369546 (+1168648us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540067e8d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.369669 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443709184}
I20260709 12:24:39.371064  5752 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:39.371488 31466 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.372349 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.374226  5752 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:39.374752  5752 raft_consensus.cc:697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:39.375582  5752 consensus_queue.cc:237] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.374908 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.379727 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48618 (request call id 3093) took 1148 ms. Trace:
I20260709 12:24:39.380084 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:39.380136 31495 rpcz_store.cc:276] 0709 12:24:38.231564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.233013 (+  1449us) service_pool.cc:224] Handling call
0709 12:24:39.379537 (+1146524us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000235d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.379672 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258192128}
I20260709 12:24:39.380806  5815 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:39.381233  5815 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.381578  5815 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:39.382709 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.383306 31565 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:39.386312 31537 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:39.387490  5769 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:39.388433 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.389135 31420 raft_consensus.cc:2368] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17.
I20260709 12:24:39.389541  5815 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.391708  5815 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.365985  5677 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.396878 31422 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:39.401723 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55328 (request call id 4207) took 1182 ms. Trace:
I20260709 12:24:39.402134 31419 rpcz_store.cc:276] 0709 12:24:38.219569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.239067 (+ 19498us) service_pool.cc:224] Handling call
0709 12:24:39.401563 (+1162496us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54004484d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.401668 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671224192}
I20260709 12:24:39.404433 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:39.404971  5775 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.403755 31315 catalog_manager.cc:5697] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 11 to 12, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 12 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.337368  5773 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.408990  5712 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.408793  5773 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.410786  5613 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.412186  5646 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.414248  5664 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.335829  5777 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:39.299615  5636 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:39.415117 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:39.416002 31568 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 15: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:39.422942 31573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 3728) took 1729 ms. Trace:
I20260709 12:24:39.423254 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:39.423470 31573 rpcz_store.cc:276] 0709 12:24:37.612216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.612337 (+   121us) service_pool.cc:224] Handling call
0709 12:24:39.341393 (+1729056us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54002a21d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.341515 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26182400}
I20260709 12:24:39.425206 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:39.425966 31495 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:39.429859 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.201759  5772 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.447799 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f97e5105626c48be9d1768855511628a"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:39.448673 31497 raft_consensus.cc:606] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:39.449085 31497 raft_consensus.cc:614] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:39.462124  5717 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:39.463387  5712 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.464094  5712 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.467162  5712 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.334978  5812 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.469473 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:39.295089  5758 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.337693  5768 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.415881  5674 tablet_copy_client.cc:538] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:39.473501 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:39.470571 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:39.486620 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:39.447917  5816 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:39.491209 32079 leader_election.cc:400] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17.
I20260709 12:24:39.491508 32079 leader_election.cc:403] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.473088  5757 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:39.474349  5767 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.483356  5610 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:39.491688  5636 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.483836  5815 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:39.495293  5756 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:39.505527  5796 raft_consensus.cc:2804] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:39.506973  5610 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.710793  5610 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:39.590878 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 172854us
I20260709 12:24:39.717463 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:39.596268 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 191762us
I20260709 12:24:39.721742  5567 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:39.719537  5631 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:39.605700 31390 leader_election.cc:400] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:39.724161 31390 leader_election.cc:403] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:24:39.611055 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 187793us
I20260709 12:24:39.725605 31465 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.614207 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 370) took 3602 ms. Trace:
I20260709 12:24:39.725857  5567 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:39.725908  5631 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.618906 31495 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:39.632139 31416 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.636946 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3084) took 1751 ms. Trace:
I20260709 12:24:39.641741 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.645430 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.646745 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.649398 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.650247 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.736732 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.738600 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.739888 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:39.740835 31497 raft_consensus.cc:2393] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 21: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:39.743017 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.651593 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.727559  5631 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:39.655843 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
W20260709 12:24:39.749796 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 94370.4us
I20260709 12:24:39.750761 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:39.752060 31497 raft_consensus.cc:2368] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:39.754096 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.665797 31574 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:39.755317 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.757702  5618 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:39.758291  5618 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.758889  5618 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:39.796809 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.688334 31565 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
W20260709 12:24:39.694727 32108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55792 (request call id 1590) took 1488 ms (client timeout 1599 ms). Trace:
I20260709 12:24:39.799842  5562 raft_consensus.cc:2764] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 12:24:39.799551 32108 rpcz_store.cc:269] 0709 12:24:38.206419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.206583 (+   164us) service_pool.cc:224] Handling call
0709 12:24:39.694141 (+1487558us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b540032afd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:39.694432 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133011200}
I20260709 12:24:39.696727 32113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 1648) took 1251 ms. Trace:
I20260709 12:24:39.801355 32113 rpcz_store.cc:276] 0709 12:24:38.444752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.587942 (+143190us) service_pool.cc:224] Handling call
0709 12:24:38.588273 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.805974 (+217701us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:24:38.834342 (+ 28368us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.894988 (+ 60646us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.895038 (+    50us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:24:38.895089 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.696234 (+801145us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54005c94d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:39.696296 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.696510 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12567,"prepare.queue_time_us":27433,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":34,"raft.queue_time_us":1223,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":499944192,"thread_start_us":55303,"threads_started":1,"wal-append.queue_time_us":116396}
I20260709 12:24:39.698170 32112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1659) took 1254 ms. Trace:
I20260709 12:24:39.804587 32112 rpcz_store.cc:276] 0709 12:24:38.443712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.444143 (+   431us) service_pool.cc:224] Handling call
0709 12:24:38.444426 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.795097 (+350671us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:24:38.818778 (+ 23681us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.375708 (+556930us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b18002471e0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc116658e07 00007fc11f4b39a9 00007fc11667569b 00007fc11667393f 00007fc116675c02 00007fc1192fd20b 00007fc119302d23 00007fc11930323a 00007fc11976da2a
0709 12:24:39.696267 (+320559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.696364 (+    97us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:39.696466 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.697758 (+  1292us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400520154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:39.697803 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.697956 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23425,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":13604,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":148,"spinlock_wait_cycles":816813568,"thread_start_us":320128,"threads_started":1}
I20260709 12:24:39.504429  5530 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.728847  5567 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:39.806905  5567 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.807550  5567 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:39.807220  5530 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.728739 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.799662  5409 consensus_queue.cc:1059] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:24:39.811630  5409 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:39.812062  5409 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:39.815129  5409 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.816147  5726 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.817157  5726 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:39.818691 31497 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:24:39.730736 31500 rpcz_store.cc:276] 0709 12:24:37.885741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.885889 (+   148us) service_pool.cc:224] Handling call
0709 12:24:37.896911 (+ 11022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.220251 (+323340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.220285 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.220328 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:24:38.220365 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.636257 (+1415892us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400292cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:39.636353 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.636687 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743152896}
I20260709 12:24:39.652839 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.821147 31494 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
W20260709 12:24:39.745375 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 140286us
I20260709 12:24:39.823585 31390 leader_election.cc:400] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21.
I20260709 12:24:39.823930 31390 leader_election.cc:403] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.825606 31390 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:39.826490  5724 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:39.827136  5690 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:39.827358  5724 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.830832  5643 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:39.831755  5643 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:39.832332  5643 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:39.833775  5643 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:39.835350 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 118196us
I20260709 12:24:39.837060  5618 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.748569 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.732458 31493 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 21: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:39.817181  5409 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:39.543748  5743 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.552986  5756 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17.
I20260709 12:24:39.553598  5759 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.525828  5758 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.516943  5764 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.531253  5772 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.537355  5777 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.540652  5792 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:39.971889 31571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.014s
I20260709 12:24:39.971982  5777 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:39.972360 31571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.005s	sys 0.014s
I20260709 12:24:39.973381 32114 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:39.508327  5794 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:39.518996  5796 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.975128  5796 raft_consensus.cc:3060] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:39.508642  5808 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.515187  5809 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.516229  5815 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:39.498409  5816 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:39.546432  5827 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:24:39.999236  5815 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.830412  5724 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.859198 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:39.838222  5610 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.002871  5808 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.888181 31497 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:40.004914  5610 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.888428  5530 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.888756 31389 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:39.888805 31493 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:39.890993  5666 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:40.007807  5666 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:40.009119  5666 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.010233  5816 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:39.891400  5618 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:39.915982 31494 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:39.917593 31500 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:39.932561 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:39.935757  5726 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:39.937021 31387 leader_election.cc:400] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16.
W20260709 12:24:40.014166 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77403.4us
I20260709 12:24:39.726395 31322 rpcz_store.cc:276] 0709 12:24:36.011303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.011447 (+   144us) service_pool.cc:224] Handling call
0709 12:24:39.613927 (+3602480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:36.191208 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:36.191797 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:36.191827 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:24:36.191848 (+    21us) tablet.cc:662] Decoding operations
0709 12:24:36.192582 (+   734us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:36.192629 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:36.192658 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:36.231747 (+ 39089us) tablet.cc:701] Row locks acquired
0709 12:24:36.231766 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:36.231895 (+   129us) write_op.cc:270] Start()
0709 12:24:36.232003 (+   108us) write_op.cc:276] Timestamp: P: 1783599876231853 usec, L: 0
0709 12:24:36.232023 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:36.232620 (+   597us) log.cc:844] Serialized 2539 byte log entry
0709 12:24:36.993736 (+761116us) op_driver.cc:464] REPLICATION: finished
0709 12:24:37.225905 (+232169us) write_op.cc:301] APPLY: starting
0709 12:24:37.235902 (+  9997us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:37.504295 (+268393us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:37.504418 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:37.522812 (+ 18394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:37.523040 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:24:37.523084 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:37.523319 (+   235us) log.cc:844] Serialized 65 byte log entry
0709 12:24:37.523491 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.523602 (+   111us) write_op.cc:454] Released schema lock
0709 12:24:37.523654 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:37.524029 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.524059 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13426,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":180187,"apply.run_cpu_time_us":10441,"apply.run_wall_time_us":309133,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":177,"prepare.run_cpu_time_us":3440,"prepare.run_wall_time_us":41705,"replication_time_us":761503,"thread_start_us":159859,"threads_started":1}]]}
W20260709 12:24:40.015631 31567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.030s
W20260709 12:24:40.016036 31567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.023s	sys 0.030s
I20260709 12:24:40.018862  5635 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:40.019560 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:40.007808 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 140422us
W20260709 12:24:39.947646 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 185960us
W20260709 12:24:39.968624 31572 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.009s
I20260709 12:24:39.964471 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:39.984434  5677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.010s
I20260709 12:24:39.974462  5794 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:39.834311  5567 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.010761  5617 consensus_meta.cc:287] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.016s
I20260709 12:24:40.029670 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:40.023249  5677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.003s	sys 0.011s
I20260709 12:24:40.033911  5618 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.034642  5618 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.035248 31498 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:40.036238 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:40.037408  5618 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.039247  5674 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap starting.
I20260709 12:24:40.039548 31493 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:40.041374  5618 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:24:40.042227  5567 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.032101 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:40.044806 31497 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:40.037874 31540 leader_election.cc:400] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:40.033720  5743 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:24:40.049347 31540 leader_election.cc:403] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.056649 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:40.032405 31572 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:40.063136  5409 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:40.061203 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:40.065249 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 472972us
I20260709 12:24:40.066823  5653 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.067531  5653 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.064146  5530 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.070094  5653 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:40.069921  5530 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.071535  5797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.006s	sys 0.013s
W20260709 12:24:40.071954  5797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.006s	sys 0.013s
I20260709 12:24:40.072402  5530 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.073689  5739 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:40.074434  5739 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.076917  5739 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.083822 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:40.050982  5617 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.086757 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:40.055203  5567 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:24:40.085700  5776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.016s
I20260709 12:24:40.172698 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.174190 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:40.190975 31572 raft_consensus.cc:2393] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:40.175141 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:40.179466  5636 consensus_meta.cc:287] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 12:24:40.179908  5794 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:40.186398 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 134003us
I20260709 12:24:40.186619  5653 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.186776  5841 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.187039  5737 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:40.187129 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:40.197506 31497 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:40.203148 31390 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:40.196542  5776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.012s	sys 0.017s
I20260709 12:24:40.205716 31565 raft_consensus.cc:1275] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:40.207894 32114 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:40.212229 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 156926us
I20260709 12:24:40.213936 31389 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:40.214634  5791 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:40.214833 31499 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:40.215770  5840 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.216357  5840 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.209213 31466 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.193:35273 timed out after 2.235s (SENT) [suppressed 7 similar messages]
W20260709 12:24:40.221984 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 139738us
W20260709 12:24:40.223789 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.224792 32112 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:40.221349  5756 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.230268 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.230453  5734 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:40.231030 31569 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:40.206526 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.226248  5756 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.238871  5840 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:40.286226 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.287238 32108 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:40.288214  5739 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:40.288359  5635 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.288900  5617 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.289078  5635 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.291106 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.292507 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.295274 31421 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:40.295467 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.296591  5719 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:40.297153  5719 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:40.298485  5635 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.298285 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.299402 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.299759 31423 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:40.303160 31423 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:40.305927 31421 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:40.306859 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:40.308893 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:40.273183  5690 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21.
I20260709 12:24:40.312309 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:40.312501 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.313287 32107 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:40.209844  5636 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:40.315254 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.210388  5794 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.268924  5610 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:24:40.316659  5794 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.318481  5850 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 12:24:40.232487  5841 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.320055  5846 log.cc:927] Time spent T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.318s	user 0.019s	sys 0.057s
W20260709 12:24:40.315441  5848 log.cc:927] Time spent T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.317s	user 0.001s	sys 0.012s
I20260709 12:24:40.321254  5841 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.323355  5756 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.323383 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:40.324249  5737 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:40.324817 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.326696 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.298156  5719 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:40.327669 31421 raft_consensus.cc:2368] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:24:40.330026 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:40.330200  5843 log.cc:927] Time spent T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.321s	user 0.004s	sys 0.008s
I20260709 12:24:40.331933 32079 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:40.332850 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 68245.7us
I20260709 12:24:40.336731 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.337800 31572 raft_consensus.cc:2393] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:24:40.339753  5853 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.327s	user 0.004s	sys 0.008s
I20260709 12:24:40.341343 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:40.342348  5777 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:40.206858  5745 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.245s
I20260709 12:24:40.287123  5758 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.309026 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95175.3us
I20260709 12:24:40.345750 31415 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 21.
I20260709 12:24:40.294416 31540 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:40.338500 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.346953 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.356838 31569 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:40.358536 32114 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:40.362311 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.236683  5653 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.363504  5409 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:40.364132 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.342772  5777 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.367159 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.354266  5666 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:24:40.369228 31417 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:24:40.354552  5841 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:40.376080 31389 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:40.376150 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.376803  5758 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:40.378207  5847 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.379s	user 0.008s	sys 0.003s
I20260709 12:24:40.383055  5610 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.373186 32107 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:40.372141  5777 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:40.408296 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 237024us
I20260709 12:24:40.402762 31492 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:24:40.357867  5796 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.423094 32080 leader_election.cc:400] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:40.424535 32080 leader_election.cc:403] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.361375  5791 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:24:40.429314 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:40.442991 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 179239us
I20260709 12:24:40.425159  5745 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:40.447685 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.448485 31569 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:40.450026  5409 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:40.434473  5840 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:40.451706 32079 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:40.463472 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.466172 31423 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:40.453097  5815 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.467901  5815 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.470314  5815 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:40.470880  5836 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.391s	user 0.002s	sys 0.002s
I20260709 12:24:40.471426  5752 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:40.472057  5752 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.472941 32114 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
W20260709 12:24:40.473069 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 112940us
I20260709 12:24:40.474203  5752 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.474395 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.475742  5772 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.476347 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.441416  5743 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:24:40.474754  5409 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:40.482319  5409 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:40.483578  5409 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:40.485137  5409 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:40.487739  5840 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:40.488217  5840 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:40.488603  5840 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:40.434584  5610 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.492693 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.493162  5610 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:40.494243 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 98534us
I20260709 12:24:40.444042  5794 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.476295  5772 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:40.505690 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:40.511173 31415 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:24:40.515183 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.521413  5799 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:24:40.531795 31495 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:24:40.536882 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:40.539690 31494 raft_consensus.cc:1240] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:40.543736 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.524034  5653 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.546108 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.558341 31566 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:40.561074 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:40.569120 31387 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:40.533496  5752 consensus_queue.cc:1059] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:24:40.582775 31387 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:40.587249 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 90652.2us
I20260709 12:24:40.561517  5745 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:40.589686  5690 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:40.591711  5635 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:40.541056  5719 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:24:40.588064  5631 consensus_meta.cc:287] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.004s
I20260709 12:24:40.597517  5666 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:40.606732  5666 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:40.607205  5666 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:40.607266 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.597661  5797 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:40.616793 31565 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:40.605846  5796 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:40.599112  5567 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:24:40.624994  5773 consensus_queue.cc:1059] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 12:24:40.627553 31415 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:24:40.612730  5635 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:40.601289  5617 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:24:40.615190  5797 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:40.624087 31466 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:40.631690 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.619561  5758 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:40.611392  5631 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.624521  5745 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:40.663532  5745 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.663771  5635 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.667258  5863 log.cc:927] Time spent T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:24:40.668452  5781 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:40.668834  5781 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:40.669698  5781 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.670576 31494 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 12:24:40.671413  5858 log.cc:927] Time spent T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:40.673468  5777 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.679066 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:40.683493  5864 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:24:40.698769 32080 leader_election.cc:400] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 16. Current term is 17.
I20260709 12:24:40.701064 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.701625 32113 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:40.702028 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.707044 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.707158  5797 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:40.694736 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 80726us
I20260709 12:24:40.702565 32114 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:40.701555 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.711689 32107 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:40.698173 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:40.714881 32113 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:40.716970 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:40.709581  5666 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:40.666564  5745 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.640005  5776 consensus_queue.cc:1059] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:24:40.697773  5773 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:40.717511  5617 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:40.727247 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.695027  5796 consensus_queue.cc:1048] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:24:40.746153 32107 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:40.696982  5772 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:40.749852 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.750597 32108 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 10.
I20260709 12:24:40.722410  5719 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:40.741704  5840 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.742808  5792 raft_consensus.cc:3055] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:40.760075 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.734215 31574 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:40.727526  5791 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:40.740502 32113 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 14: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:40.729386  5815 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:40.755426 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:40.770493 32112 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:40.752369  5781 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:40.757138  5617 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:40.758944  5792 raft_consensus.cc:740] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:40.785388 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:40.786131  5752 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:40.788084  5790 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:24:40.769652  5815 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:40.792065 31389 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:40.811820 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.812937 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.758072  5773 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.817658 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.820164 32108 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:40.811498  5815 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:40.775933  5719 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.857681 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.858942 32113 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:40.868942 32114 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:40.831091  5777 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.783056  5791 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.874078 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.877146 31419 raft_consensus.cc:2376] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 21. Re-sending same reply.
I20260709 12:24:40.878386  5874 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.881567 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.863602  5643 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:40.887595 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.887701 31494 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:24:40.899410 31497 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:40.901958 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:40.902777 32112 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:40.870647  5653 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:40.907339 32112 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
W20260709 12:24:40.907428 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 130290us
I20260709 12:24:40.909390 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:40.914889 32108 raft_consensus.cc:1240] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:40.917403 32114 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
W20260709 12:24:40.924885 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.907486  5772 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:40.891445  5874 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.931594  5874 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.934809  5653 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.935565  5772 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.936987  5653 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.946491 32113 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 21.
W20260709 12:24:40.955750 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52337.9us
I20260709 12:24:40.956732 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:40.957536 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.958290 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:40.961179 31540 leader_election.cc:400] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:24:40.961582 31540 leader_election.cc:403] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.929278  5808 raft_consensus.cc:3055] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:24:40.965328 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 89156.9us
I20260709 12:24:40.971046  5631 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:40.971352  5791 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.972083 32113 raft_consensus.cc:1275] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:24:40.973382  5772 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.974886  5773 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:40.965818  5409 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:24:40.977759  5409 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:40.978188  5409 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:40.979414  5409 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.980973  5409 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:40.987033 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:40.991212 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:40.993096  5790 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:40.993487  5790 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:40.993858  5790 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:40.964707  5643 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:40.995055  5643 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.996208 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:40.997534 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.000383  5743 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:41.000882  5743 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.002803 31574 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:41.003209 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.003528  5743 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.006204  5790 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:40.943393  5739 raft_consensus.cc:3055] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:41.022024 31493 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:24:41.011595 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.027376 32113 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
W20260709 12:24:41.035229 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 74245.5us
W20260709 12:24:41.027391 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59352.1us
I20260709 12:24:40.951442  5840 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:41.036304 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.043954 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.044305 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:41.046300  5886 log.cc:927] Time spent T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:24:41.052275 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:40.918241  5617 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.054469 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:40.919714  5792 consensus_queue.cc:260] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.069262 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:40.966851  5808 raft_consensus.cc:740] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:41.076265 31574 raft_consensus.cc:2468] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:41.027593  5739 raft_consensus.cc:740] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:41.054137  5734 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
W20260709 12:24:41.090626 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 54425.4us
I20260709 12:24:41.091919 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.086539  5758 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:41.124320 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.093323  5792 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:41.093222  5719 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.135035  5734 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:41.141152 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.140265  5873 log.cc:927] Time spent T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
I20260709 12:24:41.132781  5808 consensus_queue.cc:260] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.150295  5885 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:41.151086  5885 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:41.151741 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 52649.4us
I20260709 12:24:41.152629 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.153898 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.154112  5734 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.154865  5734 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:41.155591 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.157477  5885 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.159839  5409 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.160509  5409 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:41.161823  5815 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.162931  5758 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:41.163369  5790 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.163640  5758 consensus_queue.cc:1243] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:24:41.164324  5772 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:41.164662  5772 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:41.165520  5772 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:41.166363  5891 log.cc:927] Time spent T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:24:41.167126  5772 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:41.168376  5666 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:41.172837  5739 consensus_queue.cc:260] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:41.177304 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.143779  5737 consensus_meta.cc:287] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.819s	user 0.015s	sys 0.000s
I20260709 12:24:41.188751  5737 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.206732 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.207425 32113 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 14.
I20260709 12:24:41.208256 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.208277 32105 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:41.208798 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.209457 32112 raft_consensus.cc:2376] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17. Re-sending same reply.
I20260709 12:24:41.221223 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:41.222498 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 148252us
I20260709 12:24:41.222211 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.226928 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.227548 32114 raft_consensus.cc:2376] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15. Re-sending same reply.
I20260709 12:24:41.227056 32106 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:41.226328  5797 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:41.236217  5815 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:41.239128 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 60017.5us
I20260709 12:24:41.239642 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.240417 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.227941  5808 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:41.229247 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:41.245357 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.248503 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:41.249051 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.250097 31567 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:24:41.245482 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.246752 31574 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:41.254922 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.261195 31566 raft_consensus.cc:2410] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:24:41.326826 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:41.329687 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.330542 31573 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:24:41.330945 31573 pending_rounds.cc:85] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 8
I20260709 12:24:41.331178 31573 pending_rounds.cc:107] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:24:41.331434 31573 raft_consensus.cc:2889] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:41.334120 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.334785 31572 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
I20260709 12:24:41.335538 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.336498 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.337706 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.340248  5737 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:41.341496  5666 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:41.341851  5666 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:41.347108 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.356741 31569 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
W20260709 12:24:41.358018 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.358563 31574 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:41.260632  5752 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:41.367444 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.368211 31574 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:41.369019 31571 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:24:41.369340 31570 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:41.375084 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.379189  5764 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:41.379680  5764 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:41.380044  5764 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:41.384774 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.385324 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.387007  5815 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:41.397854  5797 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:41.398418  5797 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.400550  5797 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.401048  5797 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:41.401630  5797 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:41.405979  5781 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:41.397329 32079 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:41.419700 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.426448  5719 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:41.426898  5719 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:41.427282  5719 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:41.429759 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.416549  5530 raft_consensus.cc:2804] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:41.441090 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.451032  5409 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.451586  5409 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:41.453313  5409 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:41.468222 31491 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:41.470259 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.459009  5772 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:41.467375  5530 raft_consensus.cc:697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:41.483024  5409 consensus_queue.cc:1059] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:41.487900 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.475111  5790 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:41.502871 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:41.521118  5567 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:41.521574  5567 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:41.522020  5567 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:41.489006  5643 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:24:41.524521 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.525249 32113 raft_consensus.cc:2368] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:41.532490 32107 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14.
I20260709 12:24:41.533586  5764 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:41.534400 31500 raft_consensus.cc:1240] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:41.522594 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:41.518743  5896 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:24:41.541968 32108 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:41.542693 32111 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:41.544836 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.543262  5530 consensus_queue.cc:237] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.543757 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.547333 32109 raft_consensus.cc:2368] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16.
I20260709 12:24:41.548663 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.548976 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.549517 32108 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:41.549659 32114 raft_consensus.cc:2368] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:24:41.549899 32107 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:24:41.550479 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.551118 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.551355 32108 raft_consensus.cc:2393] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:41.552223 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.552304 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.552399 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.552970 32110 raft_consensus.cc:2368] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:41.552999 32107 raft_consensus.cc:2376] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 14. Re-sending same reply.
I20260709 12:24:41.553450 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.554041 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.554596 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.554829 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.556003 32112 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:41.544117  5781 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:24:41.553951 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.565270 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.566705 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.553989 32108 raft_consensus.cc:2376] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17. Re-sending same reply.
I20260709 12:24:41.587692  5764 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:41.590885  5666 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:41.592098  5666 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:41.592500  5719 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.600849 31321 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:41.607901  5719 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.665164 31321 catalog_manager.cc:5697] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 13, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 13 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:41.671546 31321 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 17, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:41.675272 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63405.2us
I20260709 12:24:41.675912 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.675318 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.678105 31387 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:41.680111 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:41.682351 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.683924 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:41.684616 31419 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:41.686506 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:41.683386 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.681067 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:41.688027 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 167225us
I20260709 12:24:41.688604 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.689503 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:41.690444 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.677456  5674 log.cc:927] Time spent T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 12:24:41.692073 31418 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:24:41.692339 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:41.694767 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:41.695240 31493 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:41.692322 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.700129 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.690449 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.704676 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.705168 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.707132 31492 raft_consensus.cc:2393] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 15: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:41.710300 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.681679  5643 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:41.707192 31498 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:24:41.713207 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.713213 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:41.714457 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.714905 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.715719 31572 raft_consensus.cc:2376] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17. Re-sending same reply.
I20260709 12:24:41.715965 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.709471 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.710878 31567 raft_consensus.cc:2376] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15. Re-sending same reply.
I20260709 12:24:41.718148 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:41.718633 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.719656 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.709867 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:41.704814  5719 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:41.734853 32105 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:41.743783 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.717228  5643 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.702283  5567 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.756160 31421 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:41.753345 31416 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:41.756522 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:41.762740 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48367.1us
I20260709 12:24:41.770155 32105 raft_consensus.cc:1240] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 12:24:41.761210 32080 connection.cc:256] RPC call timeout handler was delayed by -1.8768613719998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:24:41.777644 32080 connection.cc:256] RPC call timeout handler was delayed by -1.8230651180001587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:24:41.778172 32080 connection.cc:256] RPC call timeout handler was delayed by -1.6239613719999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:24:41.778566 32080 connection.cc:256] RPC call timeout handler was delayed by -1.5501613719998204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 12:24:41.778909 32080 connection.cc:256] RPC call timeout handler was delayed by -1.4673613719996865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 12:24:41.779404 32080 connection.cc:256] RPC call timeout handler was delayed by -1.401661372000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 12:24:41.779794 32080 connection.cc:256] RPC call timeout handler was delayed by -1.0954617309994319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 12:24:41.780660 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.757637  5643 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:41.789283 31418 raft_consensus.cc:1240] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:41.795961 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.801743 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:41.797264 31421 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 21. Current term is 22. Ops: []
I20260709 12:24:41.803200 31315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 253) took 5491 ms. Trace:
I20260709 12:24:41.762161  5617 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:41.803318 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90183us
I20260709 12:24:41.805294 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.805801 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:41.805927 31491 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:41.806891 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:41.807503 32110 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:41.807475 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:41.809070 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55511us
I20260709 12:24:41.803579 31315 rpcz_store.cc:276] 0709 12:24:36.183440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.183696 (+   256us) service_pool.cc:224] Handling call
0709 12:24:41.675172 (+5491476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:39.890163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:39.891808 (+  1645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:39.891896 (+    88us) write_op.cc:435] Acquired schema lock
0709 12:24:39.891951 (+    55us) tablet.cc:662] Decoding operations
0709 12:24:39.892589 (+   638us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:39.892739 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:39.892784 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:39.893210 (+   426us) tablet.cc:701] Row locks acquired
0709 12:24:39.893272 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:24:39.893515 (+   243us) write_op.cc:270] Start()
0709 12:24:39.893730 (+   215us) write_op.cc:276] Timestamp: P: 1783599879893420 usec, L: 0
0709 12:24:39.893788 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 12:24:39.909407 (+ 15619us) log.cc:844] Serialized 539 byte log entry
0709 12:24:40.417626 (+508219us) op_driver.cc:464] REPLICATION: finished
0709 12:24:40.700551 (+282925us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11976032a 00007fc1196e5f14 00007fc1196e5ec3 00007fc1196e5e38 00007fc1196e5df3 00007fc1196e50dc 00007fc11970ee16 00007fc1196f6cbb 00007fc1196e139d 00007fc1196e4d75
0709 12:24:40.726652 (+ 26101us) write_op.cc:301] APPLY: starting
0709 12:24:40.732461 (+  5809us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:40.903189 (+170728us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:40.903223 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:40.958279 (+ 55056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:41.086897 (+128618us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:24:41.093619 (+  6722us) write_op.cc:312] APPLY: finished
0709 12:24:41.155764 (+ 62145us) log.cc:844] Serialized 25 byte log entry
0709 12:24:41.155951 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.156027 (+    76us) write_op.cc:454] Released schema lock
0709 12:24:41.156083 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:41.156592 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:41.156630 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":368875,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":269222,"apply.run_cpu_time_us":8217,"apply.run_wall_time_us":440314,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":275048,"prepare.run_cpu_time_us":19902,"prepare.run_wall_time_us":152530,"raft.queue_time_us":178528,"raft.run_cpu_time_us":55867,"raft.run_wall_time_us":335755,"replication_time_us":484739,"spinlock_wait_cycles":9417600,"thread_start_us":535701,"threads_started":4,"wal-append.queue_time_us":261100}]]}
I20260709 12:24:41.800257 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.806942 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.808063 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:41.775966  5781 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.824262 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.826722 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:41.827312 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:41.826848  5909 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.840014 31419 raft_consensus.cc:2468] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 12.
I20260709 12:24:41.820499  5631 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:41.858032 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 143422us
W20260709 12:24:41.861680 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 92238us
I20260709 12:24:41.819790  5913 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:41.869469 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 59295.9us
I20260709 12:24:41.875334 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:41.873713 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:41.817073  5917 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:24:41.857743  5617 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:41.881438 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100972us
I20260709 12:24:41.885294 31537 leader_election.cc:400] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
I20260709 12:24:41.885669 31537 leader_election.cc:403] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:41.895552 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.901865 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.906713 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.859072  5781 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:41.923738 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 160271us
I20260709 12:24:41.917452 31537 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:41.927667 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52405.4us
I20260709 12:24:41.931456  5922 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:24:41.891742  5918 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:24:41.933960  5918 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:41.934327  5918 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:41.934671  5918 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:41.936770 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:41.944731  5927 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:41.945223  5927 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:41.948426 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.940146  5631 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:41.967262  5885 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.967401  5920 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:41.969050 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67271.2us
I20260709 12:24:41.954308  5919 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:41.971031  5925 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:24:41.953073  5911 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:24:41.929242  5909 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:24:41.973430  5929 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:41.946074  5927 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:41.975379  5927 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:41.955668 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:41.957816  5792 consensus_queue.cc:1048] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:41.989631 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:41.992717  5925 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:24:41.996028 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 89558.9us
I20260709 12:24:41.970350  5781 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:41.995245 32113 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:42.002900  5409 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17.
W20260709 12:24:42.002996 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 65738.3us
I20260709 12:24:41.952028  5719 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:24:42.008123 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71474us
I20260709 12:24:42.010756 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:42.005712 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:41.997473  5909 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:41.998620  5567 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.021595 31571 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:42.024482  5936 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:42.028371 31387 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:42.031914 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.032630 31568 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:42.028896 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:42.035247 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:42.038923  5898 raft_consensus.cc:3055] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:42.039407  5898 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:42.040158  5567 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:42.040635  5567 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.041044  5567 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.040409  5898 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:42.012300  5910 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:24:42.046706  5739 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:42.047458  5910 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:42.047832  5910 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:42.048695  5910 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.049531  5643 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.050182  5910 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:42.015805  5909 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.050912 31420 raft_consensus.cc:1240] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:24:42.051080  5909 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.052768  5567 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.039477 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.067198 31573 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:42.067341 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.070729 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.071610 31571 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.064884  5737 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:24:42.077958 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 129655us
I20260709 12:24:42.066045  5631 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.119273 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.075469  5917 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.125555 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:42.125010  5745 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:42.129961  5745 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.132727  5745 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:42.130421  5530 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.112478  5737 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:42.129262 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 68948.1us
W20260709 12:24:42.137574 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 274989us
I20260709 12:24:42.166884 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:42.167681 32113 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.150843 31573 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 14.
I20260709 12:24:42.173957 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:42.161361  5764 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:42.118140  5932 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.176034 31466 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:42.141956  5737 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.141691  5567 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:42.231529 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49581.7us
W20260709 12:24:42.179033  5928 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:24:42.237794 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124864us
I20260709 12:24:42.238489 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.135845  5924 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:42.233877 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.239086 31574 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.177052  5764 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
W20260709 12:24:42.246003 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 72149us
I20260709 12:24:42.188313  5917 raft_consensus.cc:2804] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:42.265069 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.236605  5752 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:42.262957 31465 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:42.279846 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.229843  5918 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.236846  5666 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:24:42.293454 32113 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:42.282155  5631 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:42.278784  5674 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:42.189424  5932 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.303857 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:42.304620 32110 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:42.274467  5917 raft_consensus.cc:697] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:42.316649 31574 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:42.333665  5920 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.334321 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.299417  5946 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:42.335129  5815 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.336818  5918 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.338980 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.302255  5764 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.284024  5643 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:42.341141 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.342248  5674 tablet_bootstrap.cc:492] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Bootstrap complete.
I20260709 12:24:42.254910  5924 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.349059  5917 consensus_queue.cc:237] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.354861 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:42.362546  5898 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:42.368247  5940 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.293s	user 0.002s	sys 0.002s
I20260709 12:24:42.374357 31417 raft_consensus.cc:2410] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:24:42.384330  5737 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.412182 31568 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:42.413930 31571 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:42.416805 31570 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
W20260709 12:24:42.416991 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 78104.3us
I20260709 12:24:42.440420 31494 raft_consensus.cc:1240] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:42.427613 32112 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 15.
I20260709 12:24:42.453282 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:24:42.454742 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 120497us
I20260709 12:24:42.460323 31571 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:24:42.460883 31571 pending_rounds.cc:85] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 10
I20260709 12:24:42.461210 31571 pending_rounds.cc:107] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:24:42.461536 31571 raft_consensus.cc:2889] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:42.428951  5777 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:42.445508  5674 ts_tablet_manager.cc:1403] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent bootstrapping tablet: real 2.407s	user 0.045s	sys 0.032s
W20260709 12:24:42.463798 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 230014us
I20260709 12:24:42.440765  5739 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:42.466660 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:42.475175 31566 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 17: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:42.472126 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:42.478199  5737 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:42.491919 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 229076us
I20260709 12:24:42.454097 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:42.470827 31492 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:42.417289  5909 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.507442 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:42.509289 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:42.463548  5776 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:24:42.463306  5797 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 12:24:42.516796 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 62734us
I20260709 12:24:42.517918 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.523129 32110 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
W20260709 12:24:42.525561 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.532991 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.510839  5737 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:42.525511  5936 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:42.527024  5925 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:42.528389  5946 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:42.531563  5929 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.551106 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80191.3us
I20260709 12:24:42.553174  5752 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:42.557957  5752 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.553673  5910 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.560266  5910 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.562335  5910 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:42.555538  5925 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:42.565130 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:42.565361 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.574666  5764 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.588150 31389 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.589102  5808 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:42.589766  5808 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:42.590909  5690 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:42.591467  5690 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:42.592353  5690 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.592528  5643 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:42.594656  5909 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:42.548022  5939 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.598461  5931 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.603781 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:42.606511 31492 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.531359  5739 consensus_queue.cc:1059] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:24:42.542791  5922 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:42.549280  5936 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:42.614444 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49606.4us
I20260709 12:24:42.615275 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:42.591010  5808 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.621544  5936 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.631989  5737 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:42.608772  5913 consensus_queue.cc:1059] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:24:42.629118  5946 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:42.663409 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.676405 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68717.9us
I20260709 12:24:42.621335  5666 consensus_queue.cc:1059] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:24:42.641170  5924 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.596997  5939 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.618827  5922 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.556406  5929 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.599076  5931 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.680156  5916 raft_consensus.cc:3055] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:42.679821  5946 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.699908  5879 raft_consensus.cc:3055] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:42.745004  5929 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:42.738178  5879 raft_consensus.cc:740] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:42.747385  5879 consensus_queue.cc:260] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.748906  5879 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.755106 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:42.705256 31492 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:42.705786 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.707953 31417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50108 (request call id 1544) took 1088 ms. Trace:
I20260709 12:24:42.709780 32105 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:42.741721  5674 raft_consensus.cc:359] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:42.716579  5915 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:42.719012 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:42.767542 31420 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:42.720723 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:42.768502 31415 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:42.725600 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:42.769498 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 43985.7us
I20260709 12:24:42.770469 31387 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:42.711643  5898 consensus_queue.cc:1059] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:42.728967  5737 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.772212  5906 raft_consensus.cc:3055] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:42.772677  5906 raft_consensus.cc:740] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:42.563575  5925 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.773720  5906 consensus_queue.cc:260] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.774497  5745 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:42.759644 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:42.764878 31537 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.625s (SENT)
I20260709 12:24:42.784351 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:42.733135  5960 log.cc:927] Time spent T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:42.758308 31417 rpcz_store.cc:276] 0709 12:24:41.619177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.667114 (+ 47937us) service_pool.cc:224] Handling call
0709 12:24:42.707726 (+1040612us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54003539d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:42.707859 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594264832}
I20260709 12:24:42.735239  5916 raft_consensus.cc:740] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:42.786007 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:42.768267  5674 raft_consensus.cc:740] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Initialized, Role: LEARNER
I20260709 12:24:42.767127  5927 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:42.801002 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.782035  5776 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:42.782814  5931 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.810464  5409 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:42.787745  5929 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:42.793789  5745 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:42.805585  5776 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.810984  5906 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:42.777386  5915 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.815606  5677 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:42.840298 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 83047.4us
I20260709 12:24:42.815229  5924 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:24:42.839421 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 74577.8us
I20260709 12:24:42.849498 31415 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
W20260709 12:24:42.849769 31537 leader_election.cc:336] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.821s (SENT)
I20260709 12:24:42.833916  5776 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:42.850243 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:42.810528  5927 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.832603  5917 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.819290  5929 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:42.854944  5631 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:42.851938 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 159101us
I20260709 12:24:42.832644  5617 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:42.864444  5409 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:42.849155  5924 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:42.888393  5967 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:24:42.889449  5973 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:24:42.890779  5745 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:42.900249 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50515.4us
I20260709 12:24:42.880555  5924 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:42.902696  5969 log.cc:927] Time spent T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:24:42.851821  5677 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.836799  5674 consensus_queue.cc:260] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:42.901280 32080 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.908247  5915 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:42.895812  5617 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.909011  5922 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.950130  5617 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.951747  5617 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:42.952356  5617 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.957948 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:42.958376 31321 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 350) took 6493 ms. Trace:
I20260709 12:24:42.966821 31321 rpcz_store.cc:276] 0709 12:24:36.464659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.465128 (+   469us) service_pool.cc:224] Handling call
0709 12:24:42.958320 (+6493192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:41.885048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:41.885635 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:41.885675 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:24:41.885699 (+    24us) tablet.cc:662] Decoding operations
0709 12:24:41.886288 (+   589us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:41.886352 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:41.886395 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:41.886775 (+   380us) tablet.cc:701] Row locks acquired
0709 12:24:41.886799 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:24:41.887029 (+   230us) write_op.cc:270] Start()
0709 12:24:41.887150 (+   121us) write_op.cc:276] Timestamp: P: 1783599881886957 usec, L: 0
0709 12:24:41.887171 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:41.926622 (+ 39451us) log.cc:844] Serialized 1311 byte log entry
0709 12:24:42.054081 (+127459us) op_driver.cc:464] REPLICATION: finished
0709 12:24:42.331143 (+277062us) write_op.cc:301] APPLY: starting
0709 12:24:42.331257 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:42.333887 (+  2630us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:42.334006 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:42.512546 (+178540us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:42.512838 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:24:42.512912 (+    74us) write_op.cc:312] APPLY: finished
0709 12:24:42.513199 (+   287us) log.cc:844] Serialized 41 byte log entry
0709 12:24:42.513384 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:42.513486 (+   102us) write_op.cc:454] Released schema lock
0709 12:24:42.513534 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:42.514021 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:42.514075 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194750,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":263642,"apply.run_cpu_time_us":7871,"apply.run_wall_time_us":182867,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":162771,"prepare.run_cpu_time_us":3943,"prepare.run_wall_time_us":41973,"replication_time_us":166741,"thread_start_us":231737,"threads_started":2}]]}
I20260709 12:24:42.911816  5939 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.917490 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:42.972172 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:42.918977 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:42.973817 31499 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:42.920375  5918 raft_consensus.cc:3055] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:42.921489  5674 ts_tablet_manager.cc:1434] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Time spent starting tablet: real 0.427s	user 0.009s	sys 0.000s
I20260709 12:24:42.919059 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:42.922453  5970 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:42.924435  5932 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:42.927618  5968 log.cc:927] Time spent T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:24:42.938971  5929 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.864250  5917 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:42.856511  5916 consensus_queue.cc:260] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:42.988230  5758 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:43.006762  5617 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:43.007838 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88854.7us
I20260709 12:24:43.008826 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.009961  5917 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:42.991365 31322 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.942662 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.011327 31566 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 19: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:43.012794  5983 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.013392  5983 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:43.013931  5983 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:43.014827 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.945084  5677 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:42.946529 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:42.958535 32108 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:42.649117 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:42.911152  5946 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:42.910475  5927 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:42.970709 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:43.028374  5981 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:42.974409 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:42.974890 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 50948us
I20260709 12:24:42.986974  5918 raft_consensus.cc:740] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:43.035318  5918 consensus_queue.cc:260] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.035868  5916 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:42.911165  5936 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.045919  5936 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.045929  5981 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:42.988041  5674 ts_tablet_manager.cc:1467] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Tablet startup took 516ms
I20260709 12:24:42.994189  5931 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.993999 31573 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:42.995839 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:42.995980 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:42.994596 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.000046 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.000916 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.047897 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.011310 31322 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.036346  5918 raft_consensus.cc:3060] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:43.053413 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:42.989223  5631 raft_consensus.cc:2749] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:42.987466 31496 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:43.057894  5808 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:43.042150 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:43.060259 31497 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 16.
I20260709 12:24:43.042878 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:43.027597 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.061182 31495 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:43.061439  5631 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:43.046836  5674 ts_tablet_manager.cc:1469] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Trace:
0709 12:24:35.472798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.472946 (+   148us) service_pool.cc:224] Handling call
0709 12:24:35.721173 (+248227us) ts_tablet_manager.cc:934] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: Initiating tablet copy from peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
0709 12:24:36.121605 (+400432us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:37.103199 (+981594us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:37.119641 (+ 16442us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:37.966933 (+847292us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:38.036038 (+ 69105us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:38.069878 (+ 33840us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:38.069974 (+    96us) inbound_call.cc:177] Queueing success response
0709 12:24:38.585984 (+516010us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18002c5420. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1165f0c0a 00007fc11fd30219 00007fc11651aed8 00007fc116675de2 00007fc11e6dad23 00007fc11e6da55d 00007fc11e7763d8 00007fc11e7a7f4e 00007fc11e78cfdd
0709 12:24:40.038428 (+1452444us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:42.502005 (+2463577us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:42.547389 (+ 45384us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:42.685844 (+138455us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":548,"mutex_wait_us":48543,"raft.queue_time_us":3553,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":23592320,"tablet-copy.queue_time_us":117826,"tablet-download-pool.queue_time_us":58780,"tablet-download-pool.run_cpu_time_us":1347,"tablet-download-pool.run_wall_time_us":1269442,"thread_start_us":232804,"threads_started":2}
I20260709 12:24:43.063105 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.045964 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.047019 31494 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:43.064112  5631 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:43.064389 31572 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:42.999980 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.054208  5931 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.049520 31322 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 18 to 19, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 19 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.065514 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.066561  5631 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:43.067304  5931 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.063213 31390 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.068226 31415 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 21.
I20260709 12:24:43.069082 32080 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.066599 31322 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.046820  5981 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:43.072230 31537 leader_election.cc:336] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.702s (SENT)
I20260709 12:24:43.072674 31537 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.069392 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:43.070626 31322 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 19 to 20, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 20 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.074764 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.076726 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.077133 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:43.077443 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.077734 31495 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:43.078719 31322 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 18 to 20, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 20 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.080662 31322 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.090078 31322 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.034371  5776 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.095530 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.096159 32113 raft_consensus.cc:2376] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18. Re-sending same reply.
I20260709 12:24:43.099155  5874 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:43.099428 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.100152 32109 raft_consensus.cc:2393] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 14: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:43.099608 31322 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 14 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.100849 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.099179 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.111270 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:24:43.135097 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51805.6us
I20260709 12:24:43.119261 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.139981 32113 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
W20260709 12:24:43.141007 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 63631.9us
I20260709 12:24:43.101997 31322 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 13 to 15, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:43.141089 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:43.103348 31537 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.905s (SENT)
I20260709 12:24:43.142088 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.071063  5739 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.108983 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.142777 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.102943 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.082392  5631 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:43.130932 32106 raft_consensus.cc:3055] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:43.128952 32111 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:24:43.128489 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.144438 31390 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.102602 31466 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.157709 32112 raft_consensus.cc:2393] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:43.152194 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:24:43.153187 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 69553.7us
I20260709 12:24:43.158172 32113 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:43.156176 32106 raft_consensus.cc:740] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:43.087631  5777 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:24:43.166927 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 64406.2us
I20260709 12:24:43.169520 31466 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.169790 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.167788 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.170540 32110 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:43.134908  5939 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:43.099643  5874 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.106150  5917 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:43.178551 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.180747 32108 raft_consensus.cc:2393] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 21: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:43.086990  5758 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:24:43.148494  5808 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:43.197824 32113 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:43.148717  5922 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:43.198710 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.178197  5734 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:43.201259 31565 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:24:43.201399 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.202283 31585 tablet_copy_service.cc:342] P 8553a13b444649b9a19e5488aabaf1c5: Request end of tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d54aaf3e560149eca7c259e9a3b7e37e received from {username='slave'} at 127.0.0.1:58364
I20260709 12:24:43.202816 31585 tablet_copy_service.cc:434] P 8553a13b444649b9a19e5488aabaf1c5: ending tablet copy session e166c1cb41f04d55a85e6c0d7966e32e-d54aaf3e560149eca7c259e9a3b7e37e on tablet d54aaf3e560149eca7c259e9a3b7e37e with peer e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.204576 31495 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:43.186405 32106 consensus_queue.cc:260] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.206318 32106 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:43.206897 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50726.2us
W20260709 12:24:43.207828 31463 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.636s (SENT)
I20260709 12:24:43.102876  5986 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:43.216918  5924 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:43.155427  5910 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 12:24:43.172143  5737 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:43.219347  5737 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.190994  5874 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.219910  5737 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.221241 31572 raft_consensus.cc:1240] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:43.222792  5936 consensus_queue.cc:1059] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:43.223131 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.223639  5936 raft_consensus.cc:3055] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:43.223752 32111 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:43.224036  5936 raft_consensus.cc:740] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:43.224920  5936 consensus_queue.cc:260] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:43.226027  5936 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:43.179461  5677 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:43.219173 32106 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:24:43.227128 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 123805us
I20260709 12:24:43.227448 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.228461 31537 leader_election.cc:400] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15.
I20260709 12:24:43.190824  5932 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:43.240841 32106 raft_consensus.cc:1240] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:43.197453  5617 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:43.257748 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:43.257772 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:43.197161  5808 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:43.262120 32113 raft_consensus.cc:3055] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:43.263710 32113 raft_consensus.cc:740] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:43.266904 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:43.267568 31497 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.243584  5932 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.258759  5617 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:43.268396 32113 consensus_queue.cc:260] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.286803 32113 raft_consensus.cc:3060] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:43.273257  5617 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:43.271215  5932 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:43.295004 32113 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:43.297875  5983 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.300638  5924 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:43.301591 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 55791.5us
I20260709 12:24:43.306319 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.294970  5981 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:43.266963  5808 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:43.265326 32110 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:43.314409 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.266893 32111 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:43.315610 31573 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:43.304590  5929 raft_consensus.cc:2764] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:24:43.322274 31497 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:43.328090 32105 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:43.331817 31390 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.337038 32079 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:43.351143 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.329676  5910 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:43.354579  5981 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:43.375063 31537 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:43.381171  5776 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.390823  5997 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:43.391413  5997 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.393615  5997 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:43.396847  5925 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:43.399978  5920 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:43.400360  5920 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:43.401224  5920 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.403214  5905 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:43.403599  5905 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:43.404428  5905 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.405874  5905 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:43.363855  5929 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:43.375281  5931 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:24:43.426265 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.435343 31565 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:24:43.435907 31565 pending_rounds.cc:85] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 13
I20260709 12:24:43.436193 31565 pending_rounds.cc:107] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:24:43.436471 31565 raft_consensus.cc:2889] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:43.398357  5745 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:43.402446  5920 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:43.449141 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:43.449761 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.455156 31424 raft_consensus.cc:1275] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:43.455727  5677 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.455957 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 80967.3us
I20260709 12:24:43.455771  5929 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:43.462100 31571 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:43.456449  5932 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:43.467407 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.478812  5925 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:24:43.479136 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 49152.1us
W20260709 12:24:43.456434  5994 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:24:43.481666  5631 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:43.483402  5983 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:43.490643 31574 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:24:43.350631  5617 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:43.481492 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 55331.4us
I20260709 12:24:43.507897 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:43.540000 31572 raft_consensus.cc:1240] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 21. Current term is 22. Ops: []
W20260709 12:24:43.508562 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.540201 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.406746  5739 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:43.511488  5797 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:43.503535  5929 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:43.514021  5932 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.513907  5808 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:43.503189  5677 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.515178  5925 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.376250  5981 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:43.517752  5998 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:43.489859  5737 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:43.508875  5971 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:24:43.556087 31417 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
W20260709 12:24:43.520038 31463 leader_election.cc:336] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.911s (SENT)
I20260709 12:24:43.556761 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.523905  5874 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.527346  5781 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:43.545653 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:43.548067 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 216323us
I20260709 12:24:43.561820 32108 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:43.561896 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.543392 31495 raft_consensus.cc:2410] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:24:43.553386 31421 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:43.554643 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.563042 32114 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.560778  5979 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:43.495862  5745 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.562273 32108 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:43.564298  5983 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:43.556357  5981 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.574904 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.575477 32110 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:43.581812 32108 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.585621  5999 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:24:43.591020 31417 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:43.594770  5986 consensus_queue.cc:1059] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:24:43.553427  5936 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:24:43.565203  5918 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:43.583431 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.567517  5631 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:24:43.600858 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 80852.4us
W20260709 12:24:43.601580 31463 leader_election.cc:336] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 2.021s (SENT)
I20260709 12:24:43.601967 31463 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:43.608383 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.558542  5998 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.608309 32108 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:43.618541 32110 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:43.564917  5739 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:24:43.632452  5739 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:43.632948  5739 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.633723 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:43.634336 31573 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.634951  5797 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.635433  5797 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.636412 31387 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:43.636507 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:43.637128 31417 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:43.637405  5797 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.606995  5777 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:24:43.641270 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.624117 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.641485  5677 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:43.642467 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.645290 32114 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:43.645685 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.654119 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.654874 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.651551 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.656351 32111 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:43.656450  5924 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:43.657404 31417 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:43.657959  5745 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.642122  5929 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.662489 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.641393 31573 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:43.646375  5874 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.627774  5737 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:43.647552 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 44230.7us
I20260709 12:24:43.651278 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.651479  5617 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.672829 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.665827 32109 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:43.674110  5797 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:43.674928 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.675155  5739 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.676791  5986 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:24:43.677595 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 76043.2us
I20260709 12:24:43.678287 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.679092 32114 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:43.681726 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:43.682303 31495 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:43.682300  5918 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.683508  5808 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:43.684836 31496 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:43.685842  5677 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:43.686370  5677 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:43.606774  5758 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:24:43.687247  5677 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:43.690975 31537 leader_election.cc:336] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667): Timed out: RequestConsensusVote RPC to 127.29.143.196:35667 timed out after 1.954s (SENT)
I20260709 12:24:43.691435 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.692173 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.692783 31573 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:43.693109 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.693810 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:43.696264 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.696616 31496 raft_consensus.cc:1240] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:43.697050 32106 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:24:43.698339 32106 raft_consensus.cc:1240] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.694339 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.696653 32111 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:43.692793 32114 raft_consensus.cc:1240] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:24:43.705674 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:43.706537  5998 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:43.706668 32113 raft_consensus.cc:2368] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 21. Current term is 22.
I20260709 12:24:43.708002 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.708717 32114 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:43.709733 32106 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:24:43.711454 31495 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:43.717222 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.719640 32107 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:43.720929 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:43.723376 32111 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:43.725306 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.696470  5881 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.707401  5758 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:24:43.740077 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.736888 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:43.738142 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:43.739583 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:24:43.742825 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 69509.7us
I20260709 12:24:43.757092 31573 raft_consensus.cc:2368] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 19. Current term is 20.
I20260709 12:24:43.759909 31387 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.761334 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.716434  5918 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:43.774310 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:43.778167 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52948.7us
I20260709 12:24:43.779838 31463 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.769001 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.785373 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:43.771318 31387 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:43.788689 31463 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:43.790235 31389 leader_election.cc:400] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 19. Current term is 20.
I20260709 12:24:43.790592 31389 leader_election.cc:403] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:24:43.731405  5924 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:43.727514  5797 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:43.792129 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.793254 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:43.794036 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:43.793012 32107 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:24:43.792881 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.722201  5999 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:24:43.807919  5971 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:43.791759  5617 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:43.791219  5739 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:43.809478  6007 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:43.809623 31387 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.793349  5986 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:43.795418  5631 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.775415  5918 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.729730  5815 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
I20260709 12:24:43.802316  5958 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:43.791674  5734 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:43.790042  5936 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:43.827003 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.770093  5881 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.815615  5781 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 19. Current term is 20.
I20260709 12:24:43.794727  5898 consensus_queue.cc:1059] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:24:43.824426  5918 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:43.822803  5739 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.843767 32107 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:43.825274  5737 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.847362 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:43.834303  5910 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:43.830904  6007 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:43.862986 31421 raft_consensus.cc:2393] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:43.870184 32108 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:24:43.838515  5958 raft_consensus.cc:697] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:43.838181  5925 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:43.878049 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.861721  5739 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:43.865487  5998 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:43.875965  5932 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:24:43.866984  5737 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.896636  6006 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:24:43.862354  5797 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:43.903390  6000 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 12:24:43.978938  5776 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:44.011174 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 233390us
W20260709 12:24:44.013296 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 220435us
I20260709 12:24:43.939812  6007 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.052101  5881 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:44.053236  5910 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:44.053786  5910 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:44.059821  5981 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:44.064415  5920 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.001s
I20260709 12:24:44.077045  5929 raft_consensus.cc:3055] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:44.077658  5929 raft_consensus.cc:740] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:44.030195  5776 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:44.080066  5776 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:44.093005  5898 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.097332  5898 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:44.100239  5898 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:44.102397 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:44.122213 32106 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:43.993587  5958 consensus_queue.cc:237] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.125478  5918 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.078612  5929 consensus_queue.cc:260] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.120388  5752 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.150903 31387 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:44.152067  5776 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:44.152516  5776 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.152902  5776 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:44.155813  5981 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:44.159998 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:44.163697 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:44.164403 31415 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:44.148375  5915 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.187422 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:44.169137  5916 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:44.203588 31571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:44.211825 31571 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:44.206532 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:44.207628 31568 raft_consensus.cc:1275] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:44.234050 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:44.236824 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:44.207158  5924 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:44.171710  5739 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.164840  5752 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:44.190289  5915 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:44.245573  5989 consensus_queue.cc:1048] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:24:44.250444  5924 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.233489  5916 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:44.260334 31496 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:44.264108  5924 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:44.273239 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 246368us
I20260709 12:24:44.278102 32106 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:44.277310 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:44.280849 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:44.260089  5737 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:44.320572  5737 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:44.261373 31571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1685dea95ca449998eaf8075418fda96"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:44.316648  5918 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:44.282999  5617 consensus_queue.cc:1048] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:24:44.329173  5815 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:44.338138  5737 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:44.319235  6021 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 12:24:44.379823 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 97883.6us
I20260709 12:24:44.458325 31570 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:44.368577  5808 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:44.379765  6024 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:24:44.463230 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:44.486377 31566 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:44.380178  5815 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:44.492794 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:44.495048 31572 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:44.469058 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 219208us
W20260709 12:24:44.681089 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 155834us
I20260709 12:24:44.517395  5915 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:44.687189  6027 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 12:24:44.773335 31572 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:44.773842 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:44.774403 32110 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:44.718992  5917 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.069s	sys 0.092s
W20260709 12:24:44.779260 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 325487us
I20260709 12:24:44.780033 31463 leader_election.cc:400] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 21. Current term is 22.
I20260709 12:24:44.780311 31463 leader_election.cc:403] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:24:44.782886 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:44.752005  6038 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.719928  5916 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:44.787761  6019 log.cc:927] Time spent T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.753s	user 0.003s	sys 0.011s
I20260709 12:24:44.750101  5631 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.784548 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:44.845342 31569 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:44.756422  5752 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:44.778205  5917 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.070s	sys 0.093s
W20260709 12:24:44.794451  6025 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
I20260709 12:24:44.518487  5737 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.773262  5989 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:44.776968  6028 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:44.840363  5910 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
I20260709 12:24:44.784425  6021 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.844447 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49748.1us
W20260709 12:24:44.879261  6030 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
I20260709 12:24:44.854509  6051 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:44.885689  6029 log.cc:927] Time spent T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.510s	user 0.000s	sys 0.001s
I20260709 12:24:44.899147 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:44.843200  6038 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:44.900136 32110 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:44.854841  5631 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.951664 31492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 2597) took 1134 ms. Trace:
I20260709 12:24:44.952204 31492 rpcz_store.cc:276] 0709 12:24:43.816839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.817981 (+  1142us) service_pool.cc:224] Handling call
0709 12:24:43.823408 (+  5427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.823708 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.823738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.824169 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.007050 (+182881us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:44.007186 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.007269 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.951390 (+944121us) raft_consensus.cc:1685] finished
0709 12:24:44.951424 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.951589 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2659,"raft.queue_time_us":919,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3583,"thread_start_us":182332,"threads_started":1,"wal-append.queue_time_us":436554}
I20260709 12:24:44.842916  5815 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.879956  6028 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:44.981395  6028 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:44.982177  6037 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.470s	user 0.001s	sys 0.001s
I20260709 12:24:44.885452  5910 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:44.966619  6033 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260709 12:24:44.968190  5631 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:44.969596  5983 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:44.971316  6034 log.cc:927] Time spent T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:24:44.972244  6054 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.896313  6055 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:44.973169  5999 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:44.895006  6050 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 21. Current term is 22.
W20260709 12:24:44.973533  5776 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Time spent flushing consensus metadata: real 0.820s	user 0.007s	sys 0.002s
W20260709 12:24:44.956746  6048 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:24:44.975214  6038 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:44.879868  5989 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:44.897442  5918 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:24:44.976485 32109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 1686) took 1300 ms. Trace:
W20260709 12:24:44.976727  5924 consensus_meta.cc:287] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.001s
I20260709 12:24:44.903592  6051 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:44.988462 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 102434us
I20260709 12:24:44.949692  5971 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:44.887813  6021 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.022651 31565 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:45.040362 32109 rpcz_store.cc:276] 0709 12:24:43.676467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.676616 (+   149us) service_pool.cc:224] Handling call
0709 12:24:43.676978 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.677256 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.677283 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.677756 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.897876 (+220120us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:24:43.897925 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.898015 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.787080 (+889065us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:24:44.976190 (+189110us) raft_consensus.cc:1685] finished
0709 12:24:44.976211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.976424 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21972224,"thread_start_us":207916,"threads_started":1,"wal-append.queue_time_us":318641}
I20260709 12:24:45.046111 31424 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:45.049805 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55792 (request call id 1684) took 1066 ms. Trace:
I20260709 12:24:45.056912 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.057812 31421 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:45.057063 32111 rpcz_store.cc:276] 0709 12:24:43.983426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.983590 (+   164us) service_pool.cc:224] Handling call
0709 12:24:44.005590 (+ 22000us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.011103 (+  5513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.011143 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.144751 (+133608us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18003b9b00. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11805ca11 00007fc11806c372 00007fc11979ea01 00007fc11976343a
0709 12:24:44.145219 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.324095 (+178876us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:44.324145 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.324242 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.043118 (+718876us) raft_consensus.cc:1685] finished
0709 12:24:45.043147 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.049694 (+  6547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5260,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14283,"spinlock_wait_cycles":5350656,"thread_start_us":178516,"threads_started":1,"wal-append.queue_time_us":229086}
I20260709 12:24:44.995743  5983 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.070096 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.068440 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:45.037986  5999 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.024151  6054 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.074571 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.071358 31424 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:45.037233  5776 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.075764 32111 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:24:45.075649 31387 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:45.078635 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.079382 32109 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:24:45.079267 31423 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:45.050395  5924 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:45.088639 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.087255 31574 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:24:45.062961  5690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.009s	sys 0.022s
I20260709 12:24:45.075642  5916 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:45.075641  5631 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.098353  6057 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:24:45.098798  5631 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.099524  5924 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:45.101230  5631 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:45.102768  6012 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:45.103703  6066 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:45.096123 31415 raft_consensus.cc:2368] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:45.104271  6066 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:24:45.104480  6026 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.623s	user 0.000s	sys 0.001s
I20260709 12:24:45.105108 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.105681 31568 raft_consensus.cc:2368] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:45.105189  6066 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.106529 31419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55332 (request call id 2595) took 1347 ms. Trace:
I20260709 12:24:45.107774  6051 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.106889 31419 rpcz_store.cc:276] 0709 12:24:43.759219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.759366 (+   147us) service_pool.cc:224] Handling call
0709 12:24:43.788296 (+ 28930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.794697 (+  6401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.794727 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.806923 (+ 12196us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.214443 (+407520us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:44.214496 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.216846 (+  2350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.103870 (+887024us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:24:45.106247 (+  2377us) raft_consensus.cc:1685] finished
0709 12:24:45.106266 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.106453 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6201,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":12351,"spinlock_wait_cycles":6203136,"thread_start_us":380679,"threads_started":1,"wal-append.queue_time_us":500327}
I20260709 12:24:45.096419  6061 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.109025  6031 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:24:45.108820  6061 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.073391  5815 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.025542  6055 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.096949  6050 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.112958  6055 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.113006  5910 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:45.112977  6050 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.055307  5971 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.115012  6061 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.115592  6050 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.115808  5971 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:45.116457  5815 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.119115 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:45.119629  6021 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:45.122188  5989 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.097700  5916 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.123148  5916 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:45.124979 32080 leader_election.cc:400] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
I20260709 12:24:45.125380 32080 leader_election.cc:403] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:24:45.134792 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.136571 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.141305 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.142048  5776 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:45.142127  5983 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.142814  5983 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:45.143656  6054 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.144205 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:45.144735 32111 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:45.149765 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.143755 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:45.152184 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:45.153131 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:45.277179 32109 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:45.154686  6069 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:45.238588 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 454945us
W20260709 12:24:45.286119 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 134010us
I20260709 12:24:45.275743 32111 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
W20260709 12:24:45.276503 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 129683us
W20260709 12:24:45.241003 31539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.014s
W20260709 12:24:45.289546 31539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.015s
I20260709 12:24:45.290496 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.273993 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.293996 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:45.294788 32114 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:45.296594 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:45.303351 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.511816 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.512943 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:45.292630 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 143414us
I20260709 12:24:45.515393 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:45.353592 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:45.290155 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:45.154075  5815 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:45.397150 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 43759.9us
I20260709 12:24:45.460454 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.494055 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:45.530036 32107 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:45.501730 31568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48852 (request call id 2940) took 1164 ms. Trace:
I20260709 12:24:45.277629  5776 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:45.510495 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:45.511516 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 207621us
I20260709 12:24:45.512423 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:45.523221 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:45.523813 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.525333  6038 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:45.553714 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 2600) took 1352 ms. Trace:
I20260709 12:24:45.527901 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.533689 31574 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:45.300143  6051 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.559576 31495 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:45.299183  5917 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.555512 31496 rpcz_store.cc:276] 0709 12:24:44.158765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.159734 (+   969us) service_pool.cc:224] Handling call
0709 12:24:45.511236 (+1351502us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b5400362754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:45.511326 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229004032}
I20260709 12:24:45.562492 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:45.526114  6058 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.530944 31568 rpcz_store.cc:276] 0709 12:24:44.233633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.233790 (+   157us) service_pool.cc:224] Handling call
0709 12:24:45.357210 (+1123420us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b5400262fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:45.398297 (+ 41087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2002817408}
I20260709 12:24:45.525920  6045 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:45.535214 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.558987 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:45.332917  5617 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.396893  5677 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:45.577023 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 59012.4us
I20260709 12:24:45.577998 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:45.299393  6054 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:45.575361 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 60268.7us
I20260709 12:24:45.585937 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.593218 31493 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:45.589452 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:45.593849 31494 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:45.591163 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.592185 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.397715  5998 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.245s
I20260709 12:24:45.595304 31466 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:45.604576 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:45.560878  6057 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:45.559305  6028 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.609102 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:45.590204  6068 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:45.623823 31574 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:45.582340  5815 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:45.575085  5989 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:45.637151 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.586776  5734 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.639074  6039 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:45.639719  6023 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.640489  6084 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:45.641886  5932 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:45.646031 31494 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:45.618770  6061 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:45.648339  6077 log.cc:927] Time spent T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:24:45.649313  6076 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
W20260709 12:24:45.650363  6070 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:45.692461 31565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48862 (request call id 3810) took 1525 ms. Trace:
W20260709 12:24:45.692713  6027 log.cc:927] Time spent T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:45.692871 31565 rpcz_store.cc:276] 0709 12:24:44.166668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.167441 (+   773us) service_pool.cc:224] Handling call
0709 12:24:44.167684 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.053147 (+885463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.692219 (+639072us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54001969d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:45.692386 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965735296}
I20260709 12:24:45.609122  6045 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.608599  6054 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.698021  6054 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.653328  6028 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.702970 32107 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
W20260709 12:24:45.707988 31390 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.143.194:40303 timed out after 1.875s (SENT) [suppressed 24 similar messages]
I20260709 12:24:45.662739 31493 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:45.566479  5924 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:24:45.564633  5776 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.602344  5999 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.566774  6038 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.667923  5932 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.675184  6064 raft_consensus.cc:2764] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:24:45.675549  6080 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:45.584722  5917 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.635424  5815 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.685776 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.589569  6058 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.722990 31492 raft_consensus.cc:2368] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
W20260709 12:24:45.687343  6078 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:45.689836  6061 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.615337  5677 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.585057  6051 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.599047  5617 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.670411  6084 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.668942  5734 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.719451  5932 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:45.670007  5989 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.731189 31567 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
W20260709 12:24:45.726269 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 162664us
I20260709 12:24:45.732604  5734 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:45.748150 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:45.724386  5815 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:45.663679  6057 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:45.762498 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 472391us
I20260709 12:24:45.674073  6039 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:45.753259  5916 consensus_meta.cc:287] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.002s
I20260709 12:24:45.767872 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:45.801592 31493 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:45.769305 31537 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:45.701151  6023 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.730701  6084 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:45.752132  6045 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:45.805925 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 206975us
I20260709 12:24:45.807509 32109 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:45.758988  6064 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:45.811621 31568 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:45.814865 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:45.822042 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.822813 31492 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:45.825711 31492 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:24:45.801821  6006 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.764194  6085 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:45.803501  5986 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:45.824122  5983 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.001s
I20260709 12:24:45.834753  6028 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:45.837878  6064 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:45.838922  6064 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:45.840880  6046 log.cc:927] Time spent T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 1.001s	user 0.009s	sys 0.009s
I20260709 12:24:45.836429 31540 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:45.846079 32114 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:24:45.846819 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:45.807268  6050 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:24:45.849767 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:45.851547 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 256309us
I20260709 12:24:45.827229  5734 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:45.852646 31466 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:45.814743  5916 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:45.855240 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 246238us
I20260709 12:24:45.836069  5983 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for earlier term 17. Current term is 18.
W20260709 12:24:45.857602 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 149647us
I20260709 12:24:45.851539  5898 raft_consensus.cc:2804] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:45.854385  5734 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.871906 31572 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:45.833137  6006 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:45.847183  5986 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:45.835855  6085 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:45.943178 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 68301.8us
W20260709 12:24:45.959259 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 101783us
W20260709 12:24:45.959672 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 107136us
W20260709 12:24:45.943571  6025 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:46.012418 31466 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:45.877162  5734 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:46.020236 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 154336us
I20260709 12:24:46.014302 31465 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:46.018646 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:46.021323 31418 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:24:46.015200  5781 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:45.958359  6038 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.042044 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.019833  6091 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:46.060284 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:46.061307 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 47080us
I20260709 12:24:46.070366 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.070799  5898 raft_consensus.cc:697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:24:46.039947 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 161152us
I20260709 12:24:46.030427  6061 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.136135 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.138031 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.043957  5917 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.044473  6058 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.147607 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.036896  6093 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:46.153146 31417 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
W20260709 12:24:46.137616 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 100846us
I20260709 12:24:46.064252  5617 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.159420 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.150456 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:46.160313 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 91216.3us
I20260709 12:24:46.065450  5677 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:46.185823 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 159926us
I20260709 12:24:46.127808  6028 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:46.180526 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.047365  5781 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.180904 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.127310  5776 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.138339  5989 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.166100 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.191537 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.199405  6085 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.213948 31389 leader_election.cc:400] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
W20260709 12:24:46.199690  6095 log.cc:927] Time spent T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:24:46.179849  6064 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:24:46.201093  6090 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.202961 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.205848 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.206326  6102 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
W20260709 12:24:46.186108 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 58588.7us
I20260709 12:24:46.158470  5797 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.243297  5797 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.245581  5797 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.214290 31389 leader_election.cc:403] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:46.245651  5932 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.246788 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:46.215711  6089 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:46.165063  6105 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:46.219763  6006 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.220216  5898 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } }
I20260709 12:24:46.221436  5916 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.212212  6023 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.207108  6057 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.189646  6039 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.227626 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:46.231092 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 193662us
I20260709 12:24:46.195765  6028 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.251009  6089 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.241711  6038 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:46.258237 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:46.265074 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:46.270936  5983 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.271499  6088 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:24:46.231155 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 76790.5us
I20260709 12:24:46.255869  5776 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:46.276335 32109 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:46.286130 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.283895  5881 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:24:46.275007  6028 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.287986 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:46.280356 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:46.289453 32106 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 11: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:46.280864 32108 raft_consensus.cc:1275] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:46.284228  5874 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:46.291556  5781 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.291373  5874 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.281136  6006 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 12:24:46.284006 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.277143 31418 raft_consensus.cc:2468] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:46.238231  6090 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.301836 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.302834 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.302769 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.300498 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.305166 31416 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:24:46.305490 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.283114  5932 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.306011 31493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.300798 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.299763 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:46.308687 31573 raft_consensus.cc:2393] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 18: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:46.308432 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.306527 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.282274  6088 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:46.277244  6089 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.311936 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.312999 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.250379  6102 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.298755  6110 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:46.317421  6102 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:46.303828  5815 consensus_meta.cc:287] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 12:24:46.318122  5815 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.319705 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:46.320263  5815 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.314971 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.320955 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:46.321388 31498 raft_consensus.cc:2368] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:46.322214 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.314640 31573 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:46.322273 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.315332 31574 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:46.328380 31422 raft_consensus.cc:2368] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19.
I20260709 12:24:46.329226 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:46.337021 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.329792 31566 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 20.
I20260709 12:24:46.345249 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.268421  6105 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.301749  5986 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.341602  5989 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.358901  6061 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.359167  5989 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.285055  5983 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.358067 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.359688  6061 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:46.357497  6084 consensus_meta.cc:287] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:24:46.311167  6093 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:46.374315 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.376425 31466 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:46.375013 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.382145 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.384560 31540 leader_election.cc:400] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19.
I20260709 12:24:46.384663 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.385174 31540 leader_election.cc:403] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:24:46.356415  6057 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.389962 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.372946  5631 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.313732  5734 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.392855 31466 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:46.398348  6105 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.374778  5986 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.389701  6023 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:46.401281  6061 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.413859  5986 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.414947  6061 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.415474  6061 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.416719  5986 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.417510  6061 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.383320  6084 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.396317  6088 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.360862  6085 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.418736 31466 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:46.396855  6093 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.419414  6084 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.420401 31466 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:46.421335  6113 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:46.421371  6023 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:46.422169  6113 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:46.423913  6090 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.393954  5739 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.371766  6106 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.398729  5874 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.438159 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:46.404431  5776 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:46.357914  6102 consensus_queue.cc:1059] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:24:46.401573  6051 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.407104  5631 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.406529  6057 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.419025  6085 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.403349 31566 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:46.425992 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.423964 31569 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:46.431248 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.403872  5898 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:46.373617  6028 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.472941  6039 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.473044  6028 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.473599  6039 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.475346 31493 raft_consensus.cc:2368] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19.
I20260709 12:24:46.437084 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.435448  6111 raft_consensus.cc:3060] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.445575  5989 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.445771  6102 consensus_queue.cc:1243] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer 0065979e5b9a477f8abf064563426291 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:24:46.445004 31390 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.450599  6057 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:46.484030 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 63696.4us
I20260709 12:24:46.450793  5631 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.451865 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.386819 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:46.452461  6090 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.463919 31494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.464689  6105 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.485957  6039 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.501593  5734 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.502324  5776 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.439899  6106 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.504316  5983 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.504693  6106 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.488838  5929 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.490942 31466 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:46.491568  6087 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.471s	user 0.003s	sys 0.000s
I20260709 12:24:46.492036 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:24:46.495296 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50387.5us
I20260709 12:24:46.496016 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
W20260709 12:24:46.497319 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 110559us
I20260709 12:24:46.498400 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.500274  6090 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.510747 31390 leader_election.cc:400] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:46.512403 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.500418  6105 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.514572 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:46.523311 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:46.523905 31424 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.530248 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.530987 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:46.519258  5815 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:46.533393  5910 raft_consensus.cc:3055] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:46.533826  5910 raft_consensus.cc:740] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:46.534384 31424 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:46.539625 31466 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:46.527364  6106 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:46.546101  6092 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:46.546041  6119 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:46.551736  6119 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.552107  6119 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:46.553306  6090 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.554119 31499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3208) took 1038 ms. Trace:
I20260709 12:24:46.554622  6085 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.554533 31499 rpcz_store.cc:276] 0709 12:24:45.515368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.518065 (+  2697us) service_pool.cc:224] Handling call
0709 12:24:45.518368 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.756065 (+237697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.756110 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.756165 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:45.756217 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.553880 (+797663us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400361d54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:46.553927 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.554059 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546141056}
I20260709 12:24:46.549928  6105 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.527045  5734 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.557171  5734 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.560850  6089 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.562057 31492 raft_consensus.cc:2368] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19.
I20260709 12:24:46.588588 31500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48628 (request call id 2601) took 1077 ms. Trace:
I20260709 12:24:46.589213 31500 rpcz_store.cc:276] 0709 12:24:45.510786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.510918 (+   132us) service_pool.cc:224] Handling call
0709 12:24:45.578238 (+ 67320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.727313 (+149075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.727358 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.727412 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:45.727458 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.588257 (+860799us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400024ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:46.588322 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.588504 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342295808}
I20260709 12:24:46.589820 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:46.590545 31421 raft_consensus.cc:2393] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 19: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:46.571941  5958 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:46.610972  6006 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:46.611626  6006 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.613895  6006 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.616006  6055 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.616598  6055 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.617334 32079 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.620271  5983 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:46.619149 32079 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.621272  5999 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:46.622011  6055 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.624629  5631 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.625110  5631 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.621827 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.628142  6055 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:46.597177  5745 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.628737  6055 raft_consensus.cc:493] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.629406  6055 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:46.629108  5745 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.631247  5734 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.633176  6089 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.632145  5745 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.633903 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:46.638989  5958 raft_consensus.cc:697] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:46.640167  5958 consensus_queue.cc:237] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.642511 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.643460 31567 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:46.645952 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.627206  5631 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.659652 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.794718  5631 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.795445  5631 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.836521  6055 raft_consensus.cc:515] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.855863  5631 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.673487  6066 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:46.832427  6111 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273) with higher term. Message: Invalid argument: T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19.
I20260709 12:24:46.911593 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:46.915921 31566 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:46.860175  5734 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.863296  6055 leader_election.cc:290] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.915704  5999 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.933457  5999 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.935699  5999 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:46.915334  6066 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.938374  6066 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.941277 32110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1723) took 1646 ms. Trace:
I20260709 12:24:46.948458 31571 raft_consensus.cc:606] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:46.947978 31566 raft_consensus.cc:2468] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:46.948382  6119 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.949707 31418 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:46.950237  5734 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.952337  5734 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:46.953308  5971 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:46.955058  5971 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:46.954957 32079 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.955471  5971 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:46.956347  5971 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:46.957257  5999 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:46.957549  5971 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:46.957695  5999 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:46.948984 31571 raft_consensus.cc:614] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:46.958137  5999 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:46.958742 31570 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 11.
I20260709 12:24:46.959270  5920 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.959741  5920 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:46.962594  6119 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:46.946394  6088 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:46.956717 32079 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:46.941835 32110 rpcz_store.cc:276] 0709 12:24:45.294916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.295033 (+   117us) service_pool.cc:224] Handling call
0709 12:24:45.295371 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.652100 (+356729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.652143 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.673663 (+ 21520us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.860945 (+187282us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:46.016329 (+155384us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.021490 (+  5161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.552377 (+530887us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18001cedc0. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:24:46.940886 (+388509us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540058f7d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:46.940934 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.940995 (+    61us) raft_consensus.cc:1685] finished
0709 12:24:46.941008 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.941200 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12190,"prepare.queue_time_us":150350,"raft.queue_time_us":2362,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":15405,"spinlock_wait_cycles":835531264,"thread_start_us":177385,"threads_started":1,"wal-append.queue_time_us":283355}
I20260709 12:24:46.966437 32079 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:46.967231 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.968714 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.970009 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:46.970891  5979 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:46.968668  6055 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:46.971509  5979 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:46.971995  5979 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:46.971915  6055 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.972586  6055 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:46.964018 31572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 3819) took 1504 ms. Trace:
I20260709 12:24:46.983697 31572 rpcz_store.cc:276] 0709 12:24:45.459386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.460114 (+   728us) service_pool.cc:224] Handling call
0709 12:24:46.963849 (+1503735us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400196ed4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:46.963961 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786717952}
I20260709 12:24:47.006410 32079 leader_election.cc:304] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:47.007443  5631 raft_consensus.cc:2804] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:47.008111  5631 raft_consensus.cc:697] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:47.009270  5631 consensus_queue.cc:237] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.011466 31389 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.012274 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.013995 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.015198 31389 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.016671  6066 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:47.016973  6096 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.018087  6127 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.018414 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.018801  5983 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.018668  6127 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.019323  5983 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.020844  6127 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.021301  6127 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.021483  5983 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:47.021742  6127 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.023897  6127 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.024971 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.025107  5979 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.027045 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.027693 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.030129 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.018697  5981 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.032119  5981 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.034181  5981 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.035246 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.037775 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:47.038614  6064 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:47.038908 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:47.040180 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:47.040130  6064 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:47.051025 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.022087  5983 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.054666 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:47.055254  5983 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.052636 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.061299 31566 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:47.057372 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.067679 31540 leader_election.cc:400] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19.
I20260709 12:24:47.070559 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.073731  5979 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.074889  5983 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.077911  5920 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.080264 31491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3204) took 1570 ms. Trace:
I20260709 12:24:47.083195 31566 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:47.080753 31491 rpcz_store.cc:276] 0709 12:24:45.509555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.553168 (+ 43613us) service_pool.cc:224] Handling call
0709 12:24:45.553500 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.826741 (+273241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.826789 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.826848 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:45.826895 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.080016 (+1253121us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003bcc54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:47.080064 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.080207 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627790208}
I20260709 12:24:47.068342 32079 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:47.083093 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.093453 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.093750 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.094197 31566 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.094947 31572 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.095971  6093 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.097034  6021 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.070907  5737 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:47.062217  5936 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:47.099121 31496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3209) took 1533 ms. Trace:
I20260709 12:24:47.107136 31496 rpcz_store.cc:276] 0709 12:24:45.565725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.577170 (+ 11445us) service_pool.cc:224] Handling call
0709 12:24:45.577435 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.729496 (+152061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.729527 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.729570 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:45.729609 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.098904 (+1369295us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002922d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:47.098945 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.099065 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349298560}
W20260709 12:24:47.100337 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.102764 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.104802 31567 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:24:47.109185 31569 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.099530  5979 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.101439  6111 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.101962  5983 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:47.116886 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.122653 31566 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:47.129223 31566 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:47.129575 32079 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:47.106769  5737 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.107086  5936 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.142158 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.143728 31569 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:47.111099  6127 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.149215 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.153564 31572 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:47.137149  5999 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.155264 32105 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:47.157488  5999 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.105628  6093 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.128752  5983 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.163789 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.166102 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.139500  5936 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:47.176987 32106 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:47.139616  5981 raft_consensus.cc:2804] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:47.148687  5737 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:47.169587  5920 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.195866  5920 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.198161  5920 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.158593  5631 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.198961  5631 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.201068  5631 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:47.128432  5979 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.204087  5979 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:47.168511  6106 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.130360  6111 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:47.208199  6111 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:47.179101  5929 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:24:47.190255  6132 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:24:47.158493  5734 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.191810  5981 raft_consensus.cc:697] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:47.116312  6021 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.216918 31567 raft_consensus.cc:2468] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:47.228036 31465 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:47.231521 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.232178 31496 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 10.
I20260709 12:24:47.170781  5983 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:47.244587 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.245378 31418 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.234447  5958 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.249009 31421 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:24:47.249819 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.162892  6127 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.250448 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.257086 32106 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.253353 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:47.233857  5734 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.286029 31492 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:47.241034  6028 consensus_queue.cc:1059] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:24:47.244836  5971 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
W20260709 12:24:47.294801 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 58823us
I20260709 12:24:47.244963  6073 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:24:47.296475 32114 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:47.247293  5752 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:24:47.296207 31465 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:47.284350  5929 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:47.298223 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.288816  5999 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.297426  5898 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:24:47.310935  5999 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.294637  5979 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:47.312727  5979 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.314376 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.315023 31572 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:47.315666  5999 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.316665 32079 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:47.303431  6093 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.289919  5737 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:47.306423  6021 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.256032  6055 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.320747  6055 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.321344  6055 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:47.321702  6055 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.322041  6055 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.298488  5981 consensus_queue.cc:237] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.323171  5971 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:47.323266 31465 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:47.323639  5971 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:47.324453  5971 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.325342  6088 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:47.325577  5971 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.325872  6088 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:47.326200  5737 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.326753  5737 raft_consensus.cc:2804] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:47.327229  5737 raft_consensus.cc:697] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:47.326848  6088 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.308818  6127 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.310245 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.240656  5910 consensus_queue.cc:260] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.331409 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.332322 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.339731 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.328150  5737 consensus_queue.cc:237] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:47.350266 31572 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:47.299960  5929 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.351924  5910 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:47.352707  5979 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.351979  5929 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:47.354794  5924 consensus_queue.cc:1175] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0065979e5b9a477f8abf064563426291" responder_term: 18 status { last_received { term: 18 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:24:47.355593  6137 log.cc:927] Time spent T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:24:47.358035 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.358490 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.335709  6111 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.364941  5979 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.359104  6028 raft_consensus.cc:493] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:47.388808 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.375694  5979 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.400983 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.404839  6021 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:47.420913 31390 leader_election.cc:400] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19.
I20260709 12:24:47.421443 31390 leader_election.cc:403] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:47.430382 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.431200 32114 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:47.394742  6028 raft_consensus.cc:515] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:47.442723 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.442410 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.443542 31492 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 10.
I20260709 12:24:47.465875 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.466910 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:47.467200 32110 raft_consensus.cc:1240] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:47.468006 31491 raft_consensus.cc:2410] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:24:47.468642 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.469048 31499 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:47.431310  6118 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19.
I20260709 12:24:47.476287 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:47.480396 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 86532us
I20260709 12:24:47.484515 31573 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:47.441896  6147 raft_consensus.cc:493] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:47.489600 31463 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:47.494063 32114 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.500438 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.503049 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.501978 31497 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:47.500666 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:47.521966 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.516355 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.499979  6127 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.532202  5918 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:47.532665  5918 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:47.532963  5918 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:47.538048 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.542097  5881 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:24:47.542616  6149 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:47.546126 31568 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:24:47.546526 31568 pending_rounds.cc:85] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 12
I20260709 12:24:47.546775 31568 pending_rounds.cc:107] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:24:47.547020 31568 raft_consensus.cc:2889] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.526937 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:47.563632 32107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55788 (request call id 1704) took 1797 ms. Trace:
I20260709 12:24:47.519236  6148 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:47.574406 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.565003 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.498368  6008 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
W20260709 12:24:47.567818 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 67269.6us
I20260709 12:24:47.576767  6146 consensus_queue.cc:1048] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:24:47.577349 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52648.1us
I20260709 12:24:47.564043 32107 rpcz_store.cc:276] 0709 12:24:45.766540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.766726 (+   186us) service_pool.cc:224] Handling call
0709 12:24:45.820135 (+ 53409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.033824 (+213689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.033851 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.033888 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:46.033923 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.547120 (+1513197us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400781754. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:47.563463 (+ 16343us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.563568 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490965376}
W20260709 12:24:47.574522 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 80060.4us
I20260709 12:24:47.580435 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.582901 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.583006  6155 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:47.583789 32107 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:47.583719  6155 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.501727  6147 raft_consensus.cc:515] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.587667  6147 leader_election.cc:290] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.589090 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.590528 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.591758 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.524385  5631 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 12:24:47.593590  6143 log.cc:927] Time spent T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:24:47.596654  5929 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.514384  6059 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:24:47.602321  6129 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.556s	user 0.000s	sys 0.003s
W20260709 12:24:47.581015  6144 log.cc:927] Time spent T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:24:47.598482  5936 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:47.620044  5936 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:47.603289  6140 log.cc:927] Time spent T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:24:47.602236 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.606775 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.622104 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.607151 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.623152  6096 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:47.623258 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.623605  6096 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:47.624322 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.610303 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:47.612128 31537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.613714 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:47.629020 31567 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 19: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:47.615132 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.616235  5918 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.617908  6059 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:47.624387  6096 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:47.625761 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.640487 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.625532 31387 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:47.565372  6055 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.641604  6028 leader_election.cc:290] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.643146  6055 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.591259  5881 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:24:47.647993 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3228) took 1203 ms. Trace:
I20260709 12:24:47.633845 32113 raft_consensus.cc:2393] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:47.564878  6127 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.634836 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:24:47.631671 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.648379 31495 rpcz_store.cc:276] 0709 12:24:46.444871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.470116 (+ 25245us) service_pool.cc:224] Handling call
0709 12:24:46.470367 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.589191 (+1118824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.589218 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.589258 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:47.589297 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.647792 (+ 58495us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400276fd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:47.647833 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.647940 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572683648}
I20260709 12:24:47.649720 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.652712 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.653292 32113 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:47.654031 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.654464 32113 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 11.
I20260709 12:24:47.650307  6119 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:24:47.662082  6127 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.663311 31498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48618 (request call id 3226) took 1219 ms. Trace:
I20260709 12:24:47.663679 31498 rpcz_store.cc:276] 0709 12:24:46.444286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.444398 (+   112us) service_pool.cc:224] Handling call
0709 12:24:46.447532 (+  3134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.456946 (+  9414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.456975 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.498241 (+ 41266us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.913207 (+414966us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:24:46.913270 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.913354 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.601792 (+688438us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1164fedb1 00007fc11659cc85 00007fc11659d6a2 00007fc11930f1db 00007fc11930aaaf 00007fc1192fe86e 00007fc1192fdbb6 00007fc1192fd7d8 00007fc119307221 00007fc1193071d9 00007fc119307169
0709 12:24:47.663031 (+ 61239us) raft_consensus.cc:1685] finished
0709 12:24:47.663051 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.663253 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26082,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":114,"spinlock_wait_cycles":47261952,"thread_start_us":407947,"threads_started":1,"wal-append.queue_time_us":540526}
I20260709 12:24:47.664815 32112 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.665999 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:47.610834  5979 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.669381 32113 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:24:47.669885  5879 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:47.690670 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.674587 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.666671 31500 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:47.694229 32109 raft_consensus.cc:3060] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEARNER]: Advancing to term 18
I20260709 12:24:47.693020 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 377) took 6325 ms. Trace:
I20260709 12:24:47.694406 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.695519 32113 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:47.694260 31387 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:47.696311 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.697003 32113 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:47.697777 32113 raft_consensus.cc:1240] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:24:47.696116 32080 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:47.701251 31387 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:47.695154 31322 rpcz_store.cc:276] 0709 12:24:41.368130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.368418 (+   288us) service_pool.cc:224] Handling call
0709 12:24:47.692960 (+6324542us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:43.487684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:43.488401 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:43.488438 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:24:43.488465 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:43.497875 (+  9410us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:43.497962 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:43.497994 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:24:43.498901 (+   907us) tablet.cc:701] Row locks acquired
0709 12:24:43.498924 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:43.499086 (+   162us) write_op.cc:270] Start()
0709 12:24:43.499244 (+   158us) write_op.cc:276] Timestamp: P: 1783599883499030 usec, L: 0
0709 12:24:43.499270 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:43.529991 (+ 30721us) log.cc:844] Serialized 4035 byte log entry
0709 12:24:44.508649 (+978658us) op_driver.cc:464] REPLICATION: finished
0709 12:24:44.885490 (+376841us) write_op.cc:301] APPLY: starting
0709 12:24:44.893947 (+  8457us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:45.683222 (+789275us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:45.683329 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:45.698901 (+ 15572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:45.699160 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:24:45.699228 (+    68us) write_op.cc:312] APPLY: finished
0709 12:24:45.699521 (+   293us) log.cc:844] Serialized 97 byte log entry
0709 12:24:46.044311 (+344790us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:46.059883 (+ 15572us) write_op.cc:454] Released schema lock
0709 12:24:46.072265 (+ 12382us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:46.248060 (+175795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:46.250089 (+  2029us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":242185,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":354166,"apply.run_cpu_time_us":92453,"apply.run_wall_time_us":1355529,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":230899,"prepare.run_cpu_time_us":51683,"prepare.run_wall_time_us":330283,"raft.queue_time_us":269324,"raft.run_cpu_time_us":37625,"raft.run_wall_time_us":504149,"replication_time_us":982143,"thread_start_us":1101628,"threads_started":5,"wal-append.queue_time_us":1074051,"wal-append.run_cpu_time_us":23454,"wal-append.run_wall_time_us":2250781}]]}
I20260709 12:24:47.704926  5881 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:47.705420  5881 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.705807  5881 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.703009  5925 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:47.710937 31571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48056 (request call id 5) took 3453 ms. Trace:
I20260709 12:24:47.711306 31571 rpcz_store.cc:276] 0709 12:24:44.261051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.261208 (+   157us) service_pool.cc:224] Handling call
0709 12:24:47.710752 (+3449544us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54001ce154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc11975d853 00007fc11e72b60a 00007fc117cb17d4 00007fc117cb1762 00007fc117cb1691 00007fc117cb160c 00007fc117cb08c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:47.710846 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6007004416}
I20260709 12:24:47.711728 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:47.714756  6155 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.714920 31500 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:47.691980  6096 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:47.717432 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.719391 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.722059 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.723664 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.727694 32113 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.730449 31573 raft_consensus.cc:2393] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 19: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:47.699812  5979 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:47.745306  6055 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.750486 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.752437 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.752490  5917 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:47.753995 32112 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:47.754211  5917 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.755014 31387 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:47.755800  6118 consensus_queue.cc:1059] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:47.756098  5797 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:47.756615  6110 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:47.757992 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:47.759452  6118 consensus_queue.cc:1243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer e166c1cb41f04d55a85e6c0d7966e32e log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:24:47.759979  6118 raft_consensus.cc:3055] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:47.760279  6118 raft_consensus.cc:740] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:47.761040  6118 consensus_queue.cc:260] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.762187  6118 raft_consensus.cc:3060] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:47.730367  5631 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:47.695832  5983 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.770661 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.784745 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.785449  5983 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.785796 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.771435 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.786756 32105 raft_consensus.cc:1240] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:47.787667 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.788687 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.789191 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.789639 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.772511 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.791489 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.792526 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.792989 31419 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:24:47.793085 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.793453 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:47.793941 31419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.773168 31420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.731369  5925 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:24:47.745894  6055 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:47.797199  6055 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:47.797286 31571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:47.797539 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:47.797906 31571 raft_consensus.cc:606] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:47.798725 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.799285 32108 raft_consensus.cc:2376] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18. Re-sending same reply.
W20260709 12:24:47.800915 31570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48862 (request call id 3831) took 1501 ms (client timeout 1579 ms). Trace:
W20260709 12:24:47.801298 31570 rpcz_store.cc:269] 0709 12:24:46.299932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.302608 (+  2676us) service_pool.cc:224] Handling call
0709 12:24:47.800768 (+1498160us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54001ce154. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:47.800859 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506666880}
I20260709 12:24:47.774724 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.731631  6127 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:47.778389  5929 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:47.779369 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:47.803452 31499 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:24:47.804787 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:47.811025 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.820324 31495 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.820262 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.822536 32109 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.823731 32109 raft_consensus.cc:1240] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:47.830084 31465 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:47.841538 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.842519 31418 raft_consensus.cc:2468] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:47.843452 32113 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:47.785804 31321 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.852412 31321 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:47.855201 31321 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.860913 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:47.863551 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:47.865679 31574 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:24:47.857378 31321 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:47.884105 32107 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:24:47.885288 32107 raft_consensus.cc:1240] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:47.874902 31321 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 17, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 17 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:47.895735 31321 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:47.904142 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:47.907596 32111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55794 (request call id 1718) took 2592 ms. Trace:
I20260709 12:24:47.912178 32107 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:47.924012 31572 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:24:47.926647 31499 raft_consensus.cc:2468] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 12.
I20260709 12:24:47.920502 32111 rpcz_store.cc:276] 0709 12:24:45.291152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.291390 (+   238us) service_pool.cc:224] Handling call
0709 12:24:45.291722 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.494014 (+202292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.494061 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.523283 (+ 29222us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.730331 (+207048us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:24:45.794483 (+ 64152us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.794800 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.562103 (+767303us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b180005b120. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166763f3 00007fc1166787c1 00007fc116678779 00007fc116678709 00007fc1166786d1 00007fc1166779cd 0000000000388634 0000000000388479 00007fc11665983a
0709 12:24:47.186282 (+624179us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b180005b120. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc1166442a6 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419
0709 12:24:47.882915 (+696633us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400241b54. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc119763e01 00007fc11976283e 00007fc11e727419 00007fc117c9ebd4 00007fc117c9eb62 00007fc117c9ea91 00007fc117c9ea0c 00007fc117c9dcc2 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:47.882959 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.883001 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:47.883013 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.883136 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8720,"prepare.queue_time_us":63550,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":5188,"raft.queue_time_us":9851,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":25017,"spinlock_wait_cycles":482808704,"thread_start_us":206709,"threads_started":1,"wal-append.queue_time_us":304414,"wal-append.run_cpu_time_us":2615,"wal-append.run_wall_time_us":1086139}
I20260709 12:24:47.859058  6106 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:24:47.905357  6075 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:47.934549 31540 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:47.941589 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.967481 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d39355c9d4d4e3b922b43b63d9f6ef6" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.967978 32106 raft_consensus.cc:1240] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:47.968652 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e64b21111bd41639226f8d37505e9a7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:47.963904 31321 catalog_manager.cc:5697] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.899530  5936 consensus_queue.cc:1059] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:24:47.973799 31321 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 17 to 19, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 19 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:47.985888  6064 raft_consensus.cc:3055] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:47.986332  6064 raft_consensus.cc:740] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:47.987916 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:47.933193  6142 raft_consensus.cc:2764] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:24:47.978540  5916 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:47.934597  6000 consensus_queue.cc:1059] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:24:47.941241  6045 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:24:47.987413  5998 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:47.969282  6075 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:48.026330 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85271.5us
I20260709 12:24:48.035224  5881 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.018090  6059 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:48.036136  6059 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:48.036917  6059 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.037531  5881 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.038091  6059 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:48.038707 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:48.024863  6064 consensus_queue.cc:260] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.041160  6064 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:48.044999 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.065912  6165 log.cc:927] Time spent T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:24:48.070737  5916 raft_consensus.cc:697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:48.071695  5916 consensus_queue.cc:237] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.080550  5734 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.081179 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:48.085418  5917 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.086252  5958 raft_consensus.cc:3055] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:48.086742  5958 raft_consensus.cc:740] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.044035  5998 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.087719  5958 consensus_queue.cc:260] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.088828  5998 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.088965  5958 raft_consensus.cc:3060] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:48.091931  5808 raft_consensus.cc:3055] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:48.092319  5808 raft_consensus.cc:740] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:48.093123  5808 consensus_queue.cc:260] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.098307  5918 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.105510  6075 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:48.107097 32108 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: [18.17-18.17]
I20260709 12:24:48.108790 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:48.110936 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:48.111521 31491 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 21.
I20260709 12:24:48.114751 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:48.116218  6093 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:48.116605  6093 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:48.114511 31537 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.116957 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:48.117733 31421 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 21: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:48.118022 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.119894 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:48.119972 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.120734 31497 raft_consensus.cc:2410] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e for term 19 because replica has last-logged OpId of term: 18 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
I20260709 12:24:48.121378 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:48.122442 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.094458  5808 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:48.131307  5920 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:48.132037  5920 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:48.132588  6111 raft_consensus.cc:993] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:48.133726  6154 raft_consensus.cc:1081] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:48.135097 31537 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.135856  6106 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:48.157011  5981 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:48.157863 31424 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55332
I20260709 12:24:48.157811  5981 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.158524 31424 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.158933 31424 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.159212 31537 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.159993  5981 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:48.160575 31537 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.161695  5910 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.162887 31537 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.163053 31565 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:48.215724 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.116986  6093 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:48.159999  6075 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.168556 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:48.219390 31497 raft_consensus.cc:606] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
W20260709 12:24:48.219581 31389 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.220607  6075 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.221110  6075 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.223237  6075 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.168892 31568 raft_consensus.cc:1240] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:48.170316 31571 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:48.171000 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:48.194336 31499 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:48.200461 31390 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.226835  6176 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.202782 31574 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:48.204241 31573 raft_consensus.cc:1275] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:48.207432 31423 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:48.210932 31492 raft_consensus.cc:1275] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:48.231791  6127 raft_consensus.cc:2804] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:48.234292  6127 raft_consensus.cc:493] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.234745  6127 raft_consensus.cc:3060] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.235881 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.237248 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:48.237582 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:48.238785 31415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:48.242429  6176 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:48.243142  5879 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:24:48.244807 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.247040 31463 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.249918  6064 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.250460  5879 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:48.251636  5879 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:48.252101  5879 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
W20260709 12:24:48.251718 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 88896.2us
I20260709 12:24:48.252952 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:48.253062  5879 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.252184  5734 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:48.254580  5879 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:48.255950  5920 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.258913  5999 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.253990 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:48.315438 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 61530.8us
I20260709 12:24:48.316210 31537 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.317389 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.230522 31424 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.317932  6127 raft_consensus.cc:515] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.319468 31424 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:48.275533 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 364583us
I20260709 12:24:48.320775 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.322377  6064 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:24:48.322966 31465 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.323210  6127 leader_election.cc:290] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:48.324797 31421 raft_consensus.cc:2468] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
W20260709 12:24:48.329528 31466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.307018 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 60093.5us
W20260709 12:24:48.312774 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 50534.1us
W20260709 12:24:48.313935 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78123.4us
I20260709 12:24:48.259541  6155 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:48.353986 31423 raft_consensus.cc:1240] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:48.354295 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:48.354907 31567 raft_consensus.cc:3055] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:48.355195 31567 raft_consensus.cc:740] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:48.325934 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:48.355923 31567 consensus_queue.cc:260] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.357054 31567 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.250298  6093 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.333966 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.334003  6177 consensus_queue.cc:1059] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:48.359351  6177 raft_consensus.cc:3055] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:48.359735  6177 raft_consensus.cc:740] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.360195  6093 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:48.360488  6177 consensus_queue.cc:260] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.361954  6177 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.350461 31424 raft_consensus.cc:1275] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:24:48.365285 31567 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
W20260709 12:24:48.366549 31539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.367777  5958 consensus_queue.cc:1059] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:48.371027 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.372375  5734 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.373140  5734 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.373780  5734 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:24:48.374982 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 57670.2us
I20260709 12:24:48.375250  6064 raft_consensus.cc:3055] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:48.375629  6064 raft_consensus.cc:740] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.375701 31537 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.376458  6064 consensus_queue.cc:260] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.377373 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:48.377826  6064 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:48.378373  6155 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:24:48.378042 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44147.4us
I20260709 12:24:48.380386 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.381503 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.382302  5958 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:48.382815  5979 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.382920  5958 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.383611  5979 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:48.383980  5958 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.386013 32080 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.384013  5979 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:48.386863  5981 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.387194  5979 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.388221 32080 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.389081  6155 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.390342 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.391381  6127 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.393846  6155 consensus_queue.cc:1048] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:48.395253  5979 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.396104 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:48.396818 32105 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:48.399039 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:48.399339 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:48.400017 32113 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 12: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:48.401889 31463 leader_election.cc:304] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.402751  6148 raft_consensus.cc:2749] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.404021 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.404826  6155 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:48.405417  6148 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:48.407732  6148 consensus_queue.cc:1048] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:48.409332 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.410336 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.411820  6096 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:48.413488 31463 leader_election.cc:304] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.416867  5734 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:48.417301  5734 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:48.417727  5734 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:48.398420  6064 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:24:48.433545  5734 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:48.437517 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 61908.7us
I20260709 12:24:48.438671 31537 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.439405  5916 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.442993  6155 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.453146  5734 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:48.458772 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49506.3us
I20260709 12:24:48.458856  6148 raft_consensus.cc:2749] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:48.459808 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.460572  5983 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:24:48.460677 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46119.4us
I20260709 12:24:48.462095  6148 raft_consensus.cc:993] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:48.462561  6142 raft_consensus.cc:1081] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Signalling peer 0065979e5b9a477f8abf064563426291 to start an election
I20260709 12:24:48.464428  6064 consensus_queue.cc:1059] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:48.465502  6148 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:48.465885  6148 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.466727  6148 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:48.468022 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 54600us
I20260709 12:24:48.468932 31463 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.469659  6142 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:48.471285  5979 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:48.474355  6148 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.477289 32080 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.480176 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.482471 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:48.483211 31424 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 21: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:48.478240  6142 consensus_queue.cc:1048] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:24:48.483886 31421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e"
dest_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:55328
I20260709 12:24:48.484531 31421 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.484927 31421 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:48.486609 31537 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.480597 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.481882 31389 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:48.491137 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.491721 31496 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.489464 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.497491 32080 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.498562 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.500829 32080 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.502655  5981 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.503788  5920 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:48.504684  6159 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:48.512533 31570 raft_consensus.cc:1240] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:48.488121  5983 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.502036 31421 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.514397 31537 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:48.514919 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.513772  6159 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:48.517481  6075 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:48.491161  6155 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.494655  5881 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:24:48.523766 31464 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.526648 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.501782  6127 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.497053  6093 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:24:48.538632 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.539302 31499 raft_consensus.cc:3055] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:48.539578 31499 raft_consensus.cc:740] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.541430 31537 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.524473  6075 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:48.530229  5979 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:48.522910 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.545214  6106 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:48.535027  5920 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:48.540269 31499 consensus_queue.cc:260] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.537407  5881 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:48.560309 31499 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:48.549130 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.546181  6075 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:48.593042 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.549726  6106 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:48.596047 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.584811  5971 consensus_queue.cc:1059] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:24:48.599548 31570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
mode: GRACEFUL
new_leader_uuid: "0065979e5b9a477f8abf064563426291"
 from {username='slave'} at 127.0.0.1:48056
I20260709 12:24:48.600102 31570 raft_consensus.cc:606] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 0065979e5b9a477f8abf064563426291
I20260709 12:24:48.600412 31570 raft_consensus.cc:614] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:48.597932  6127 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.554024  6155 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:48.551256  5898 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:24:48.559572  5920 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:48.609519 31497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f42c299f626148ba8af55613ab8e9bc4"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:48.619868 31497 raft_consensus.cc:606] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.619998 31499 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:48.620241 31497 raft_consensus.cc:614] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:48.595288  5979 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:48.626371 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:48.615109  6127 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:48.603721  5917 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.643389 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.621178  5920 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:48.652038 31496 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
I20260709 12:24:48.657662 32080 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.603158  5881 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:48.660532 32080 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.667394  5979 raft_consensus.cc:2804] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:48.667882  5979 raft_consensus.cc:697] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:48.668686  5979 consensus_queue.cc:237] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.670775 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:48.611474  6106 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.671416 32113 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:48.672753 32105 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:48.674309 31421 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:48.661700  6127 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:48.679749 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:48.684391 32105 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:48.661541  5981 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.685607 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.688190 32107 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:48.688378 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:48.689517 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:48.653712  5917 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.689106 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:48.695704 31537 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:48.702261 31500 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 21.
I20260709 12:24:48.706229  6064 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:24:48.697929  6154 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:48.708889  6154 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:48.709280  6154 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:48.696904  5958 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:24:48.733733  6201 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:24:48.717566  5734 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.717407  5958 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:48.741206  6199 log.cc:927] Time spent T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:24:48.748899 32113 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:48.755165  5734 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:48.738842  5958 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:48.718286  6111 consensus_queue.cc:1059] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:24:48.821431  5905 raft_consensus.cc:1064] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: attempting to promote NON_VOTER e166c1cb41f04d55a85e6c0d7966e32e to VOTER
I20260709 12:24:48.823794  5905 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.845770  6147 raft_consensus.cc:3055] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:48.846203  6147 raft_consensus.cc:740] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:48.847008  6147 consensus_queue.cc:260] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:48.857481 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 321102us
I20260709 12:24:48.858901 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:48.859159 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 321479us
I20260709 12:24:48.859800 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:48.844802  6154 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:48.868724 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:48.894547 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1685dea95ca449998eaf8075418fda96" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.895787 31496 raft_consensus.cc:2393] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 12: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:48.896493 31492 raft_consensus.cc:1275] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:48.896999 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.897118 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:48.899227 32080 leader_election.cc:304] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.900403 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:48.901036 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:48.901794 31500 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 22: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:48.903322 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:48.906565 31572 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:48.908542  5734 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:24:48.909817 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 231890us
I20260709 12:24:48.918365 32105 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:48.906225  5999 raft_consensus.cc:2749] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:48.926635  5979 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:24:48.942670  5917 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:48.959986 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59651.4us
W20260709 12:24:48.964767 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55492.6us
I20260709 12:24:48.949663  6106 consensus_queue.cc:1048] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:24:49.036158  5734 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.067592  5734 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:49.071642 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 205377us
I20260709 12:24:49.075820 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:49.076614 32105 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
W20260709 12:24:49.078601 31463 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.079906 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:49.085052  5917 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:49.099114 31415 raft_consensus.cc:1275] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:49.099748 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:49.135457 31415 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:49.102094  5917 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:49.151284 31540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.151890 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:49.154963  5999 consensus_queue.cc:1048] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:49.156564  5999 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:49.098289  5920 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.161419 31568 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:49.162060 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:49.164455 31499 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:49.153546  5917 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.191939 31567 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:49.197476 31538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.203202 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97054.5us
I20260709 12:24:49.209535 31390 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:49.218307 31568 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:24:49.223577 31421 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:24:49.257845 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 102357us
I20260709 12:24:49.186591  5905 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:24:49.269790  6218 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.270398  6218 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:49.272544  6218 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:49.283946 31568 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:24:49.234663  6096 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:49.288625 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:49.292825 31573 raft_consensus.cc:3060] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:49.300268 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 72752.7us
W20260709 12:24:49.305485 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 77333.1us
I20260709 12:24:49.234802  6142 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:24:49.292055  6223 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:24:49.312001  6096 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:49.324658  6096 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.330969 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:49.332424 31573 raft_consensus.cc:1275] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:24:49.337015  5958 consensus_meta.cc:287] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 12:24:49.337488  5958 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.338610 31499 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:49.311787  6066 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:24:49.361667  6154 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.361943  6223 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:49.362511  6223 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.364600  6223 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:49.366850  6075 consensus_meta.cc:287] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.003s
I20260709 12:24:49.367311  6075 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.369385  6075 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.369632 31565 raft_consensus.cc:1240] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:49.358332  5929 raft_consensus.cc:3055] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:49.371057  5929 raft_consensus.cc:740] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.371443  5981 consensus_queue.cc:1048] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:49.371872  5929 consensus_queue.cc:260] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.373035  5929 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:49.375584  6158 consensus_queue.cc:1059] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:49.376513  6158 raft_consensus.cc:3055] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:49.376580  5920 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.376932  6158 raft_consensus.cc:740] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:49.377805  6158 consensus_queue.cc:260] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.383513  6158 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:49.388813  6213 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:49.390094  6088 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:49.390471  6088 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:49.391285  6088 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.392689  6088 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:49.395009 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:49.398113  5917 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.400519  5917 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.404551  6147 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.409464 31491 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:24:49.417229 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:49.383389  5958 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.442610  5898 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:49.488237 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 143156us
I20260709 12:24:49.498277 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:49.501766 31499 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:49.443502  5917 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:24:49.509100 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e357624c0f4e5f89de3446133ddb5c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:49.509740 32108 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.501241 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:49.486799  5898 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:49.517592 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:49.518044 31417 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:49.514151 31424 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:49.492477  5929 consensus_queue.cc:1059] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:24:49.525274 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:49.529840 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:49.530547 32112 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.532860 32105 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEARNER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:49.536036 32105 raft_consensus.cc:1240] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:49.540342 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:49.541046 31418 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:49.494845  6234 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:24:49.549882 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:49.551704  6075 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:49.551574  5910 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:49.552139  6075 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:49.552589  6075 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.556593 31498 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:49.544551 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:49.543498 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:49.529461  6064 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.570396 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:49.573499 32108 raft_consensus.cc:2468] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:49.575872 32113 raft_consensus.cc:1240] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
I20260709 12:24:49.577782 31463 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:49.577904 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:49.576275 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:49.522230  6177 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:24:49.582958  6154 raft_consensus.cc:3055] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:49.583405  6154 raft_consensus.cc:740] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.584211  6154 consensus_queue.cc:260] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.585328  6154 raft_consensus.cc:3060] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.585979 31416 raft_consensus.cc:2468] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
W20260709 12:24:49.587167  6236 log.cc:927] Time spent T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:49.575007  6111 raft_consensus.cc:2749] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:24:49.576785  6227 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:24:49.597111 32112 raft_consensus.cc:2468] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:49.597900 32105 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:49.605676 31463 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:49.580616  5971 raft_consensus.cc:2804] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:49.607538  6238 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:49.613682  5971 raft_consensus.cc:697] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:49.613960  6238 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:49.577138  6064 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.559098  5920 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:24:49.614396  6238 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:49.626303 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48924.1us
I20260709 12:24:49.621574 31540 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:49.623142 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:49.601455  6106 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:49.614461  5898 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:49.663759 31499 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 20: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:49.616171  6213 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:49.610286  6045 raft_consensus.cc:2804] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:49.668615 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:49.670259 31416 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
W20260709 12:24:49.671027 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 49556.8us
I20260709 12:24:49.675493  6045 raft_consensus.cc:697] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:49.676406  6045 consensus_queue.cc:237] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.683959  6064 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.686846  5898 raft_consensus.cc:2804] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:49.689715  5898 raft_consensus.cc:697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.691056  5898 consensus_queue.cc:237] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.620349  5971 consensus_queue.cc:237] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.651193  6218 consensus_queue.cc:1059] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 12:24:49.712790  5916 raft_consensus.cc:3055] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:49.713225  5916 raft_consensus.cc:740] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.717816 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:49.729339 31570 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:49.730120 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:49.730769 32112 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:49.747213 31463 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:49.669796  6213 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:49.749609 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:49.761206 31495 raft_consensus.cc:2468] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:49.755772  6147 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:49.763849  5905 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:49.781709  5905 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:49.782157  5905 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.783147  6213 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.784798  6147 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.785333  6147 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:24:49.774923 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 163017us
I20260709 12:24:49.785821 31491 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:49.781947  6227 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 12 to 14, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:49.794273  6238 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.803747 32105 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:24:49.753417  5916 consensus_queue.cc:260] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.828158  6238 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:49.831102  6219 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:24:49.834159 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:49.836114 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:49.836889 31500 raft_consensus.cc:2393] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
W20260709 12:24:49.851305  6244 log.cc:927] Time spent T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:24:49.855018  5916 raft_consensus.cc:3060] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.866474 31423 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:24:49.868304 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:49.874994 31416 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:24:49.860428 32105 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:49.882858 31499 raft_consensus.cc:1240] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:49.885701  6088 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.886410  6088 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.894474 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:49.895126 32108 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:49.896441 31463 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:49.897185  6245 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.897650  6245 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.899793  6245 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.900303  6245 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:49.900610  6245 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.900930  6245 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.904731 31570 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:24:49.904631  6218 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:49.904908 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:49.905616 31567 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:49.908820 31465 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:49.909473  6213 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:49.909584  6214 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:49.910399  6214 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.920547  6214 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:49.920356  6147 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.874156  6238 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:49.922788  6238 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:49.924001  6238 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.928139 31495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48628 (request call id 2640) took 1033 ms. Trace:
I20260709 12:24:49.928704 31495 rpcz_store.cc:276] 0709 12:24:48.895185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.896789 (+  1604us) service_pool.cc:224] Handling call
0709 12:24:49.927921 (+1031132us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400023ad4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cc571 00007fc1197672fa 00007fc11e728b17 00007fc117ca36d4 00007fc117ca3662 00007fc117ca3591 00007fc117ca350c 00007fc117ca27c2 00007fc117a9e48c 00007fc117a9d8c6 00007fc117a9d26f
0709 12:24:49.928059 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955667712}
I20260709 12:24:49.931186 31540 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:49.922814  6088 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:49.916693 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:49.942637 31416 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:49.917575 31418 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:49.919925 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:49.944577 32107 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:49.932268  6218 raft_consensus.cc:2804] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:49.912961  6075 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:49.946218 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:49.948706 31567 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:24:49.939910  6248 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.117s	user 0.000s	sys 0.003s
I20260709 12:24:49.944660  6234 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.958490  6218 raft_consensus.cc:697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:49.971982  6075 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:49.972685 31568 raft_consensus.cc:1240] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:24:49.971565  6218 consensus_queue.cc:237] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.983359  6234 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:49.987535 31499 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:24:49.992234 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:49.992985 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:49.999783 31567 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:49.981652  5905 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.010448 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:50.011343 31498 raft_consensus.cc:2393] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 20: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:50.012944  5905 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:50.015251 31465 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:50.020516 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:50.020766 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:50.029645 31321 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 371) took 6369 ms. Trace:
I20260709 12:24:50.017105 31315 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: NON_VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.030303 31321 rpcz_store.cc:276] 0709 12:24:43.659855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.660018 (+   163us) service_pool.cc:224] Handling call
0709 12:24:43.868699 (+208681us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:50.029566 (+6160867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:48.310748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:48.311309 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:48.311342 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:48.311359 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:48.312278 (+   919us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:48.312338 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:48.312365 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:24:48.313060 (+   695us) tablet.cc:701] Row locks acquired
0709 12:24:48.313079 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:48.313216 (+   137us) write_op.cc:270] Start()
0709 12:24:48.313329 (+   113us) write_op.cc:276] Timestamp: P: 1783599888313170 usec, L: 0
0709 12:24:48.313353 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:48.313934 (+   581us) log.cc:844] Serialized 3638 byte log entry
0709 12:24:48.418184 (+104250us) op_driver.cc:464] REPLICATION: finished
0709 12:24:48.429216 (+ 11032us) write_op.cc:301] APPLY: starting
0709 12:24:48.429301 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.449040 (+ 19739us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.449143 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:48.551533 (+102390us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:48.551774 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:24:48.551820 (+    46us) write_op.cc:312] APPLY: finished
0709 12:24:48.552083 (+   263us) log.cc:844] Serialized 89 byte log entry
0709 12:24:48.552258 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.552388 (+   130us) write_op.cc:454] Released schema lock
0709 12:24:48.552431 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:48.588058 (+ 35627us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:48.589505 (+  1447us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13758,"reported_tablets":25,"spinlock_wait_cycles":354182016,"child_traces":[["op",{"apply.queue_time_us":10801,"apply.run_cpu_time_us":13821,"apply.run_wall_time_us":131661,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41801,"num_ops":9,"prepare.queue_time_us":261883,"prepare.run_cpu_time_us":3923,"prepare.run_wall_time_us":93470,"raft.queue_time_us":36759,"raft.run_cpu_time_us":1119,"raft.run_wall_time_us":16979,"replication_time_us":104669,"thread_start_us":445042,"threads_started":4,"wal-append.queue_time_us":64690,"wal-append.run_cpu_time_us":3669,"wal-append.run_wall_time_us":1224676}]]}
I20260709 12:24:50.044122 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:50.044476 31416 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:24:50.044857 32105 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:50.036594 31315 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 21 to 22, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 22 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.035146  5905 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.046114 31315 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 15, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.035354  6142 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:50.054847 31315 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 19, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 19 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.036257  6147 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.060290 32105 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:50.036708  6045 consensus_queue.cc:1059] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:24:50.063206  6045 raft_consensus.cc:3055] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:50.063542  6045 raft_consensus.cc:740] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.054032  6206 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.064347  6045 consensus_queue.cc:260] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.064606  6206 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.065553  6045 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:50.067180 31315 catalog_manager.cc:5697] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.057176  5905 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.076897 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.077493 32107 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:50.078826 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:50.079430 31491 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:50.079916 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:50.082340  6106 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:50.082732  6106 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.083153  6106 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.084183  6206 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.085980 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.086546 32107 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:50.087813  6088 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.088279  6088 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.088563 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.090279  6088 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:50.090440 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:50.094213 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.095027 31568 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:50.069840 31315 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.016613  6220 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.038s
I20260709 12:24:50.074435  5905 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.097368 31465 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:50.102535 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:50.104977 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:50.105060 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.106372 32107 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 18.
I20260709 12:24:50.107059 31315 catalog_manager.cc:5697] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 15 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
W20260709 12:24:50.092377  6233 consensus_queue.cc:1175] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0065979e5b9a477f8abf064563426291" responder_term: 16 status { last_received { term: 16 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 16 index: 9 } }
I20260709 12:24:50.103081  6148 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:50.057729  6234 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.103241  6142 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.107374  5910 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:24:50.107543  6147 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:24:50.119258  6148 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.128659  6148 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.120263  5916 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:50.133673  5916 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:50.134845  5916 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.139710 32108 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:24:50.143613  6245 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.145493 31499 raft_consensus.cc:2393] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 in current term 20: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:50.145773  6245 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.146742 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:50.146854  6214 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.147395 32108 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:24:50.147259  6142 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.148918  6214 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.155195 32108 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:50.156430 31463 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:50.158272  6064 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:50.158797  6064 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.159046  6206 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:24:50.159708  6064 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.127112  6147 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.168843 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:50.169588 32105 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.176278 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:50.177119 31568 raft_consensus.cc:3060] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.178392 31570 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:50.167404  6147 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:50.194380 32105 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
W20260709 12:24:50.197615  6251 log.cc:927] Time spent T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:24:50.232762  6106 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.235082  6106 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.235545  6147 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.237267  6148 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.239542  6238 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:50.239925  6148 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.240141  6238 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:50.240633  6262 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:24:50.242385  6238 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:50.237655  6147 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:50.114337 31315 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 15, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 15 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.287436 31387 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:50.290140 31315 catalog_manager.cc:5697] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.294665 31416 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:50.300313 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:50.301834 31422 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:50.311764 31463 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:50.319762 31567 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 18: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:50.316663 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:50.327890 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:50.324904 31492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:50.328804 31565 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 18: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:50.329432 31492 raft_consensus.cc:2393] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:50.330142 31417 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:50.337567 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:50.337572 31315 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 14 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 16 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:50.357023 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.358443 31574 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:50.363580 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:50.364642 31499 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:24:50.362329 31315 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.366523 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:50.386657 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:50.387791 32114 raft_consensus.cc:3060] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:50.390136 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:50.400171  6142 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:50.401456  6206 raft_consensus.cc:2804] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:50.402140  6206 raft_consensus.cc:697] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.403023  6204 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.390161  6238 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:50.413671  6206 consensus_queue.cc:237] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.391961  6045 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.415781  6045 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.414103  6238 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.368315 31315 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.403898  6204 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.450943  6268 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:50.451622  6268 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:50.452167  6268 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:50.510810 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90864.1us
I20260709 12:24:50.514475  6204 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.516067  6238 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:24:50.516919 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 150765us
I20260709 12:24:50.523653 31537 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:50.541359 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:50.542410 31491 raft_consensus.cc:2393] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 17: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:50.544498  6154 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:50.510367 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:50.559285 31418 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:50.561318 31423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:50.575486 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.575954 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:50.576840 31421 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:50.526981  6045 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.584321 32113 raft_consensus.cc:1275] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:24:50.586100 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:50.620879 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 90337.1us
I20260709 12:24:50.623380 32114 raft_consensus.cc:2468] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:50.626088 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.653910 31422 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:24:50.669534  6117 raft_consensus.cc:2764] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:24:50.698450  5910 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:24:50.711897 32105 raft_consensus.cc:3060] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:50.720937 31497 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:50.727536 31499 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:50.731418  6154 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.739367  6154 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.748579 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:50.751407 31568 consensus_meta.cc:287] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.574s	user 0.017s	sys 0.006s
I20260709 12:24:50.751590  6269 raft_consensus.cc:3060] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:50.751894 31568 raft_consensus.cc:2468] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:50.757889  6268 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.760584  6268 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:50.761721 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:50.762552 31568 raft_consensus.cc:2393] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 13: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:50.766276 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:50.768419 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:50.769138 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 96042.4us
I20260709 12:24:50.771085  6142 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:50.771602  6142 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.772032  6142 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:50.789602  5917 consensus_queue.cc:1048] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:50.793709 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:50.778126  6154 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.801748 31418 raft_consensus.cc:2468] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 21.
I20260709 12:24:50.815418 31422 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:50.800052  5917 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:50.821447  6204 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:50.817183 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:50.816957 31463 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:50.836890 31422 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:50.840162  6204 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.843642  5958 raft_consensus.cc:2804] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:50.844254  5958 raft_consensus.cc:697] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.845436  5958 consensus_queue.cc:237] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.854350 31466 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:50.855935  6045 raft_consensus.cc:2804] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:50.856513  6045 raft_consensus.cc:697] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:50.856642  5971 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:50.857647  6045 consensus_queue.cc:237] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.859704 31567 raft_consensus.cc:1275] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:24:50.863224 32105 raft_consensus.cc:1275] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:50.864027  6272 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.864701  6272 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.864709 31565 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:50.871641  6272 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:50.877178 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.816339  6269 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:50.887732 32108 raft_consensus.cc:1275] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:24:50.893349 31499 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 13.
I20260709 12:24:50.901834  5905 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.902155  6075 consensus_queue.cc:1059] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:50.902503  5905 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:50.903076  6075 raft_consensus.cc:3055] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:50.903451  6075 raft_consensus.cc:740] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:50.904842  5905 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.904680  6075 consensus_queue.cc:260] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:50.906126  6075 raft_consensus.cc:3060] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:50.906324 32114 raft_consensus.cc:1275] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:50.931250 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:50.931595  6111 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:50.931938 31497 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:24:50.936342  6204 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:50.937902 31424 raft_consensus.cc:1240] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 20. Current term is 21. Ops: []
I20260709 12:24:50.942535 32105 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:24:50.954704 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:50.962530 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.964787 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:50.942689  6269 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:24:50.973181 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:50.973897 31574 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:50.973559 31540 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:50.992610 32105 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:24:50.963326  5917 consensus_queue.cc:1048] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:24:51.007253 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:50.996618  6154 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:51.013312 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:51.015614  6218 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:50.978572  6206 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:24:51.011584  5917 consensus_queue.cc:1243] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer 8553a13b444649b9a19e5488aabaf1c5 log is divergent from this leader: its last log entry 19.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:24:51.033218 32110 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:51.033725  6272 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:51.034341  6272 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.003472  6111 consensus_queue.cc:1048] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:24:51.040112  6045 consensus_queue.cc:1048] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:51.022389  6154 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.043067  6154 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:51.003468  5910 consensus_queue.cc:1048] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:24:51.009624  6142 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.047593 31491 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:51.048697  6142 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:51.025352 31465 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:51.067370 31567 raft_consensus.cc:1275] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:51.074895 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:51.075870 31422 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:51.078835 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:51.083811  6238 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:51.084551  6238 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:51.085534  6238 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.079820 31574 pending_rounds.cc:85] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 16
I20260709 12:24:51.087395 31574 pending_rounds.cc:107] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 12:24:51.087729 31574 raft_consensus.cc:2889] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:51.061980  6142 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:24:51.089481 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:51.089840  6142 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:51.090087 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:51.090379  6142 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:51.091017 31565 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 20: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:51.098783 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:51.090303 32110 raft_consensus.cc:2393] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 19: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:24:51.099422 31496 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:51.103663 32080 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:51.127800  6272 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:51.129349  5981 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:51.141014 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:24:51.145707 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 150630us
I20260709 12:24:51.114239  5917 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:24:51.157285  6270 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:24:51.166642  6284 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:24:51.157799  6270 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:51.168138  6270 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:51.160267 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:51.144933  6154 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.204206  6233 consensus_queue.cc:1048] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:51.216694  6142 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.229137  6218 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.229799  6218 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:51.239869  6285 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.151s	user 0.002s	sys 0.001s
I20260709 12:24:51.242424  6216 consensus_queue.cc:1059] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 12:24:51.242831 32107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:51.243824  6268 raft_consensus.cc:3055] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:51.244227  6268 raft_consensus.cc:740] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:51.245186  6268 consensus_queue.cc:260] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.241547  6218 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:51.246450  6268 raft_consensus.cc:3060] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:51.205862  6045 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:24:51.273365 31422 raft_consensus.cc:2468] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:24:51.275492 31423 raft_consensus.cc:1240] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 12:24:51.279803  6282 log.cc:927] Time spent T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.004s
I20260709 12:24:51.364573 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:51.365844 31570 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20.
W20260709 12:24:51.443465  6075 consensus_meta.cc:287] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.004s
I20260709 12:24:51.470376  6154 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:51.445495  6270 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.487834  6270 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:51.488588 32107 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:24:51.499830 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:51.500687 31568 raft_consensus.cc:2393] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 20: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:24:51.539513 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:51.540158 32112 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:51.571560 32112 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:24:51.562433 31466 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:51.577298  6045 raft_consensus.cc:2804] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:51.579413 31418 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:24:51.605954  6290 log.cc:927] Time spent T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.361s	user 0.004s	sys 0.000s
I20260709 12:24:51.608913  6142 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:51.642145 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 57547us
I20260709 12:24:51.643231  5971 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:51.761706 32108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:51.771054 32108 raft_consensus.cc:2368] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20.
I20260709 12:24:51.664202  6045 raft_consensus.cc:697] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:51.770529  5920 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.773031  5920 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.779296 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:51.779745  6045 consensus_queue.cc:237] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:51.780726  5920 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:51.783495 31537 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:51.784148 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 52836.1us
I20260709 12:24:51.792569 31499 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:51.811612 31537 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:51.817898 32080 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:51.900323 31463 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20.
I20260709 12:24:51.900731 31463 leader_election.cc:403] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.799358  5920 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:24:51.903297 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 84768us
I20260709 12:24:51.920831 32105 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:51.922000 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:51.901966  6238 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:51.905637  5920 raft_consensus.cc:493] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.911034  5958 raft_consensus.cc:3060] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:51.928332  6305 raft_consensus.cc:2804] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:51.933688  6305 raft_consensus.cc:697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:51.934932  6305 consensus_queue.cc:237] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:51.929013  6314 log.cc:927] Time spent T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:24:51.929450  6219 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:51.939771  6219 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:51.942094  6219 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:51.926939  6111 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:51.943008  6111 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:51.945345  6111 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:51.925505  5920 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:51.956010  6238 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:24:51.972666 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 66843.8us
W20260709 12:24:51.985827 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 316913us
I20260709 12:24:52.053987  6064 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
W20260709 12:24:52.054301  6318 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:24:52.066891 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 91210.5us
W20260709 12:24:52.085619 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 58802.2us
I20260709 12:24:52.086912  5971 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.101874  6323 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:24:52.103768  6330 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:24:52.085448  6266 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.111485  6266 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:52.112721  6325 log.cc:927] Time spent T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 12:24:52.056334  6238 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.109874  5920 raft_consensus.cc:515] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.117738  5971 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.134485  5971 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.114089  6266 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.097051  6064 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.140506  6064 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.161314 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.163677 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.162846 31496 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 17.
I20260709 12:24:52.149221  5920 leader_election.cc:290] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.164287 31500 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 21.
I20260709 12:24:52.172325 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:52.180064  5958 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20.
I20260709 12:24:52.187126  5920 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.187680  5920 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.189774  5920 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.190515  5920 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.193656  6328 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 12:24:52.193403  5920 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.211364 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.218118 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.218758  5920 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.213049  5958 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:52.219667  5958 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.222631 31422 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:52.235743 31466 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:52.237651  6206 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:52.238173  6206 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.238561  6206 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:52.244310  6075 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.244887  6075 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.253876  6305 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.266731  6305 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.269503  6305 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.270578 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.271255 31491 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:24:52.271400 31465 leader_election.cc:400] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Vote denied by peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217) with higher term. Message: Invalid argument: T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 for earlier term 19. Current term is 20.
I20260709 12:24:52.276109 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.279901 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:52.292575  6075 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.299465 31390 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:52.306245  6219 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:52.306658  6219 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.307056  6219 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:52.301932 31500 raft_consensus.cc:2468] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:24:52.310994  5958 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.311110 31390 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
W20260709 12:24:52.316265 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 44491.5us
I20260709 12:24:52.329046  6311 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.329674  6311 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.331990 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.332299 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda3e60a745b4a24a244329f3c923858" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:52.332558 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.332878 31496 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:52.333186 31491 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 13.
I20260709 12:24:52.336509  6206 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.343890 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.344179 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:52.344671 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.344677 31500 raft_consensus.cc:2393] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 18: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:24:52.343890 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.345520 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.331887  6311 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.347043  6266 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:52.349354  6266 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:52.350018  6266 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:52.350934 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.345005 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.347340 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.360623 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.372953 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.380498 31496 raft_consensus.cc:2468] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 21.
I20260709 12:24:52.381613 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.385183 31315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44974 (request call id 351) took 4988 ms. Trace:
I20260709 12:24:52.388582 31463 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:52.392568 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61964.8us
I20260709 12:24:52.412146  6326 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:52.398903  6111 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.394860  6218 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.428435 32106 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:24:52.428855 32106 pending_rounds.cc:85] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 14
I20260709 12:24:52.429121 32106 pending_rounds.cc:107] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:24:52.429376 32106 raft_consensus.cc:2889] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.385603 31315 rpcz_store.cc:276] 0709 12:24:47.396906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.399402 (+  2496us) service_pool.cc:224] Handling call
0709 12:24:47.734234 (+334832us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:52.385096 (+4650862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:50.783096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:50.787242 (+  4146us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:50.787303 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:24:50.787335 (+    32us) tablet.cc:662] Decoding operations
0709 12:24:50.792613 (+  5278us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:50.792727 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:50.792758 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:24:50.794057 (+  1299us) tablet.cc:701] Row locks acquired
0709 12:24:50.794103 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:24:50.794273 (+   170us) write_op.cc:270] Start()
0709 12:24:50.794437 (+   164us) write_op.cc:276] Timestamp: P: 1783599890794209 usec, L: 0
0709 12:24:50.794476 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:24:50.880470 (+ 85994us) log.cc:844] Serialized 4851 byte log entry
0709 12:24:51.380325 (+499855us) op_driver.cc:464] REPLICATION: finished
0709 12:24:51.610278 (+229953us) write_op.cc:301] APPLY: starting
0709 12:24:51.610381 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:51.634984 (+ 24603us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:51.635099 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:51.709854 (+ 74755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:51.710269 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:24:51.710341 (+    72us) write_op.cc:312] APPLY: finished
0709 12:24:51.798394 (+ 88053us) log.cc:844] Serialized 113 byte log entry
0709 12:24:51.900278 (+101884us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:51.913969 (+ 13691us) write_op.cc:454] Released schema lock
0709 12:24:51.921773 (+  7804us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:51.973259 (+ 51486us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:51.975103 (+  1844us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":306819,"reported_tablets":31,"spinlock_wait_cycles":4177152,"child_traces":[["op",{"apply.queue_time_us":223007,"apply.run_cpu_time_us":19033,"apply.run_wall_time_us":347717,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":176862,"prepare.run_cpu_time_us":55806,"prepare.run_wall_time_us":396861,"raft.queue_time_us":25812,"raft.run_cpu_time_us":8470,"raft.run_wall_time_us":157309,"replication_time_us":585654,"spinlock_wait_cycles":216320,"thread_start_us":428461,"threads_started":4,"wal-append.queue_time_us":366664}]]}
I20260709 12:24:52.412638  6206 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.430601  6111 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.432579  6218 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.435595  6111 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.419171  6154 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.436738  6218 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.437182  6154 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.439429 31570 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:52.439841  6154 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.424793  6311 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.444087  6311 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.446153  6311 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.456019  6269 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:52.474946 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:52.477993 31573 raft_consensus.cc:1275] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:24:52.478439 31573 pending_rounds.cc:85] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting all ops after (but not including) 11
I20260709 12:24:52.478775  6337 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:52.480247 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:52.473295 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:52.481441 31568 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:24:52.481670 31573 pending_rounds.cc:107] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:24:52.482100 31573 raft_consensus.cc:2889] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:52.492759 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.497753 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.502161 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:52.502942 31565 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:52.506938 31567 raft_consensus.cc:1275] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:24:52.432233  6219 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.546578 31416 raft_consensus.cc:1275] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:24:52.565546 31495 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:52.568534 31424 raft_consensus.cc:3060] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:52.591337  5920 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.592124  5920 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.559582  6311 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.596298  6311 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.604769  6349 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:52.606171  6326 consensus_queue.cc:1048] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:52.607368  6154 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.607906  6154 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.610083  6154 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.614888  6219 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.629072  6111 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.629854  6111 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.633530  6218 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:52.634130  6218 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.636376  6218 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.640594 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:52.641610 31495 raft_consensus.cc:2368] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:52.642822 31390 leader_election.cc:400] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:52.643121 31390 leader_election.cc:403] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.647071 32111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.648268 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.650254 31320 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 16 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.653074 31320 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 17 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 18 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.679802 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:52.682257 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:52.682894 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:52.684042 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.686087 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.687207 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.690313  6266 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.691124 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.693723 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:52.703246 31565 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:52.704216 31424 raft_consensus.cc:2468] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:52.598470  6311 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.717252 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.719357 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:52.710047 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 145928us
I20260709 12:24:52.722520 31491 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:52.715518 31465 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:52.594580  5920 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.738374 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.714243  5910 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.754957 31320 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.762938 31320 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.763886  6118 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303) with higher term. Message: Invalid argument: T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0065979e5b9a477f8abf064563426291 for earlier term 17. Current term is 18.
I20260709 12:24:52.772034  6111 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.773170  5910 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.775628  5910 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:52.778304 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.779340 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:52.779450 31320 catalog_manager.cc:5697] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 11 to 12, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 12 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:52.781194 31320 catalog_manager.cc:5697] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 16 to 19, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:52.784134 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.784353 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.785352 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.785787 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.786525 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.787298  6266 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:52.788669 31565 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 20. Current term is 21. Ops: []
W20260709 12:24:52.794406 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88707us
I20260709 12:24:52.755913  6206 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:52.796212 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.803663 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:52.809132  6348 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:24:52.761425  6338 consensus_queue.cc:1048] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:24:52.760941  5958 consensus_queue.cc:1048] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:24:52.846101  5910 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:52.846796  5910 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:52.834307 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.858116 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:52.865046 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.874243 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.875582 31540 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.863051  6111 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:52.878610 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.857005  5910 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:52.887256  6303 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:52.891160 31540 leader_election.cc:304] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:52.875391  6075 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:52.885083  6154 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:52.897415  6075 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:52.876835  5920 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:52.897918  6075 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:52.918726 31498 raft_consensus.cc:1240] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 20. Current term is 21. Ops: []
W20260709 12:24:52.896097  6352 log.cc:927] Time spent T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:24:52.878360  6218 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:52.925508 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:52.927129 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:52.927915 31422 raft_consensus.cc:606] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Received request to transfer leadership to TS b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:52.928339  6111 raft_consensus.cc:2804] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:52.928916  6111 raft_consensus.cc:697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:52.929847  6111 consensus_queue.cc:237] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:52.932509  6218 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:52.934618  6348 consensus_queue.cc:1059] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:24:52.938098 31422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:52.938755 31422 raft_consensus.cc:606] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:52.947116 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:52.955541  6265 raft_consensus.cc:993] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:52.956032  6265 raft_consensus.cc:1081] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:52.969738  6305 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:52.987267 31465 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:52.970613 32114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:24:53.006367 32114 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.006918 32114 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:53.011029 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:53.009984  6287 raft_consensus.cc:2804] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:24:53.015422 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 66670.3us
I20260709 12:24:53.027139 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:52.987757  6154 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:24:53.006500  6075 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.027341  6287 raft_consensus.cc:697] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:53.051515 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.053701 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:53.067149 31422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:53.098353 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:24:53.199323 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 144032us
W20260709 12:24:53.204094 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 152659us
I20260709 12:24:53.205993 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.213008  6267 raft_consensus.cc:993] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: : Instructing follower b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:53.215874  6075 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:53.204981  5920 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:53.219450  6311 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:53.056059 31417 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Rejecting Update request from peer 8553a13b444649b9a19e5488aabaf1c5 for earlier term 21. Current term is 22. Ops: []
I20260709 12:24:53.171316  6216 raft_consensus.cc:3055] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:53.190303  6287 consensus_queue.cc:237] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:53.223510 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 236419us
I20260709 12:24:53.219873 31540 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.222769  6216 raft_consensus.cc:740] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:53.227550  6216 consensus_queue.cc:260] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.228825  6216 raft_consensus.cc:3060] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:24:53.204130 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 149197us
I20260709 12:24:53.242650  6267 raft_consensus.cc:1081] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Signalling peer b6bc3d9dbfb44e81b63071002a011f71 to start an election
I20260709 12:24:53.244333 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:53.244874  6369 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:53.246825 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.248113 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.232848 32114 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.255939 32110 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
I20260709 12:24:53.257900 31540 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.259074 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.264704 31540 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.271242 32105 raft_consensus.cc:1275] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:24:53.279482 32114 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:53.277375  5920 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:53.259969  6154 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:53.257400  6366 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:53.264554  6311 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:53.283217  6366 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:53.284576  6311 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:24:53.284941  6311 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
W20260709 12:24:53.278563 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 54468.7us
I20260709 12:24:53.259963  6369 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:53.289436 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:53.285733  6311 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:53.292519 31568 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:53.305884 31540 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.326129 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.326263 31495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:53.328905 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.329910 31495 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:53.331311 31540 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.324491  6154 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:53.327873  6311 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:53.301752  6238 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:24:53.331001  6075 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:53.339813  5910 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:53.315557  6366 consensus_queue.cc:1048] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:24:53.348151  6266 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:24:53.329828  6308 consensus_queue.cc:1059] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:24:53.392400 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:53.401289 31495 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
I20260709 12:24:53.403404 32080 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:53.404830 31496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
 from {username='slave'} at 127.0.0.1:48618
I20260709 12:24:53.405454 31496 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.405812 31496 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:53.418995  6348 raft_consensus.cc:2804] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:24:53.419705  6348 raft_consensus.cc:697] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:53.420647  6348 consensus_queue.cc:237] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.410200  6269 raft_consensus.cc:493] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.424966 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:53.425561 31418 raft_consensus.cc:606] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.422541  6269 raft_consensus.cc:515] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.432840 31418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:53.433439 31418 raft_consensus.cc:606] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:53.433786 31418 raft_consensus.cc:614] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:53.435242  6371 log.cc:927] Time spent T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:24:53.447541 31417 raft_consensus.cc:3055] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:24:53.447934 31417 raft_consensus.cc:740] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:53.448907 31417 consensus_queue.cc:260] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:53.454262 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52096.1us
I20260709 12:24:53.455030  6295 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:53.455425  6295 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:53.456279  6295 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.488306  6295 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:53.499089 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.504187 31417 raft_consensus.cc:3060] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:24:53.508550 31491 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:24:53.510193  6364 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:24:53.513015  6269 leader_election.cc:290] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:53.515796 31496 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:53.524127 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:53.561940 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 43662.7us
I20260709 12:24:53.567183 31416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:53.568789 31416 raft_consensus.cc:3055] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:53.569092 31416 raft_consensus.cc:740] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:53.571180 31496 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:53.571736 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:53.570362 31416 consensus_queue.cc:260] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:53.578576 31570 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:53.578898 31416 raft_consensus.cc:3060] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:53.577847 31417 raft_consensus.cc:2468] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 19.
W20260709 12:24:53.584478 31388 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.600523 31417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c28624eba07742ab91e568bf551106a4"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:53.601204 31417 raft_consensus.cc:606] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:53.601522 31417 raft_consensus.cc:614] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:53.604158 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:53.606006 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:53.606544  6321 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:24:53.607059 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:53.612597 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 191494us
I20260709 12:24:53.615059 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cfa84e581647da8d228ad20eb18205" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:53.616840 31570 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:53.619274 31416 raft_consensus.cc:2468] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:24:53.621737 31465 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:53.622737  6336 raft_consensus.cc:2804] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:24:53.623245  6336 raft_consensus.cc:697] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:53.624107  6336 consensus_queue.cc:237] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:53.642580 32114 raft_consensus.cc:1275] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:24:53.642971 32114 pending_rounds.cc:85] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting all ops after (but not including) 15
I20260709 12:24:53.643195 32114 pending_rounds.cc:107] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:24:53.643419 32114 raft_consensus.cc:2889] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.648483 32080 leader_election.cc:304] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:53.660836  5981 raft_consensus.cc:2749] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:53.684330 31500 raft_consensus.cc:1240] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 18. Current term is 19. Ops: []
W20260709 12:24:53.701402 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 45226.1us
I20260709 12:24:53.706097  6364 consensus_queue.cc:1048] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:24:53.772100 31568 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:53.788663 31416 raft_consensus.cc:1275] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:24:53.790385  6372 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:24:53.811267  6206 consensus_queue.cc:1048] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:53.827360  6321 raft_consensus.cc:993] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:53.827966  6321 raft_consensus.cc:1081] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:53.831241 32106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:24:53.831794 32106 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.832142 32106 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:53.870358 32106 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.899758 32106 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:53.902110 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:53.903831 31491 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:53.906116 31417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:53.908694 31417 raft_consensus.cc:3055] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:53.909479 31417 raft_consensus.cc:740] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:53.926045 31417 consensus_queue.cc:260] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:53.939776 31417 raft_consensus.cc:3060] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:54.024372 31491 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:54.026705 32080 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:54.028226  6270 raft_consensus.cc:2804] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:54.028818  6270 raft_consensus.cc:697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:54.029879  6270 consensus_queue.cc:237] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:54.030936 31417 raft_consensus.cc:2468] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:24:54.101331 31491 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:54.114527  6365 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:24:54.167806 31416 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:54.173578  6372 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:54.234107 31568 raft_consensus.cc:1275] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:24:54.235857  6372 consensus_queue.cc:1048] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:54.237923 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124226us
I20260709 12:24:54.251139 31417 raft_consensus.cc:1275] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:24:54.274507 31320 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44950 (request call id 378) took 5413 ms. Trace:
I20260709 12:24:54.289004  6399 consensus_queue.cc:1048] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:54.285712 31320 rpcz_store.cc:276] 0709 12:24:48.860977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.913923 (+ 52946us) service_pool.cc:224] Handling call
0709 12:24:49.402109 (+488186us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:54.274446 (+4872337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:53.194278 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:53.203502 (+  9224us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:53.205229 (+  1727us) write_op.cc:435] Acquired schema lock
0709 12:24:53.221672 (+ 16443us) tablet.cc:662] Decoding operations
0709 12:24:53.238365 (+ 16693us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:53.238445 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:53.238469 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:53.239001 (+   532us) tablet.cc:701] Row locks acquired
0709 12:24:53.239306 (+   305us) write_op.cc:260] PREPARE: finished
0709 12:24:53.239450 (+   144us) write_op.cc:270] Start()
0709 12:24:53.239571 (+   121us) write_op.cc:276] Timestamp: P: 1783599893239402 usec, L: 0
0709 12:24:53.239592 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:53.240198 (+   606us) log.cc:844] Serialized 2471 byte log entry
0709 12:24:53.743697 (+503499us) op_driver.cc:464] REPLICATION: finished
0709 12:24:53.872396 (+128699us) write_op.cc:301] APPLY: starting
0709 12:24:53.872480 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.998581 (+126101us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:54.018589 (+ 20008us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:54.113499 (+ 94910us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:54.120163 (+  6664us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:24:54.120234 (+    71us) write_op.cc:312] APPLY: finished
0709 12:24:54.120547 (+   313us) log.cc:844] Serialized 65 byte log entry
0709 12:24:54.124027 (+  3480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.128403 (+  4376us) write_op.cc:454] Released schema lock
0709 12:24:54.129595 (+  1192us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:54.211541 (+ 81946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.223039 (+ 11498us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":334223,"reported_tablets":30,"spinlock_wait_cycles":163523456,"child_traces":[["op",{"apply.queue_time_us":128381,"apply.run_cpu_time_us":13015,"apply.run_wall_time_us":333019,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29243,"num_ops":6,"prepare.queue_time_us":297175,"prepare.run_cpu_time_us":27430,"prepare.run_wall_time_us":140919,"raft.queue_time_us":314233,"raft.run_cpu_time_us":6938,"raft.run_wall_time_us":31818,"replication_time_us":500691,"thread_start_us":469259,"threads_started":4,"wal-append.queue_time_us":151965}]]}
I20260709 12:24:54.306480 31322 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37622 (request call id 254) took 6109 ms. Trace:
I20260709 12:24:54.306949 31322 rpcz_store.cc:276] 0709 12:24:48.196478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.196629 (+   151us) service_pool.cc:224] Handling call
0709 12:24:54.306271 (+6109642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27737,"reported_tablets":24}
I20260709 12:24:54.353331 31315 catalog_manager.cc:5697] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 19 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.355620 31315 catalog_manager.cc:5697] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 17, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.400002 31315 catalog_manager.cc:5697] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 19 to 21, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 21 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.414976 31315 catalog_manager.cc:5697] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.424233 31315 catalog_manager.cc:5697] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 18, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.428486 31315 catalog_manager.cc:5697] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 20, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 20 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.430248 31315 catalog_manager.cc:5697] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 18, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 18 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.431896 31315 catalog_manager.cc:5697] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 13 to 17, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.437206 31315 catalog_manager.cc:5697] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 17 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.444895 31315 catalog_manager.cc:5697] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.446643 31315 catalog_manager.cc:5697] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.448076 31315 catalog_manager.cc:5697] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.453555 31315 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 19 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.455969 31315 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 12 to 14, e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.459349 31315 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.475448 31315 catalog_manager.cc:5697] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 21, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 21 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.477201 31315 catalog_manager.cc:5697] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 19 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.519001 31417 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:54.521275  6399 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:24:54.579290 31491 raft_consensus.cc:1275] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:24:54.581550  6399 consensus_queue.cc:1048] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:54.650213  6270 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.650818  6270 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:54.656155 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:54.656446 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:54.657112 31573 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 14.
I20260709 12:24:54.658656 32079 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:54.659649  6399 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:54.660023  6399 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.660367  6399 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:54.654544  6270 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:54.668676  6399 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:54.671670 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:54.676617 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:54.677269 31573 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:54.675311  6399 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:54.694911 31573 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:24:54.696053 32079 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:54.697660  6270 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:54.698185  6270 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:54.699079  6270 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:54.756266 31321 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 21, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 21 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.765527 31321 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.768203 31321 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 21 to 22, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 22 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.774057 31568 consensus_queue.cc:237] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:54.796082 31499 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:54.798240  6075 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:54.804625 32114 raft_consensus.cc:1275] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:24:54.814235  6396 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:54.814795  6396 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:54.817468  6396 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:54.819007 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:54.819656 31568 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 22.
I20260709 12:24:54.819805 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291" is_pre_election: true
I20260709 12:24:54.820521 31424 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 22: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:54.821853 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:54.824503  6311 consensus_queue.cc:1048] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:54.831297  6395 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:24:54.831754  6395 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:54.832114  6395 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:24:54.890339  6311 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.892195 31317 catalog_manager.cc:5697] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 18, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.893959 31317 catalog_manager.cc:5697] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 17 to 18, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } }
I20260709 12:24:54.899710 31499 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.902226  6395 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:54.910331  6395 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:54.915226 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:54.920218 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:54.920985 31424 raft_consensus.cc:2393] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 22: Already voted for candidate 0065979e5b9a477f8abf064563426291 in this term.
I20260709 12:24:54.932169 31568 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 22.
I20260709 12:24:54.935837 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:24:54.940382  6396 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:24:54.940881  6396 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:54.941798  6396 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:54.956557 31321 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44958 (request call id 372) took 3890 ms. Trace:
I20260709 12:24:54.952930 31322 catalog_manager.cc:5697] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 19 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.969010 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:54.968539 31322 catalog_manager.cc:5697] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 15 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:54.957693 31321 rpcz_store.cc:276] 0709 12:24:51.061583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.095519 (+ 33936us) service_pool.cc:224] Handling call
0709 12:24:51.711985 (+616466us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54003863d4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:24:54.951537 (+3239552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:54.834074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:54.834593 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:54.834625 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:24:54.834644 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:54.835179 (+   535us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:54.836212 (+  1033us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:54.836242 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:54.838734 (+  2492us) tablet.cc:701] Row locks acquired
0709 12:24:54.838753 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:54.838896 (+   143us) write_op.cc:270] Start()
0709 12:24:54.839008 (+   112us) write_op.cc:276] Timestamp: P: 1783599894838853 usec, L: 0
0709 12:24:54.839030 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:54.839640 (+   610us) log.cc:844] Serialized 1316 byte log entry
0709 12:24:54.842390 (+  2750us) op_driver.cc:464] REPLICATION: finished
0709 12:24:54.842844 (+   454us) write_op.cc:301] APPLY: starting
0709 12:24:54.842929 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:54.845011 (+  2082us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:54.845110 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:54.846997 (+  1887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:54.847180 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:24:54.847232 (+    52us) write_op.cc:312] APPLY: finished
0709 12:24:54.847451 (+   219us) log.cc:844] Serialized 41 byte log entry
0709 12:24:54.855667 (+  8216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.856004 (+   337us) write_op.cc:454] Released schema lock
0709 12:24:54.856046 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:54.856436 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.856471 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9831,"reported_tablets":25,"spinlock_wait_cycles":168932736,"child_traces":[["op",{"apply.queue_time_us":157,"apply.run_cpu_time_us":5339,"apply.run_wall_time_us":13536,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":1435,"prepare.run_cpu_time_us":2967,"prepare.run_wall_time_us":5864,"replication_time_us":3197,"spinlock_wait_cycles":32000}]]}
I20260709 12:24:54.989512 31306 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d54aaf3e560149eca7c259e9a3b7e37e with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:54.991218 31322 catalog_manager.cc:5697] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 16 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 17 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.984227 32114 raft_consensus.cc:2955] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:55.046171 31317 catalog_manager.cc:5697] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: config changed from index 14 to 15, VOTER 0065979e5b9a477f8abf064563426291 (127.29.143.193) evicted. New cstate: current_term: 18 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.086342 31491 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:24:55.095438 31406 tablet_service.cc:1558] Processing DeleteTablet for tablet d54aaf3e560149eca7c259e9a3b7e37e with delete_type TABLET_DATA_TOMBSTONED (TS 0065979e5b9a477f8abf064563426291 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:48288
I20260709 12:24:55.112990  6417 tablet_replica.cc:333] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:55.114394  6417 raft_consensus.cc:2243] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.126483 31491 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:55.129176  6417 raft_consensus.cc:2272] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.129860 31424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:55.130836 31424 raft_consensus.cc:606] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:55.131678  6399 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:55.136682  6417 ts_tablet_manager.cc:1916] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:55.138180  6415 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.138794  6415 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.124912 31321 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 21 to 22, leader changed from 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 22 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.141781  6415 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:55.144435 31321 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 12 to 13, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 13 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } } }
I20260709 12:24:55.145675 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:55.145744 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:55.150913 31421 raft_consensus.cc:606] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:55.152189 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:55.152776 31573 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 15.
I20260709 12:24:55.155768  6266 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.156266  6266 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.159245 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:55.163518  6266 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:55.170882 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:55.171892 31568 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 22.
I20260709 12:24:55.158866 31465 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:55.180821 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:55.183022  6220 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:24:55.183488  6220 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.183916  6220 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.208016 31499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca"
dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:39894
I20260709 12:24:55.208720 31499 raft_consensus.cc:606] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:55.234486 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:55.235108 31421 raft_consensus.cc:606] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:55.269882  6220 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.270670  6206 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:55.272076  6220 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 23 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:55.272826  6206 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:55.273382  6206 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.282311 31322 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.283039  6417 ts_tablet_manager.cc:1929] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 12:24:55.285552  6417 log.cc:1199] T d54aaf3e560149eca7c259e9a3b7e37e P 0065979e5b9a477f8abf064563426291: Deleting WAL directory at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/wals/d54aaf3e560149eca7c259e9a3b7e37e
I20260709 12:24:55.296551 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:55.297204 31421 raft_consensus.cc:606] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Received request to transfer leadership to TS e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:55.283808  6206 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.297976 31495 raft_consensus.cc:1240] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Rejecting Update request from peer e166c1cb41f04d55a85e6c0d7966e32e for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:55.300750 31496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:55.303681 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:55.304275 31573 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.314030  6365 consensus_queue.cc:1059] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:55.292359 31307 catalog_manager.cc:5028] TS 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): tablet d54aaf3e560149eca7c259e9a3b7e37e (table test-workload [id=59ab1996fef44b9ab26a01f942f775e5]) successfully deleted
I20260709 12:24:55.322283 31568 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:55.322566 31421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb"
dest_uuid: "0065979e5b9a477f8abf064563426291"
mode: GRACEFUL
new_leader_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:41104
I20260709 12:24:55.323220 31421 raft_consensus.cc:606] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Received request to transfer leadership to TS 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:55.330209 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:55.332213 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.332389  6365 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:55.333091 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.343724  6418 raft_consensus.cc:993] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.344426  6418 raft_consensus.cc:1081] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.346266 32114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:24:55.347036 32114 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.347476 32114 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.373663 32114 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.380124 31421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.380690 31421 raft_consensus.cc:3055] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:55.380975 31421 raft_consensus.cc:740] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.381656 31421 consensus_queue.cc:260] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.382755 31421 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.390061 31421 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 23.
I20260709 12:24:55.391697 32080 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:55.399976  6270 raft_consensus.cc:2804] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:55.402601  6309 raft_consensus.cc:993] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.403255  6309 raft_consensus.cc:1081] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.410706  6399 raft_consensus.cc:3055] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:55.411441 32114 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:55.412710 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:55.422647 31569 raft_consensus.cc:3060] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.422006  6399 raft_consensus.cc:740] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:55.433596 31573 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 23.
I20260709 12:24:55.439662 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:55.446615 31574 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 22. Current term is 23. Ops: []
I20260709 12:24:55.447665 31389 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:55.468339 31569 raft_consensus.cc:2468] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 23.
I20260709 12:24:55.472467 32106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:24:55.473049 32106 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.473441 32106 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:55.474927 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:24:55.471081  6270 raft_consensus.cc:697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:55.479005  6206 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Requested vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:55.462785  6418 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:24:55.477880  6270 consensus_queue.cc:237] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.498548 32106 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.519057 32106 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:55.443974  6399 consensus_queue.cc:260] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.475255  6395 consensus_queue.cc:1059] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 12:24:55.538254 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 78421.6us
I20260709 12:24:55.507467  6418 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 LEADER]: Becoming Leader. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.544567 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:55.545262 31574 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:55.559378 31574 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:55.564697 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.565442 31424 raft_consensus.cc:3055] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:24:55.565804 31424 raft_consensus.cc:740] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.566179 32079 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:24:55.582172 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 51972.5us
I20260709 12:24:55.579293 31424 consensus_queue.cc:260] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.585405  6418 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.603752 31424 raft_consensus.cc:3060] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:55.599534  6430 raft_consensus.cc:2804] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:24:55.618218  6399 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.623380 31424 raft_consensus.cc:2468] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:24:55.629303  6430 raft_consensus.cc:697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 20 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:55.630358  6430 consensus_queue.cc:237] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.633750  6206 raft_consensus.cc:3055] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:24:55.634199  6206 raft_consensus.cc:740] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:55.639897  6420 raft_consensus.cc:993] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:55.640419  6420 raft_consensus.cc:1081] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:55.643136  6206 consensus_queue.cc:260] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.644444  6206 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:24:55.656378  6433 raft_consensus.cc:993] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.656932  6433 raft_consensus.cc:1081] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.663671 31322 catalog_manager.cc:5697] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 22 to 23, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 23 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.681062 31418 raft_consensus.cc:1240] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 LEADER]: Rejecting Update request from peer b6bc3d9dbfb44e81b63071002a011f71 for earlier term 22. Current term is 23. Ops: []
I20260709 12:24:55.681612 32106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27c769ef5464411f973f730390441710"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:24:55.682125 32106 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.682494 32106 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.696012 32106 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.697714  6206 raft_consensus.cc:993] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: : Instructing follower e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.698236  6206 raft_consensus.cc:1081] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Signalling peer e166c1cb41f04d55a85e6c0d7966e32e to start an election
I20260709 12:24:55.698975 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:55.699636 31568 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.705719 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.706395 31418 raft_consensus.cc:3055] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:55.706750 31418 raft_consensus.cc:740] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.707849 32113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca"
dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
 from {username='slave'} at 127.0.0.1:55794
I20260709 12:24:55.708388 32113 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.708709 32113 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:55.707593 31418 consensus_queue.cc:260] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.714509 31418 raft_consensus.cc:3060] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.713712 31322 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 reported cstate change: term changed from 22 to 23, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 0065979e5b9a477f8abf064563426291 (127.29.143.193). New cstate: current_term: 23 leader_uuid: "0065979e5b9a477f8abf064563426291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.720119 31568 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:55.726181 32114 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:24:55.733291 31463 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:55.733932 32079 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:55.734133  6395 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:55.735381  6395 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:55.735512  6365 raft_consensus.cc:2804] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:55.736604  6365 raft_consensus.cc:697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:55.736465  6395 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:55.746124 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183272us
I20260709 12:24:55.738315  6365 consensus_queue.cc:237] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.741822 32106 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:55.738189 32113 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.755513 31418 raft_consensus.cc:2468] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
I20260709 12:24:55.757582 32113 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:55.761394 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:55.761992 31499 raft_consensus.cc:3055] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:24:55.762281 31499 raft_consensus.cc:740] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:24:55.763098 31499 consensus_queue.cc:260] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.764199 31499 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:55.771185 31424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.771776 31424 raft_consensus.cc:3060] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:24:55.769434 31322 catalog_manager.cc:5697] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 19 to 20, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 20 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.795747 31321 catalog_manager.cc:5697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 15 to 16, leader changed from e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 16 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.805791 31570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:55.806485 31570 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.806859 31570 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.828817 31499 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 21.
I20260709 12:24:55.831157 32080 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:24:55.832051  6365 raft_consensus.cc:2804] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:24:55.832567  6365 raft_consensus.cc:697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 21 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:24:55.833462  6365 consensus_queue.cc:237] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:55.832660  6418 raft_consensus.cc:993] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: : Instructing follower 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:55.835039  6431 raft_consensus.cc:1081] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Signalling peer 8553a13b444649b9a19e5488aabaf1c5 to start an election
I20260709 12:24:55.836870 31570 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.842531 31570 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:55.835032 31322 catalog_manager.cc:5697] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.846490 31424 raft_consensus.cc:2468] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 21.
I20260709 12:24:55.851274 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.851862 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:55.861672 31568 raft_consensus.cc:1240] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:55.861877 31499 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.861673 31418 raft_consensus.cc:3055] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:55.863090 31418 raft_consensus.cc:740] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.863655 31418 consensus_queue.cc:260] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.852903 31573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05"
dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
 from {username='slave'} at 127.0.0.1:48852
I20260709 12:24:55.864493 31573 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.864733 31573 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:24:55.870817  6431 consensus_queue.cc:1175] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8553a13b444649b9a19e5488aabaf1c5" responder_term: 16 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0065979e5b9a477f8abf064563426291 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:55.871594 31573 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.872423 31499 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:55.872428 31418 raft_consensus.cc:3060] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:55.874998 31540 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:24:55.875892  6438 raft_consensus.cc:2804] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:24:55.876420  6438 raft_consensus.cc:697] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:55.877430  6438 consensus_queue.cc:237] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.885828 31418 raft_consensus.cc:2468] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:24:55.888581 31573 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:55.889151 31418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0065979e5b9a477f8abf064563426291"
I20260709 12:24:55.889747 31418 raft_consensus.cc:3055] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:24:55.890070 31418 raft_consensus.cc:740] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0065979e5b9a477f8abf064563426291, State: Running, Role: LEADER
I20260709 12:24:55.901319 31322 catalog_manager.cc:5697] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 20 to 21, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 21 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.906275 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:55.906898 31499 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:55.909719 31418 consensus_queue.cc:260] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.911055 31418 raft_consensus.cc:3060] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:55.930621 31418 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:55.931874 31540 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: 
I20260709 12:24:55.933260  6075 raft_consensus.cc:2804] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:55.934026  6075 raft_consensus.cc:697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:24:55.935088  6075 consensus_queue.cc:237] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:55.943979 31499 raft_consensus.cc:2468] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:24:55.949656 31322 catalog_manager.cc:5697] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 16 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.978716 31322 catalog_manager.cc:5697] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 16 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 17 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.017905 31499 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:24:56.018577 31499 pending_rounds.cc:85] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting all ops after (but not including) 12
I20260709 12:24:56.018959 31499 pending_rounds.cc:107] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:24:56.019238 31499 raft_consensus.cc:2889] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.021728  6431 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:56.052667 31418 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:56.054409  6365 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:24:56.134264 31570 raft_consensus.cc:1275] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:24:56.136420  6424 consensus_queue.cc:1048] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:56.152891 31568 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Refusing update from remote peer 0065979e5b9a477f8abf064563426291: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:24:56.152921 31570 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:56.157727  6425 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:56.157897  6433 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:56.161010 31570 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:24:56.184352  6365 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.121s
I20260709 12:24:56.325831 31418 raft_consensus.cc:1275] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:24:56.358632  6454 consensus_queue.cc:1048] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:24:56.450714 31569 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:56.463950 31491 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:56.476945 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:56.494822 32113 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:56.497327 31418 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:24:56.500041 31569 raft_consensus.cc:1275] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:24:56.509253 31418 raft_consensus.cc:1275] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:24:56.515983 31418 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:24:56.610870 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 59271.9us
W20260709 12:24:56.623390 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75947.4us
I20260709 12:24:56.541237  6454 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
W20260709 12:24:56.625422 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 48239.5us
W20260709 12:24:56.626780 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 49908.3us
W20260709 12:24:56.648293 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59902.5us
I20260709 12:24:56.654227 31491 raft_consensus.cc:1275] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:24:56.537868  6469 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:24:56.656318  6311 consensus_queue.cc:1048] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:56.658284  6452 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:56.670897 31418 raft_consensus.cc:1275] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 12:24:56.752547 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 64855.8us
I20260709 12:24:56.761003 31491 raft_consensus.cc:1275] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:24:56.761052 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 87984.3us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
W20260709 12:24:57.035692 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 269478us
I20260709 12:24:56.764649  6466 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.262s
I20260709 12:24:56.776850  6430 consensus_queue.cc:1048] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.237s
W20260709 12:24:57.067950 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 272560us
W20260709 12:24:57.115618 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 296804us
W20260709 12:24:57.137413 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 341266us
I20260709 12:24:57.035647  6454 consensus_queue.cc:1048] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.096s
I20260709 12:24:57.146170 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
W20260709 12:24:57.231029 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 110185us
I20260709 12:24:57.153458  6369 consensus_queue.cc:1048] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
W20260709 12:24:57.246120 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 83417.9us
W20260709 12:24:57.262419 31390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.019s	sys 0.019s
W20260709 12:24:57.263155 31390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.020s	sys 0.020s
W20260709 12:24:57.263456 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 614223us
W20260709 12:24:57.315735  6489 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:24:57.323208  6484 log.cc:927] Time spent T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 12:24:57.344594 31387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 178478us
I20260709 12:24:57.300418  6486 raft_consensus.cc:493] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:57.347326 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 111787us
W20260709 12:24:57.352700 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 189068us
I20260709 12:24:57.278414  6482 consensus_queue.cc:1048] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:24:57.388724  6514 raft_consensus.cc:493] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:57.389360  6514 raft_consensus.cc:515] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.393559  6514 leader_election.cc:290] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:57.395078  6495 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:57.398855 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.400023 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97965a28958a4537ae9f58c98ca87319" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:57.408071 31540 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:24:57.396463  6486 raft_consensus.cc:515] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.415966  6482 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.416389  6498 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:57.520809 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 159592us
W20260709 12:24:57.530911 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 115726us
I20260709 12:24:57.532083  6435 raft_consensus.cc:493] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.522301  6507 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.523062  6465 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:57.547600 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 139549us
I20260709 12:24:57.565985  6483 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:57.576691 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 62243.6us
I20260709 12:24:57.531392  6482 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.568527  6492 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:57.538004  6435 raft_consensus.cc:515] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:57.537760  6498 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:57.626427 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 96334.9us
I20260709 12:24:57.543984  6465 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:57.566596  6483 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:57.554873  6507 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:57.626250 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.629072 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64028.4us
I20260709 12:24:57.588362  6521 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.597288  6518 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.628211  6488 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:57.629871  6520 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:24:57.653088 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.642084  6516 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.643780  6494 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:57.625336  6492 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.659231  6470 raft_consensus.cc:493] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:57.653445 31389 leader_election.cc:304] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:57.689684  6508 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.690495  6508 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:57.693570  6508 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.695786  6482 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.697880  6498 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.671851  6494 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.699419  6483 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:57.705718  6507 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.639489  6521 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.709672  6531 raft_consensus.cc:2749] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.711020  6435 leader_election.cc:290] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.651777  6488 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.660235  6518 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.684811  6534 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:57.745936 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 92564.5us
I20260709 12:24:57.664960  6520 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.735316  6510 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.678761  6486 leader_election.cc:290] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.756520 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.670665  6516 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.759678 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.761945 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.763067 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.764590 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.735473  6470 raft_consensus.cc:515] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:24:57.772105  6528 log.cc:927] Time spent T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:57.757725  6510 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:57.774525  6510 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.775321  6537 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:57.775869  6537 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.778232  6537 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.781805  6520 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.788779  6518 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.759706  6486 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:57.797798  6488 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.800240  6492 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.800856  6494 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.801616  6465 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.804958  6521 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.821152 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.826084 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a95aee9cae4e239fa037efead078d5" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:57.835039 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 197410us
I20260709 12:24:57.835465  6476 raft_consensus.cc:493] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:57.828390  6311 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:57.838126  6311 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:57.844177 31465 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 75913.1us
I20260709 12:24:57.845613 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.847529 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.851718  6311 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:57.827270  6486 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.857053  6486 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.858961  6481 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.859459  6470 leader_election.cc:290] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.862624 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:57.863011  6544 raft_consensus.cc:493] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:57.864900 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:57.870994 31574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:57.876861 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.863528  6544 raft_consensus.cc:515] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.881186  6544 leader_election.cc:290] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.882974 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:57.883697  6533 log.cc:927] Time spent T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:24:57.884464 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca4f4ed71aa4cfd84010eb5f7ee80ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:57.887115 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.889667 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e08d75cdb9c24b78bf644d1554c2c5fe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.756891  6534 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.836197  6476 raft_consensus.cc:515] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.859596  6481 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.877202 31572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:57.891901 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.892508 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.893923  6534 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:57.897703 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.905977  6476 leader_election.cc:290] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:57.908007 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.912109 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:57.914201 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 250538us
W20260709 12:24:57.911506 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.916646  6481 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:57.918077 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:57.926824 31466 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:57.937116  6453 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:57.937716  6453 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:57.939802  6453 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:24:57.941453 31466 leader_election.cc:336] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:57.942199 31466 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:57.942873 31466 leader_election.cc:336] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:57.943527 31466 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:57.944432 31466 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:57.945024 31466 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:57.945672 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:57.946246 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:57.946661  6516 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:57.950322 31466 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:57.950855 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:57.951244 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:57.955279 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:57.957003 31466 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:57.959574 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.002208  6476 raft_consensus.cc:493] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.002831  6476 raft_consensus.cc:515] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.003340 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.004961  6476 leader_election.cc:290] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.005625  6425 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:58.013598 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.014564 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.022761  6532 raft_consensus.cc:493] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.023399  6532 raft_consensus.cc:515] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.024441  6482 raft_consensus.cc:493] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.025072  6482 raft_consensus.cc:515] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.027583  6532 leader_election.cc:290] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.027788 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77a183300084f968171dcd68225d026" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.030308 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:57.963171  6466 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:24:58.031646  6466 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.034135  6466 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.006162  6425 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.036139  6425 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.036198  6482 leader_election.cc:290] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.038662 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.070415 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.071414  6415 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:58.074178 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.076191  6418 raft_consensus.cc:493] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.076463 31465 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.076722  6418 raft_consensus.cc:515] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.077590 31465 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.082484 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.083225 31465 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.079360  6482 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:58.095201 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 68084.4us
I20260709 12:24:58.080559  6418 leader_election.cc:290] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.082540  6415 raft_consensus.cc:2749] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:58.097345 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.094547  6537 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:24:58.110745 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d2c7602ed046c6afb92739319e584c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.110772 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d7370a77bc48eaaa344ded5091445b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.115120 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e4a1fb5dbb4dca99dc9fbc2881de05" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.118443 31463 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.122452 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d385c04853e749af8fb00afe40a4a255" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.124439 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.124567 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91ffe6e1ad36492d95a9cf3251d2894c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.124863 31389 leader_election.cc:304] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.125581 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.127453  6520 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.127942 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.128151  6520 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:24:58.129993 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.132917 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.131592 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.146028 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.149092 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:58.138770 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.157783 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.158921  6458 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.140079  6418 raft_consensus.cc:493] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.146850  6504 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.159956  6418 raft_consensus.cc:515] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.162016  6418 leader_election.cc:290] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.164983 31389 leader_election.cc:304] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.139628  6482 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:58.171362  6418 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.141706  6435 raft_consensus.cc:493] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.172887 31390 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.174204 31389 leader_election.cc:304] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.176391 31389 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:58.158342 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.163309  6476 raft_consensus.cc:2749] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:24:58.180243 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.190402 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.179363 31389 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.179775 31390 leader_election.cc:304] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.180411  6429 raft_consensus.cc:2749] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:58.180810  6490 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.180862  6514 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:58.186669 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 95742.3us
I20260709 12:24:58.172251  6435 raft_consensus.cc:515] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.188486  6492 raft_consensus.cc:493] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.197805 31390 leader_election.cc:304] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.172233  6418 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:24:58.235409 31389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 56118.1us
I20260709 12:24:58.238760 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54aaf3e560149eca7c259e9a3b7e37e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.241092  6486 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.241494  6544 raft_consensus.cc:2749] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.241659  6486 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.243810 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb15d4732f1472ea96078ec58ddade4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.243855  6486 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.245982  6492 raft_consensus.cc:515] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.245342 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.218770  6431 raft_consensus.cc:2749] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.249338 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:58.245165 31390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47413.2us
I20260709 12:24:58.251184  6435 leader_election.cc:290] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.253476 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.258602 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb26db0e5b834d508281418291d5c108" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.260196  6496 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:58.261070  6492 leader_election.cc:290] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.247515  6418 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.237623 32079 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.261487 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.246990  6464 raft_consensus.cc:2749] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.269670 31567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.270172 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.270342 31567 raft_consensus.cc:2468] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0065979e5b9a477f8abf064563426291 in term 19.
W20260709 12:24:58.263331 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.270896 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c769ef5464411f973f730390441710" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.262193  6418 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.276213 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28624eba07742ab91e568bf551106a4" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.198158  6550 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:58.273054 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.273113  6496 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.276594  6438 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.280418  6418 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.277349 31390 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:58.282478 31540 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.264268  6425 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.287824 31537 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.272053  6470 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.289252 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.295400 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.297087  6497 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:24:58.298578 31540 leader_election.cc:336] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.298239  6470 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.288753  6496 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.322312 31463 leader_election.cc:304] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.300871 31540 leader_election.cc:304] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
W20260709 12:24:58.327797 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.328258 31540 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.328650 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:58.329416 31540 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.267767  6490 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.329775 31540 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.288544  6464 raft_consensus.cc:493] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.290845  6435 raft_consensus.cc:493] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.339493  6435 raft_consensus.cc:515] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.340358  6490 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.342073  6435 leader_election.cc:290] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.335227 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aa949305b1a42489bcc1e0b4287c6c3" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.342761  6418 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.295068  6431 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.344455  6431 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.295455  6471 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.348140  6431 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.351691  6512 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.335757  6338 raft_consensus.cc:2749] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.354419  6496 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.332739  6476 raft_consensus.cc:493] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.355300  6476 raft_consensus.cc:515] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.355808  6464 raft_consensus.cc:515] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.356178 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.357261  6476 leader_election.cc:290] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.357821  6454 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.358830 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.330528  6469 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.335615  6514 raft_consensus.cc:493] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.360229  6464 leader_election.cc:290] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.360200  6514 raft_consensus.cc:515] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.362310  6514 leader_election.cc:290] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.321647  6493 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.332975  6497 raft_consensus.cc:2749] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:24:58.301849  6550 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:58.370970 32080 leader_election.cc:304] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.372189 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.372416 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.303752  6429 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.374778 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.375048 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.375507 31389 leader_election.cc:304] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.379077 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.383212 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.383384 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e61fb74a676405696e2d0e6b9027efe" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.290349  6438 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.384814 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1af086d1060473f980f0bed9af34c07" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.378954  6531 raft_consensus.cc:493] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.382906 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd7b78d2ef1488c970505878e67c6ca" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.388020 31389 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.389725 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:58.384466 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.394918 31389 leader_election.cc:304] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.396315 31387 leader_election.cc:304] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.397231 31389 leader_election.cc:304] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.401151 31390 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.386760  6531 raft_consensus.cc:515] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.406648 31387 leader_election.cc:304] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.391363  6478 raft_consensus.cc:2749] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.409659 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.393694  6463 raft_consensus.cc:2749] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.400815  6544 raft_consensus.cc:2804] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:24:58.413465 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a899a61b216247dbbb91edb923e9eddf" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.414065 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f5f1e9d2894583bcc9bc45a5df0112" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.406000  6476 raft_consensus.cc:2749] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.390621  6429 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.408196  6433 raft_consensus.cc:2749] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:58.407552  6465 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:58.419868 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60738423610d43149226454d80d6b245" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.408290  6486 raft_consensus.cc:2749] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.432163 31389 leader_election.cc:304] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.414966  6550 raft_consensus.cc:2749] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:24:58.416774  6544 raft_consensus.cc:493] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:24:58.434234 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.436738 31389 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
W20260709 12:24:58.437402 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.438019 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.438550 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.438702  6433 raft_consensus.cc:2749] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.440099  6476 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.438189  6544 raft_consensus.cc:3060] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:24:58.445950 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.447258  6429 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.444454  6433 raft_consensus.cc:493] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.454592  6433 raft_consensus.cc:515] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.469185  6438 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:24:58.491344 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.476579  6531 leader_election.cc:290] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.564060  6433 leader_election.cc:290] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.565306 31389 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.566509  6544 raft_consensus.cc:515] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.567143 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.569123 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.569702  6433 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:24:58.585472  6544 leader_election.cc:290] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.566509 31389 leader_election.cc:304] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.600003  6544 raft_consensus.cc:2749] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.602716 31570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:24:58.658504  6544 raft_consensus.cc:493] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e166c1cb41f04d55a85e6c0d7966e32e)
I20260709 12:24:58.663630  6433 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.663897  6544 raft_consensus.cc:515] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.664208  6433 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.666062  6433 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.666205  6531 raft_consensus.cc:493] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8553a13b444649b9a19e5488aabaf1c5)
I20260709 12:24:58.666721  6531 raft_consensus.cc:515] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:24:58.669492  6531 leader_election.cc:290] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.666062  6544 leader_election.cc:290] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:24:58.672192 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.673417 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.677222 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:24:58.689483 31540 leader_election.cc:336] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.690831 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650d5583d6f49e2aba22f8d696283ea" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.690074 31540 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.697733  6494 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.705251 31387 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.706009  6544 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.706435 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfceb446d3434b4b8dad1af98ef2db39" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.707945 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19ad016bcdfe4c62a610fe4974bc52c2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.709308 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341ae51396d44edeba0872b9567766e7" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:24:58.709645 31540 leader_election.cc:336] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.710067 31540 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.710265  6531 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:24:58.710819  6494 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.712810 31387 leader_election.cc:304] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.710786  6531 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:24:58.716521 31387 leader_election.cc:304] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.718462  6486 raft_consensus.cc:2749] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.717200  6433 raft_consensus.cc:2749] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.719341 31387 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.720342  6433 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.720902  6531 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:24:58.740273 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:24:58.748299  6470 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:24:58.749188 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.749599 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 310166us
W20260709 12:24:58.750276 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.750916 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.751513 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.752089 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.752632 32080 leader_election.cc:336] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.753062 32080 leader_election.cc:304] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.753455 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.755004 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c09d681ba8545a397b540c3565c50ff" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:24:58.754344 31499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f615aa4788f84d6fa066cd71bbdaeadb" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.755846 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81365ffbeca2466590e0e6d5e449c28b" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:24:58.756451 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dad6aaa667ee45cb985fe02da47448e3" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:24:58.756498 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.758551 32080 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.758962 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.759438 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c7d950f0b944939a3a24f8336687e2" candidate_uuid: "0065979e5b9a477f8abf064563426291" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:24:58.764792 31387 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:24:58.766160 31390 leader_election.cc:304] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.770349  6486 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.765424  6499 raft_consensus.cc:2749] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:24:58.771394 31390 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.771736  6515 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:24:58.771360 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:58.780445 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:58.771883  6544 raft_consensus.cc:2749] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:24:58.780895 32080 leader_election.cc:336] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.780848 31390 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.784122 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.792972 31390 leader_election.cc:304] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0065979e5b9a477f8abf064563426291; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:24:58.781409  6433 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.794881  6544 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:58.798601  6486 raft_consensus.cc:2749] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:24:58.800680 32080 leader_election.cc:336] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:58.801120 32080 leader_election.cc:304] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:24:58.804592  6454 raft_consensus.cc:2749] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:58.804075  6499 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:24:58.908231 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55295.5us
I20260709 12:24:59.048683 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:59.051244 30271 tablet_replica.cc:333] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.052876 30271 raft_consensus.cc:2243] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.055264 30271 raft_consensus.cc:2272] T ac6ba1e461fb4563910a86b4223e918c P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.058197 30271 tablet_replica.cc:333] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.059602 30271 raft_consensus.cc:2243] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.060209 30271 raft_consensus.cc:2272] T 81365ffbeca2466590e0e6d5e449c28b P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.064320 30271 tablet_replica.cc:333] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.065271 30271 raft_consensus.cc:2243] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.065827 30271 raft_consensus.cc:2272] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.068709 30271 tablet_replica.cc:333] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.069564 30271 raft_consensus.cc:2243] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.070643 30271 raft_consensus.cc:2272] T 519f567f2eff4e55b84df6d3edde6bc2 P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.073312 30271 tablet_replica.cc:333] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.074144 30271 raft_consensus.cc:2243] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.075297 30271 raft_consensus.cc:2272] T 92b3a623c9be4f43853d9eeb42b92968 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.080224 30271 tablet_replica.cc:333] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.081105 30271 raft_consensus.cc:2243] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.081746 30271 raft_consensus.cc:2272] T e77a183300084f968171dcd68225d026 P 0065979e5b9a477f8abf064563426291 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.084525 30271 tablet_replica.cc:333] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.085354 30271 raft_consensus.cc:2243] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.086535 30271 raft_consensus.cc:2272] T d4592ece2c344a3a8564f95da501ac46 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.089977 30271 tablet_replica.cc:333] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.090953 30271 raft_consensus.cc:2243] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.091552 30271 raft_consensus.cc:2272] T bfceb446d3434b4b8dad1af98ef2db39 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.094511 30271 tablet_replica.cc:333] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.095400 30271 raft_consensus.cc:2243] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.095978 30271 raft_consensus.cc:2272] T 84c7d950f0b944939a3a24f8336687e2 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.098942 30271 tablet_replica.cc:333] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.099776 30271 raft_consensus.cc:2243] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.100953 30271 raft_consensus.cc:2272] T 8b893ed7439d49939f7332cad4722c09 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.110509 30271 tablet_replica.cc:333] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.111308 30271 raft_consensus.cc:2243] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.120642 30271 raft_consensus.cc:2272] T 0650d5583d6f49e2aba22f8d696283ea P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.123168 30271 tablet_replica.cc:333] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.140383 30271 raft_consensus.cc:2243] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.140997 30271 raft_consensus.cc:2272] T 46d2c7602ed046c6afb92739319e584c P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.144273 30271 tablet_replica.cc:333] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.145062 30271 raft_consensus.cc:2243] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.145555 30271 raft_consensus.cc:2272] T 91ffe6e1ad36492d95a9cf3251d2894c P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.148089 30271 tablet_replica.cc:333] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.148805 30271 raft_consensus.cc:2243] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.149323 30271 raft_consensus.cc:2272] T cbb15d4732f1472ea96078ec58ddade4 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.157817 30271 tablet_replica.cc:333] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.158692 30271 raft_consensus.cc:2243] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.159291 30271 raft_consensus.cc:2272] T bb26db0e5b834d508281418291d5c108 P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.178578 30271 tablet_replica.cc:333] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.179487 30271 raft_consensus.cc:2243] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.180150 30271 raft_consensus.cc:2272] T 5c09d681ba8545a397b540c3565c50ff P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.207180 30271 tablet_replica.cc:333] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.208057 30271 raft_consensus.cc:2243] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.208694 30271 raft_consensus.cc:2272] T 97965a28958a4537ae9f58c98ca87319 P 0065979e5b9a477f8abf064563426291 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.236739 30271 tablet_replica.cc:333] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.237732 30271 raft_consensus.cc:2243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.238838 30271 raft_consensus.cc:2272] T 36ab0d648ab643bf8d74dbe6ee9503d8 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.241688 30271 tablet_replica.cc:333] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.242470 30271 raft_consensus.cc:2243] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.269593 30271 raft_consensus.cc:2272] T e08d75cdb9c24b78bf644d1554c2c5fe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.272305 30271 tablet_replica.cc:333] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.273077 30271 raft_consensus.cc:2243] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.273644 30271 raft_consensus.cc:2272] T 60738423610d43149226454d80d6b245 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.323032 30271 tablet_replica.cc:333] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.323897 30271 raft_consensus.cc:2243] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.324633 30271 raft_consensus.cc:2272] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.345363 30271 tablet_replica.cc:333] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.354298 30271 raft_consensus.cc:2243] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.355486 30271 raft_consensus.cc:2272] T 46eaf930cd8a4253b8c4ad7982a44485 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.383569 30271 tablet_replica.cc:333] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.384526 30271 raft_consensus.cc:2243] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.385068 30271 raft_consensus.cc:2272] T 41d7370a77bc48eaaa344ded5091445b P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.414122 30271 tablet_replica.cc:333] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.414978 30271 raft_consensus.cc:2243] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.422864 30271 raft_consensus.cc:2272] T 341ae51396d44edeba0872b9567766e7 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.430727 30271 tablet_replica.cc:333] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.431639 30271 raft_consensus.cc:2243] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.432229 30271 raft_consensus.cc:2272] T 12a5ef370bb94f5abfccedf7e771d83c P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.443795 30271 tablet_replica.cc:333] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.444767 30271 raft_consensus.cc:2243] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.446000 30271 raft_consensus.cc:2272] T f97e5105626c48be9d1768855511628a P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.450558 30271 tablet_replica.cc:333] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.451399 30271 raft_consensus.cc:2243] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.452498 30271 raft_consensus.cc:2272] T 987c407200734c78918f4e63b9c8f16f P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.457703 30271 tablet_replica.cc:333] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.458499 30271 raft_consensus.cc:2243] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.459619 30271 raft_consensus.cc:2272] T 6c70f01b47774cc48e80fabd1ef37f2e P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.462610 30271 tablet_replica.cc:333] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.463384 30271 raft_consensus.cc:2243] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.463898 30271 raft_consensus.cc:2272] T a1af086d1060473f980f0bed9af34c07 P 0065979e5b9a477f8abf064563426291 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.466585 30271 tablet_replica.cc:333] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.467410 30271 raft_consensus.cc:2243] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.468485 30271 raft_consensus.cc:2272] T 08259dcf521e4914917a72febcb040d1 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.471606 30271 tablet_replica.cc:333] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.472689 30271 raft_consensus.cc:2243] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.473572 30271 raft_consensus.cc:2272] T 7e61fb74a676405696e2d0e6b9027efe P 0065979e5b9a477f8abf064563426291 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.476274 30271 tablet_replica.cc:333] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.476989 30271 raft_consensus.cc:2243] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.477547 30271 raft_consensus.cc:2272] T 79f5f1e9d2894583bcc9bc45a5df0112 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.481316 30271 tablet_replica.cc:333] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.482113 30271 raft_consensus.cc:2243] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.482581 30271 pending_rounds.cc:70] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Trying to abort 1 pending ops.
I20260709 12:24:59.482844 30271 pending_rounds.cc:77] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291: Aborting op as it isn't in flight: id { term: 16 index: 10 } timestamp: 7305625173538017280 op_type: NO_OP noop_request { }
I20260709 12:24:59.483179 30271 raft_consensus.cc:2889] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:59.483501 30271 raft_consensus.cc:2272] T f615aa4788f84d6fa066cd71bbdaeadb P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.486785 30271 tablet_replica.cc:333] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.487972 30271 raft_consensus.cc:2243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.488521 30271 raft_consensus.cc:2272] T 19ad016bcdfe4c62a610fe4974bc52c2 P 0065979e5b9a477f8abf064563426291 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.491816 30271 tablet_replica.cc:333] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.495443 30271 raft_consensus.cc:2243] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.496385 30271 raft_consensus.cc:2272] T dad6aaa667ee45cb985fe02da47448e3 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.499272 30271 tablet_replica.cc:333] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.500025 30271 raft_consensus.cc:2243] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.500684 30271 pending_rounds.cc:70] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Trying to abort 1 pending ops.
I20260709 12:24:59.500933 30271 pending_rounds.cc:77] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305625173346668544 op_type: NO_OP noop_request { }
I20260709 12:24:59.501277 30271 raft_consensus.cc:2889] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:59.501720 30271 raft_consensus.cc:2272] T 9dd7b78d2ef1488c970505878e67c6ca P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.504657 30271 tablet_replica.cc:333] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.505357 30271 raft_consensus.cc:2243] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.507859 30271 raft_consensus.cc:2272] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 0065979e5b9a477f8abf064563426291 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.510603 30271 tablet_replica.cc:333] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.511456 30271 raft_consensus.cc:2243] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.512506 30271 raft_consensus.cc:2272] T 825684763f5c4e2dbf3597dc5a24f7df P 0065979e5b9a477f8abf064563426291 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.515642 30271 tablet_replica.cc:333] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.516366 30271 raft_consensus.cc:2243] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.516923 30271 raft_consensus.cc:2272] T c28624eba07742ab91e568bf551106a4 P 0065979e5b9a477f8abf064563426291 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.519296 30271 tablet_replica.cc:333] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.520059 30271 raft_consensus.cc:2243] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.521093 30271 raft_consensus.cc:2272] T b8f83500bdaf49a8ac53bb5ba49c3529 P 0065979e5b9a477f8abf064563426291 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.523981 30271 tablet_replica.cc:333] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.524735 30271 raft_consensus.cc:2243] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:24:59.525867 30271 raft_consensus.cc:2272] T ab86e60df2854213b3c95a365e5f4807 P 0065979e5b9a477f8abf064563426291 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.528510 30271 tablet_replica.cc:333] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.529172 30271 raft_consensus.cc:2243] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.529601 30271 pending_rounds.cc:70] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Trying to abort 1 pending ops.
I20260709 12:24:59.529829 30271 pending_rounds.cc:77] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305625172994973696 op_type: NO_OP noop_request { }
I20260709 12:24:59.530165 30271 raft_consensus.cc:2889] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:24:59.530478 30271 raft_consensus.cc:2272] T 27c769ef5464411f973f730390441710 P 0065979e5b9a477f8abf064563426291 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.533034 30271 tablet_replica.cc:333] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.534054 30271 raft_consensus.cc:2243] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.534737 30271 raft_consensus.cc:2272] T e0a95aee9cae4e239fa037efead078d5 P 0065979e5b9a477f8abf064563426291 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:59.537232 30271 tablet_replica.cc:333] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291: stopping tablet replica
I20260709 12:24:59.538089 30271 raft_consensus.cc:2243] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:59.538743 30271 raft_consensus.cc:2272] T a899a61b216247dbbb91edb923e9eddf P 0065979e5b9a477f8abf064563426291 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:59.858441 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.904551 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.971140 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.990960 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:00.062192 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:00.153484 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.209460  6548 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.210005  6548 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.212934  6548 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.215091 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:25:00.225401 32080 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.225977 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:00.227936  6548 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:00.241520  6430 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.242105  6430 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.244292  6430 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:00.250133 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.256219  6480 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.256441 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.256776  6480 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.259841 31569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:00.262176  6480 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:25:00.268715 31466 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.269246 31466 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:25:00.271776  6537 raft_consensus.cc:2749] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:25:00.286501 32080 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.287165 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:00.288195  6548 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:00.302232  6537 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.302836  6537 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.304512  6480 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.305095  6480 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.307384  6480 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.307917  6548 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.308465  6548 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.310590  6548 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.315877  6537 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:25:00.343564 31466 leader_election.cc:336] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.344269 31466 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.373865 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.377991  6563 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.378757  6563 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.381862  6563 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.399730 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
W20260709 12:25:00.402647 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:00.403247 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.429467  6564 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.430107  6564 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.432191  6564 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.442984 32112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:00.444591 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:00.445230 32105 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 22.
W20260709 12:25:00.446477 31466 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.441051  6537 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.449083  6537 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.452463  6537 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.439252  6563 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.462369  6563 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.464051 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:00.464763 32105 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:25:00.465664 32106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:00.477150 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:00.477901 32110 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
W20260709 12:25:00.477336 31466 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.478804  6563 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:00.480168 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:25:00.482309 31466 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.487883 31463 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:00.489158  6537 raft_consensus.cc:2749] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:00.490422 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:00.491690  6537 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:00.492079  6537 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.492595  6537 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:00.503011  6548 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.503579  6548 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.507143 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:00.509047  6548 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:00.509865  6548 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.511461  6548 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.512882  6548 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.549439 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:00.561805  6490 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.563030  6494 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.516353  6537 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.564049  6494 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.579183  6565 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:00.583420  6565 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.583940  6565 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:00.566660  6537 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.603065  6494 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.591290  6490 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.613278  6490 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:00.627151 31466 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.627942 31466 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:25:00.630785 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.635708 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.637042 31497 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 21.
I20260709 12:25:00.640193 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.641409 31498 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 23.
W20260709 12:25:00.651543 31463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 102690us
W20260709 12:25:00.657083 32080 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.657860 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:00.658986  6573 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.660233  6573 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.663558  6564 raft_consensus.cc:2749] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:00.663697  6565 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.668020  6573 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:00.670317 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:00.690518  6573 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:00.698132 31540 leader_election.cc:336] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.699156 31540 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.699199  6490 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.700291  6490 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.703465  6490 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.704779 31463 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:00.705636  6490 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.711275  6490 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.714702 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:25:00.718282 30271 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31445)
I20260709 12:25:00.719475 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.720533 31498 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:25:00.720945  6490 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.723268  6494 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:00.723853  6494 raft_consensus.cc:493] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.724385  6494 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:00.705394 31466 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.732800 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:00.733280 31466 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.733744 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.734287 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:00.736972  6568 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:25:00.737533  6568 raft_consensus.cc:493] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.737979  6568 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:00.735000  6480 raft_consensus.cc:2749] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:00.753686  6494 raft_consensus.cc:515] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.757850 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:00.755688  6480 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.758831  6480 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.761466  6571 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:00.761912  6571 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.762257  6571 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:00.762940  6568 raft_consensus.cc:515] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.765209  6568 leader_election.cc:290] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.766889  6573 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.767799  6573 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.770005  6573 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.741883  6565 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.765437  6480 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:00.779058  6494 leader_election.cc:290] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.779337 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519f567f2eff4e55b84df6d3edde6bc2" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:00.781253 32110 raft_consensus.cc:3060] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:00.790279 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ab0d648ab643bf8d74dbe6ee9503d8" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:00.791370 32113 raft_consensus.cc:3060] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:00.792572 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.785792  6571 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.794840  6568 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.795534  6568 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.797765  6568 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.801481  6571 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.804049 32113 raft_consensus.cc:2468] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 19.
I20260709 12:25:00.806915  6480 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.809193 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b893ed7439d49939f7332cad4722c09" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:00.814095 32109 raft_consensus.cc:3060] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:00.814812 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77595.8us
I20260709 12:25:00.815600  6490 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.816320  6490 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.818338  6490 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.819847 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.820492 31498 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:25:00.821612 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.821794 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b3a623c9be4f43853d9eeb42b92968" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:00.822343 31500 raft_consensus.cc:3060] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:00.822829 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ba1e461fb4563910a86b4223e918c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:00.823427 31491 raft_consensus.cc:3060] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:00.826850  6568 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.827536  6568 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.829919  6568 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.831884 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:00.832484 31573 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 16.
I20260709 12:25:00.833863 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:00.834554 31498 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:25:00.834703  6490 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.836531  6490 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.839725 31491 raft_consensus.cc:2468] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 24.
W20260709 12:25:00.840296 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:00.810966 31466 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.847440  6480 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.850615 31497 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 22.
I20260709 12:25:00.849493 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:00.852344 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:00.852547  6574 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:00.853021  6574 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.853826  6574 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:00.848896  6490 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.862776  6480 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:00.864909  6568 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:00.865394  6568 raft_consensus.cc:493] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.865787  6568 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:00.866641 31466 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.875033 31540 leader_election.cc:304] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:00.876025  6569 raft_consensus.cc:2804] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:25:00.876597  6569 raft_consensus.cc:697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 24 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:00.874574  6568 raft_consensus.cc:515] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.877756  6569 consensus_queue.cc:237] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:25:00.884290 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70811.6us
W20260709 12:25:00.884631 31466 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.884984  6568 leader_election.cc:290] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.885174 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:00.862546 31500 raft_consensus.cc:2468] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 22.
I20260709 12:25:00.886940  6573 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:00.887362  6573 raft_consensus.cc:493] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.887723  6573 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:00.892858  6565 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.894342  6565 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.900707 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:00.902585  6494 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:00.902981  6494 raft_consensus.cc:493] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:25:00.903148 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.903378  6494 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:25:00.903520 31540 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.904687 31540 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.905544 31540 leader_election.cc:336] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.906208 31540 leader_election.cc:336] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.906657 31540 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.907135 31540 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.912644 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46eaf930cd8a4253b8c4ad7982a44485" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:00.913250 31497 raft_consensus.cc:3060] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:00.913915  6574 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.917210  6548 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.919528 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:00.924998  6548 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.927352  6548 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:00.919667 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:25:00.919780 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:00.927982  6574 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:00.928297 31540 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.928893 31540 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.929018  6571 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:00.929536  6571 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.929944  6571 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:00.932660  6570 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:00.933352  6570 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.937083  6570 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.933606 31498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
W20260709 12:25:00.937608 31540 leader_election.cc:336] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.943396 31540 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:00.948020 31466 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.953020 32109 raft_consensus.cc:2468] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:25:00.958576  6565 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:00.962992  6573 raft_consensus.cc:515] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:00.955463  6571 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:00.966480 31498 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 17: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:25:00.967195  6571 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:25:00.964848 31466 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.962316 31317 catalog_manager.cc:5697] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 23 to 24, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 24 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:00.974443 31573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:25:00.975231 31573 raft_consensus.cc:2393] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 17: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
W20260709 12:25:00.973387 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88421.8us
I20260709 12:25:00.977802 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:00.981464 32110 raft_consensus.cc:2468] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 23.
W20260709 12:25:00.981504 31466 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.982987  6574 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:00.987519 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:25:00.989288  6565 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:00.990541 31497 raft_consensus.cc:2468] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:25:00.971297  6494 raft_consensus.cc:515] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:25:00.995210 32080 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:00.995767 32080 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:25:00.996726 31568 raft_consensus.cc:2393] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 23: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:25:00.999569  6494 leader_election.cc:290] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:01.000445  6573 leader_election.cc:290] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:01.001008  6548 raft_consensus.cc:2749] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:01.001967 32080 leader_election.cc:336] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:01.006283 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.007141 32080 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.007387 31540 leader_election.cc:304] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.007644 32080 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:25:01.008508  6548 raft_consensus.cc:2749] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:01.008589 31540 leader_election.cc:304] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.010730  6574 raft_consensus.cc:2804] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:01.011300  6574 raft_consensus.cc:697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:01.012295  6574 consensus_queue.cc:237] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:01.014055 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:01.014845 31497 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:25:01.015199  6575 raft_consensus.cc:2804] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:01.016117  6575 raft_consensus.cc:697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:01.017334  6575 consensus_queue.cc:237] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:01.029248 31463 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.032474  6571 raft_consensus.cc:2804] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:01.032950  6571 raft_consensus.cc:697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:25:01.033864  6571 consensus_queue.cc:237] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.037756 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:01.038439 31497 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 22.
I20260709 12:25:01.039093 31465 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
I20260709 12:25:01.039104 31463 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.040889 31463 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.043210 31497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "825684763f5c4e2dbf3597dc5a24f7df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:01.043102  6480 raft_consensus.cc:3060] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:01.046891  6570 raft_consensus.cc:2804] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:01.043848  6548 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.047497  6570 raft_consensus.cc:697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 23 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:25:01.047914  6548 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.048568  6570 consensus_queue.cc:237] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.050143  6548 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:01.042093  6565 raft_consensus.cc:2804] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:01.056632  6565 raft_consensus.cc:697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:25:01.058486  6430 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.058208  6565 consensus_queue.cc:237] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.059182  6430 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:01.061151 31540 leader_election.cc:336] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.061622  6430 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:01.066505 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:01.067139 32109 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 18.
I20260709 12:25:01.067334 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:01.067941 32110 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:25:01.068338 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:01.068941 32113 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:25:01.070996 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:01.071306 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:01.071597 32114 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 20.
I20260709 12:25:01.071923 32105 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 22.
I20260709 12:25:01.073891 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4592ece2c344a3a8564f95da501ac46" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:01.074422 31500 raft_consensus.cc:3060] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:01.075892 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:01.076463 31568 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 15.
I20260709 12:25:01.077756 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.078687  6573 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:01.079078  6573 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.079495  6573 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:01.083539 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.093017 31500 raft_consensus.cc:2468] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
W20260709 12:25:01.088506 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.106568 31537 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.107429  6494 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:01.107834  6494 raft_consensus.cc:493] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.107823 31537 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.114560  6575 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:01.115051  6575 raft_consensus.cc:493] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.115516  6575 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:01.115697  6480 raft_consensus.cc:2749] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:01.115866 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.118858  6490 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:01.119974 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:01.120611 31500 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 20.
I20260709 12:25:01.116621 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.119351  6490 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.122283  6490 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:01.123696  6548 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:01.124154  6548 raft_consensus.cc:493] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.124575  6548 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:01.128104  6494 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:01.134759 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.135583  6430 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:01.136031  6430 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.135797  6490 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.136525  6430 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:01.138744 31497 raft_consensus.cc:2468] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 23.
I20260709 12:25:01.136665 32080 leader_election.cc:304] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.144528  6575 raft_consensus.cc:515] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.146787  6572 raft_consensus.cc:2804] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:01.139948 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.156412  6575 leader_election.cc:290] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:01.154929 31540 leader_election.cc:304] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.161271  6575 raft_consensus.cc:2804] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:01.161844  6575 raft_consensus.cc:697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:01.164425  6573 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.167984 31568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
W20260709 12:25:01.172026 31540 leader_election.cc:336] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.175158  6575 consensus_queue.cc:237] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:01.179672 31568 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 16: Already voted for candidate 8553a13b444649b9a19e5488aabaf1c5 in this term.
I20260709 12:25:01.183619  6490 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:01.174280  6430 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.186146  6430 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:01.187569  6430 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:01.187933  6430 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
W20260709 12:25:01.188141 31540 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.188565  6430 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:01.168769  6573 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:01.200173  6548 raft_consensus.cc:515] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.202544  6548 leader_election.cc:290] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:01.227672 32080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87786.4us
I20260709 12:25:01.230865 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.235025 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:25:01.237133 32080 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:01.239346 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.240682 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.241195  6565 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:25:01.241619 32080 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:01.242499 32080 leader_election.cc:336] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.242511  6563 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:01.248098  6563 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.248648  6563 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:01.241694  6565 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0065979e5b9a477f8abf064563426291)
I20260709 12:25:01.250034  6565 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:01.257615  6430 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.216568  6494 raft_consensus.cc:515] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.263991  6494 leader_election.cc:290] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:01.264766 31500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:01.265364 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f97e5105626c48be9d1768855511628a" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:01.265905 31491 raft_consensus.cc:3060] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:01.276831 31491 raft_consensus.cc:2468] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 18.
I20260709 12:25:01.285382  6563 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.236567  6572 raft_consensus.cc:697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
W20260709 12:25:01.287554 31540 leader_election.cc:336] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.290923  6430 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:01.287319  6572 consensus_queue.cc:237] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:01.298112 31466 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.299108 32109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08259dcf521e4914917a72febcb040d1" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:01.303124 32109 raft_consensus.cc:3060] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:01.299292 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:01.303876 32110 raft_consensus.cc:2393] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8553a13b444649b9a19e5488aabaf1c5 in current term 16: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:25:01.302208  6565 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.312151 32109 raft_consensus.cc:2468] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:25:01.312436 31500 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 23: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:25:01.312750 32110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f83500bdaf49a8ac53bb5ba49c3529" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:01.318148 32110 raft_consensus.cc:3060] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:01.314138  6565 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:01.313334 31321 catalog_manager.cc:5697] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 19 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.320029 31321 catalog_manager.cc:5697] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 22 to 23, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 23 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:01.325702 31466 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.325762 32110 raft_consensus.cc:2468] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 19.
I20260709 12:25:01.322793 31321 catalog_manager.cc:5697] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 17 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:01.328094 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.331195 32080 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.348361  6563 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:25:01.350942 32080 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:01.351686 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.355286 31317 catalog_manager.cc:5697] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 21 to 22, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 22 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.356607 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:01.357388 31491 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e166c1cb41f04d55a85e6c0d7966e32e in current term 21: Already voted for candidate b6bc3d9dbfb44e81b63071002a011f71 in this term.
I20260709 12:25:01.357688 31317 catalog_manager.cc:5697] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 19 to 20, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 20 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.361037 31317 catalog_manager.cc:5697] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 22 to 23, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 23 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.373732 31537 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:01.376230  6490 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:01.380292 31491 raft_consensus.cc:1275] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:25:01.386754  6490 consensus_queue.cc:1048] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:01.393498 32080 leader_election.cc:304] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:01.396135  6589 raft_consensus.cc:2804] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:01.396700  6589 raft_consensus.cc:697] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:25:01.397626  6589 consensus_queue.cc:237] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.421120 31500 raft_consensus.cc:1275] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:25:01.425612 31537 leader_election.cc:304] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:01.435750 31537 leader_election.cc:304] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
W20260709 12:25:01.428570 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.437536 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.437284  6494 consensus_queue.cc:1048] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:01.438026  6575 raft_consensus.cc:2804] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:01.438666  6575 raft_consensus.cc:697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:01.439248  6494 raft_consensus.cc:2804] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:01.439785  6494 raft_consensus.cc:697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:01.439599  6575 consensus_queue.cc:237] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:01.440742  6494 consensus_queue.cc:237] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:01.438021 32080 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.443496 32080 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, 8553a13b444649b9a19e5488aabaf1c5
W20260709 12:25:01.444624 32080 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.445187  6589 raft_consensus.cc:2749] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:01.445122 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:01.451236  6589 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:25:01.453837 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.460140 32080 leader_election.cc:336] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:01.460798 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:01.469573 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.479423 31321 catalog_manager.cc:5697] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 15 to 16, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 16 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.481596 31317 catalog_manager.cc:5697] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 19 to 20, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 20 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.494477 32105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:01.495579 32105 raft_consensus.cc:2393] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 21: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
I20260709 12:25:01.495592 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:01.497535 32113 raft_consensus.cc:2393] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b6bc3d9dbfb44e81b63071002a011f71 in current term 23: Already voted for candidate e166c1cb41f04d55a85e6c0d7966e32e in this term.
W20260709 12:25:01.521049 32080 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:01.521581 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:01.520960 31463 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:01.533721 31463 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71; no voters: 0065979e5b9a477f8abf064563426291, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:01.537410 32106 raft_consensus.cc:1275] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:25:01.533030  6572 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:01.532902  6563 raft_consensus.cc:2749] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:01.550783  6565 raft_consensus.cc:2749] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:25:01.553853 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.556965 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.561587  6565 consensus_queue.cc:1048] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:25:01.563333 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.565254 31321 catalog_manager.cc:5697] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 17 to 18, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 18 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.570219 32110 raft_consensus.cc:1275] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:01.591042 31317 catalog_manager.cc:5697] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 18 to 19, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 19 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.597882  6565 consensus_queue.cc:1048] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:25:01.609011 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:01.632777 31491 raft_consensus.cc:1275] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:25:01.636385  6490 consensus_queue.cc:1048] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:25:01.641958 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.650360 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.668516 32111 raft_consensus.cc:1275] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:25:01.681806  6565 consensus_queue.cc:1048] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:25:01.699296 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.719025 30271 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31445)
I20260709 12:25:01.721210 31500 raft_consensus.cc:1275] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:25:01.741349 31500 raft_consensus.cc:1275] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:25:01.747359  6494 consensus_queue.cc:1048] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:01.759893  6572 consensus_queue.cc:1048] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:01.828044 31500 raft_consensus.cc:1275] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:25:01.905057  6572 consensus_queue.cc:1048] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:25:01.927847 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.970151 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:01.970645 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:01.997493 32106 raft_consensus.cc:1275] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:25:01.999891  6494 consensus_queue.cc:1048] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:02.018720 32111 raft_consensus.cc:1275] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Refusing update from remote peer 8553a13b444649b9a19e5488aabaf1c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:02.022289  6494 consensus_queue.cc:1048] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:25:02.048799 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:02.432554 32080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111) [suppressed 335 similar messages]
W20260709 12:25:02.719565 30271 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:02.749423 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:02.779428 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:02.796222  6618 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.796829  6618 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:02.803929  6618 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:02.804232 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:02.805007 31565 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 17.
I20260709 12:25:02.806196 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:02.807971  6612 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:02.808398  6612 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.808719  6612 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:02.819898  6612 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:25:02.828358 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:02.830703  6612 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:02.831048 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987c407200734c78918f4e63b9c8f16f" candidate_uuid: "b6bc3d9dbfb44e81b63071002a011f71" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:25:02.833103 31565 raft_consensus.cc:3060] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:02.828924 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:02.834545 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:02.838366 31466 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:02.843945 31565 raft_consensus.cc:2468] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6bc3d9dbfb44e81b63071002a011f71 in term 18.
I20260709 12:25:02.845312 31465 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71; no voters: 
I20260709 12:25:02.846158  6612 raft_consensus.cc:2804] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:02.846604  6612 raft_consensus.cc:697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Becoming Leader. State: Replica: b6bc3d9dbfb44e81b63071002a011f71, State: Running, Role: LEADER
I20260709 12:25:02.847501  6612 consensus_queue.cc:237] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
W20260709 12:25:02.850533 31466 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:02.875257 31317 catalog_manager.cc:5697] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 reported cstate change: term changed from 16 to 18, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194). New cstate: current_term: 18 leader_uuid: "b6bc3d9dbfb44e81b63071002a011f71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:02.981519 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.021214 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.025815 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.044868 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.046339 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.049233 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.074798 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.111778 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.166358  6589 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.166990  6589 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.170552  6589 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:03.171741 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
I20260709 12:25:03.172448 31565 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 16.
W20260709 12:25:03.175426 32080 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:03.175582 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.178465 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:03.188633  6589 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:03.189283  6589 raft_consensus.cc:493] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.189713  6589 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:03.206588  6589 raft_consensus.cc:515] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.218917 31565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d3e8b68142d4e34a867ce6d3a9fb56d" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5"
I20260709 12:25:03.219597 31565 raft_consensus.cc:3060] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:03.221645  6589 leader_election.cc:290] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:25:03.232373 32080 leader_election.cc:336] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:03.237399 31569 raft_consensus.cc:1275] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Refusing update from remote peer b6bc3d9dbfb44e81b63071002a011f71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:03.238976  6563 consensus_queue.cc:1048] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:03.243723 31565 raft_consensus.cc:2468] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 17.
I20260709 12:25:03.247553 32079 leader_election.cc:304] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:03.248903  6572 raft_consensus.cc:2804] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:03.249563  6572 raft_consensus.cc:697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:25:03.250635  6572 consensus_queue.cc:237] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.293671 31317 catalog_manager.cc:5697] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 15 to 17, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 17 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.339713  6572 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.340224  6572 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.342212  6572 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:03.348091 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:03.348788 31491 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 21.
I20260709 12:25:03.352839 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:03.359365  6572 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:03.359778  6572 raft_consensus.cc:493] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.360090  6572 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:03.362582 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:03.367511  6572 raft_consensus.cc:515] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.369724  6572 leader_election.cc:290] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:03.375653 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab86e60df2854213b3c95a365e5f4807" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:03.376302 31491 raft_consensus.cc:3060] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:03.384343 31491 raft_consensus.cc:2468] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 22.
W20260709 12:25:03.385298 32080 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:03.387009 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.390761 32080 leader_election.cc:304] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:03.399564  6572 raft_consensus.cc:2804] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:25:03.399654 32080 leader_election.cc:336] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:03.400164  6572 raft_consensus.cc:697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:25:03.401006  6572 consensus_queue.cc:237] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:03.411201 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.429651 31317 catalog_manager.cc:5697] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 20 to 22, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 22 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:03.466361 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.478015 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.521142 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.521720 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.553406 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.555138 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.583588  6572 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.584237  6572 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.586589  6572 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:03.588047 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:03.588835 31491 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 23.
I20260709 12:25:03.616429 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:03.620471  6572 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:25:03.620972  6572 raft_consensus.cc:493] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.621325  6572 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:25:03.620548 32080 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:03.630201  6572 raft_consensus.cc:515] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:03.634629  6572 leader_election.cc:290] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 election: Requested vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:03.643196 31596 debug-util.cc:398] Leaking SignalData structure 0x7b0800375e60 after lost signal to thread 30274
W20260709 12:25:03.644313 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080037fe40 after lost signal to thread 31356
W20260709 12:25:03.645582 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080019d820 after lost signal to thread 31524
W20260709 12:25:03.646636 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080018f0a0 after lost signal to thread 31599
W20260709 12:25:03.647763 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080016f180 after lost signal to thread 32138
I20260709 12:25:03.648259 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c70f01b47774cc48e80fabd1ef37f2e" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71"
I20260709 12:25:03.648859 31491 raft_consensus.cc:3060] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:25:03.648259 31596 debug-util.cc:398] Leaking SignalData structure 0x7b0800132560 after lost signal to thread 6581
I20260709 12:25:03.665217 31491 raft_consensus.cc:2468] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e166c1cb41f04d55a85e6c0d7966e32e in term 24.
W20260709 12:25:03.668757 32080 leader_election.cc:336] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:03.669389 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.670198 32080 leader_election.cc:304] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291
I20260709 12:25:03.671021  6572 raft_consensus.cc:2804] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:25:03.671522  6572 raft_consensus.cc:697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 24 LEADER]: Becoming Leader. State: Replica: e166c1cb41f04d55a85e6c0d7966e32e, State: Running, Role: LEADER
I20260709 12:25:03.672451  6572 consensus_queue.cc:237] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:03.673205 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.716661 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.720098 30271 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:03.727140 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:03.727690 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.737454 31317 catalog_manager.cc:5697] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e reported cstate change: term changed from 22 to 24, leader changed from 0065979e5b9a477f8abf064563426291 (127.29.143.193) to e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196). New cstate: current_term: 24 leader_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:03.760313 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:03.804647 31565 raft_consensus.cc:1275] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:25:03.806543 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:03.808888  6634 consensus_queue.cc:1048] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:25:03.846522 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:03.884967 31500 raft_consensus.cc:1275] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:25:03.886762  6589 consensus_queue.cc:1048] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:25:03.956787 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:03.984390 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.052799 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:04.055450 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.131079 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.163688 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:04.272954 31500 raft_consensus.cc:1275] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Refusing update from remote peer e166c1cb41f04d55a85e6c0d7966e32e: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
W20260709 12:25:04.275600 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:04.277940  6589 consensus_queue.cc:1048] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:25:04.324205 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.380821 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.401253 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.434619 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.462924 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:04.720549 30271 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:04.859759 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.041985 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.054483 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.103114 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.299741 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.317909 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.392830 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.428375 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.453572 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.592006 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.602206 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.662436 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.686853 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:05.721055 30271 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:05.721107 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.723213 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.774487 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.867132 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.925936 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:05.934909 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.008706 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.033710 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 64238.6us
W20260709 12:25:06.071453 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.087010 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.106912 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.112378 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.147547 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.148885 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.220196 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.249006 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.276530 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.292444 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.293445 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.409032 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:06.512151 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.616055 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.640254 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.682878 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.688769 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:06.721549 30271 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:06.804940 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.828815 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.939740 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.976975 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:06.980517 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:07.058174 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:07.121855 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:07.152765 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:07.329942 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.458602 32080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 12:25:07.641120 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.678844 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.721428 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.722045 30271 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:07.807865 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.826494 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.925107 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.942883 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:07.982532 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.141669 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.212502 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.223676 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.255414 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.264366 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.277216 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.330209 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.403534 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.472354 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:08.486297 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.499837 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.523334 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.544871 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.552433 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.613395 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.702899 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.715919 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.722482 30271 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:08.723378 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.742926 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.784907 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.845845 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:08.900178 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:09.004467 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:09.085405 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.114903 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.223495 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.276474 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.326076 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:09.361313 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.420632 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.442461 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.576012 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.633456 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.650646 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.722961 30271 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:09.724575 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:09.995280 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:10.021667 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:10.730463 30271 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:10.766713 31464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.016s
W20260709 12:25:10.767297 31464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.006s	sys 0.016s
W20260709 12:25:10.770426 31463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.002s	sys 0.041s
W20260709 12:25:10.770996 31463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.003s	sys 0.041s
W20260709 12:25:10.793555 31537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.014s	sys 0.011s
W20260709 12:25:10.794148 31537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.015s	sys 0.011s
W20260709 12:25:10.912147 31538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.011s	sys 0.006s
W20260709 12:25:10.912629 31538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.006s
W20260709 12:25:10.943287 31466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.009s	sys 0.011s
W20260709 12:25:10.943728 31466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.009s	sys 0.011s
W20260709 12:25:10.943810 31465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.005s	sys 0.017s
W20260709 12:25:10.944267 31465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.005s	sys 0.017s
W20260709 12:25:11.047009 31540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 88762.8us
W20260709 12:25:11.079485 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 59921.5us
W20260709 12:25:11.095769 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.097229 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:11.098645  6666 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:25:11.116639 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.121058 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:11.099828  6666 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:11.125200  6666 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:11.127086 31466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:35273, user_credentials={real_user=slave}} blocked reactor thread for 46335us
W20260709 12:25:11.135004 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.145761 31537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:35667, user_credentials={real_user=slave}} blocked reactor thread for 62907.8us
I20260709 12:25:11.146917  6654 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:11.147630  6654 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:11.149842  6654 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:11.164454 32113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:25:11.164911 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.165841 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.170785 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.171482 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.189303 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:11.191187 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12a5ef370bb94f5abfccedf7e771d83c" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:11.194515 31491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b6bc3d9dbfb44e81b63071002a011f71" is_pre_election: true
I20260709 12:25:11.224996 31540 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:11.226468  6672 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:11.250056 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.250566 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.256120 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.256811 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.264174 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.276356 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.284678 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:11.303260 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.303966 31540 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:11.304464 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:11.305313  6672 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:11.361815 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.376196 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:11.419049 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.436533 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.446797 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.447916 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.451066 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.535516 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.639087 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.713022 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:11.731635 30271 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:11.742467 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08000b05e0 after lost signal to thread 30274
W20260709 12:25:11.743789 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08000c04c0 after lost signal to thread 31356
W20260709 12:25:11.745244 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080037fda0 after lost signal to thread 31524
W20260709 12:25:11.746869 31596 debug-util.cc:398] Leaking SignalData structure 0x7b080028b880 after lost signal to thread 31599
W20260709 12:25:11.748193 31596 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2fc0 after lost signal to thread 32138
W20260709 12:25:11.811492 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:11.931720 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:11.962399 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:12.127463 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:12.134367 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.148624 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.218753 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.389329 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.551273 31540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111) [suppressed 399 similar messages]
W20260709 12:25:12.642640 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.671384 32079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:34217, user_credentials={real_user=slave}} blocked reactor thread for 48705.2us
W20260709 12:25:12.692879 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.695391 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.732323 30271 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:12.745806 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:12.763875 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:12.777467 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:13.056550 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.060883 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.094090 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:13.229071 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.278633 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.305034 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.325992 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.366422 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.376641 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.425302 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.509145 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3d00 after lost signal to thread 30274
W20260709 12:25:13.510309 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08003abe00 after lost signal to thread 31356
W20260709 12:25:13.511673 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08001028e0 after lost signal to thread 31524
W20260709 12:25:13.512818 32135 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5160 after lost signal to thread 31599
W20260709 12:25:13.513998 32135 debug-util.cc:398] Leaking SignalData structure 0x7b0800329a80 after lost signal to thread 32138
W20260709 12:25:13.606071 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.612035 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.674055 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.687453 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.705579 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.732985 30271 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:13.763590 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.818203 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.825448 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.945839 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.949412 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:13.965235 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:13.975611 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.017648 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.029241 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.088124 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.111779 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:14.166643 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.244704 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:14.267406 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:14.271092 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.290664 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.491202 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.605400 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:14.620452 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:14.733433 30271 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:14.734233 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:14.779161 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:14.799170 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:14.825721 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:14.876554 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.042450 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.050890 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.131734 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.263760 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.408368 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.547621 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.551440 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.575073 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.596046 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.697201 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.718951 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.728428 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.733922 30271 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:15.766993 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:15.864074 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:15.950170 31466 consensus_peers.cc:597] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.001179 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.130553 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.175777 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.216830 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.294592 31466 consensus_peers.cc:597] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.314776 31466 consensus_peers.cc:597] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.368798 31466 consensus_peers.cc:597] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.391903 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.406446 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.406828 31466 consensus_peers.cc:597] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.484959 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.508261 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.515539 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:16.575886 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.614634 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:16.625916 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.628441 31466 consensus_peers.cc:597] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:16.633104 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.695003 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.695559 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:16.734498 30271 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 31445)
W20260709 12:25:16.760342 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.025303 31466 consensus_peers.cc:597] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.167725 31466 consensus_peers.cc:597] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:17.182829 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.232642 31466 consensus_peers.cc:597] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.382458 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.460731 31540 consensus_peers.cc:597] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.473212 31466 consensus_peers.cc:597] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:25:17.589038 31540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111) [suppressed 429 similar messages]
W20260709 12:25:17.700661 31466 consensus_peers.cc:597] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:17.828337 31466 consensus_peers.cc:597] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.014006 31466 consensus_peers.cc:597] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.037926 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:18.039368 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:18.057380 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
W20260709 12:25:18.086994 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:18.087996 32080 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.176805 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:18.191476 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
W20260709 12:25:18.194984 31466 consensus_peers.cc:597] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.206315 31466 consensus_peers.cc:597] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.212158 31540 consensus_peers.cc:597] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.222196 31540 consensus_peers.cc:597] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.232892 32080 consensus_peers.cc:597] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.261291 31540 consensus_peers.cc:597] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:18.263926 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:18.264878 30271 tablet_replica.cc:333] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.265532 30271 raft_consensus.cc:2243] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.266115 30271 raft_consensus.cc:2272] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.269464 30271 tablet_replica.cc:333] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.270354 30271 raft_consensus.cc:2243] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.270936 30271 raft_consensus.cc:2272] T ac6ba1e461fb4563910a86b4223e918c P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.273032 30271 tablet_replica.cc:333] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.273581 30271 raft_consensus.cc:2243] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.274582 30271 raft_consensus.cc:2272] T 81365ffbeca2466590e0e6d5e449c28b P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.277230 30271 tablet_replica.cc:333] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.277827 30271 raft_consensus.cc:2243] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.278275 30271 raft_consensus.cc:2272] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.280413 30271 tablet_replica.cc:333] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.281004 30271 raft_consensus.cc:2243] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.281827 30271 raft_consensus.cc:2272] T 519f567f2eff4e55b84df6d3edde6bc2 P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.284229 30271 tablet_replica.cc:333] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.285022 30271 raft_consensus.cc:2243] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.285702 30271 raft_consensus.cc:2272] T c4cfa84e581647da8d228ad20eb18205 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.286590 31540 consensus_peers.cc:597] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.288225 32080 consensus_peers.cc:597] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.288676 30271 tablet_replica.cc:333] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.289528 30271 raft_consensus.cc:2243] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.290001 30271 raft_consensus.cc:2272] T 92b3a623c9be4f43853d9eeb42b92968 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.291879 30271 tablet_replica.cc:333] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.292459 30271 raft_consensus.cc:2243] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.292927 30271 raft_consensus.cc:2272] T f615aa4788f84d6fa066cd71bbdaeadb P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.294786 30271 tablet_replica.cc:333] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.295333 30271 raft_consensus.cc:2243] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.296288 30271 raft_consensus.cc:2272] T 70e01c7a1fa14a318bcfcf17308b0c63 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.298924 30271 tablet_replica.cc:333] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.299803 30271 raft_consensus.cc:2243] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.300403 30271 raft_consensus.cc:2272] T d4592ece2c344a3a8564f95da501ac46 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.302487 30271 tablet_replica.cc:333] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.303073 30271 raft_consensus.cc:2243] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.303870 30271 raft_consensus.cc:2272] T 84c7d950f0b944939a3a24f8336687e2 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.305727 30271 tablet_replica.cc:333] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.306280 30271 raft_consensus.cc:2243] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.307567 30271 raft_consensus.cc:2272] T 46d2c7602ed046c6afb92739319e584c P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.309964 30271 tablet_replica.cc:333] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.310771 30271 raft_consensus.cc:2243] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:25:18.311687 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.311808 30271 raft_consensus.cc:2272] T 8b893ed7439d49939f7332cad4722c09 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.314204 30271 tablet_replica.cc:333] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.314976 30271 raft_consensus.cc:2243] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.315752 30271 raft_consensus.cc:2272] T 0650d5583d6f49e2aba22f8d696283ea P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.318125 30271 tablet_replica.cc:333] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.318750 30271 raft_consensus.cc:2243] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.319548 30271 raft_consensus.cc:2272] T 21e357624c0f4e5f89de3446133ddb5c P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.321403 30271 tablet_replica.cc:333] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.321961 30271 raft_consensus.cc:2243] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.322479 30271 raft_consensus.cc:2272] T 1685dea95ca449998eaf8075418fda96 P b6bc3d9dbfb44e81b63071002a011f71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.324404 30271 tablet_replica.cc:333] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.324950 30271 raft_consensus.cc:2243] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.325846 30271 raft_consensus.cc:2272] T 8b5303969e814b4481d74acd8c7997df P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.328145 30271 tablet_replica.cc:333] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.328872 30271 raft_consensus.cc:2243] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.329577 30271 raft_consensus.cc:2272] T bda3e60a745b4a24a244329f3c923858 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.332397 30271 tablet_replica.cc:333] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.333168 30271 raft_consensus.cc:2243] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.334206 30271 raft_consensus.cc:2272] T bb26db0e5b834d508281418291d5c108 P b6bc3d9dbfb44e81b63071002a011f71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.336757 30271 tablet_replica.cc:333] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.337518 30271 raft_consensus.cc:2243] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.339042 30271 raft_consensus.cc:2272] T 5c09d681ba8545a397b540c3565c50ff P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.339303 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:18.341609 30271 tablet_replica.cc:333] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.342283 30271 raft_consensus.cc:2243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:25:18.343204 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.343394 30271 raft_consensus.cc:2272] T 36ab0d648ab643bf8d74dbe6ee9503d8 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.345975 30271 tablet_replica.cc:333] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.346762 30271 raft_consensus.cc:2243] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.347368 30271 raft_consensus.cc:2272] T cbb15d4732f1472ea96078ec58ddade4 P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.349118 30271 tablet_replica.cc:333] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.349705 30271 raft_consensus.cc:2243] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.350083 30271 raft_consensus.cc:2272] T f42c299f626148ba8af55613ab8e9bc4 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.352155 30271 tablet_replica.cc:333] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.352649 30271 raft_consensus.cc:2243] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.353016 30271 raft_consensus.cc:2272] T 5aa949305b1a42489bcc1e0b4287c6c3 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.355350 30271 tablet_replica.cc:333] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.356000 30271 raft_consensus.cc:2243] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.356957 30271 raft_consensus.cc:2272] T 68a65ccf8d5e42c1aa51a8761a850dd7 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.357574 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.359113 30271 tablet_replica.cc:333] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.359777 30271 raft_consensus.cc:2243] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.360803 30271 raft_consensus.cc:2272] T 60738423610d43149226454d80d6b245 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.363160 30271 tablet_replica.cc:333] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.363715 30271 raft_consensus.cc:2243] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:25:18.364223 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:25:18.364760 30271 raft_consensus.cc:2272] T 12a5ef370bb94f5abfccedf7e771d83c P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.367295 30271 tablet_replica.cc:333] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.367897 30271 raft_consensus.cc:2243] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.368803 30271 raft_consensus.cc:2272] T d385c04853e749af8fb00afe40a4a255 P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.371196 30271 tablet_replica.cc:333] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.372088 30271 raft_consensus.cc:2243] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.372822 30271 raft_consensus.cc:2272] T 46eaf930cd8a4253b8c4ad7982a44485 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.375718 30271 tablet_replica.cc:333] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.376686 30271 raft_consensus.cc:2243] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.378023 30271 raft_consensus.cc:2272] T d54aaf3e560149eca7c259e9a3b7e37e P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.380164 30271 tablet_replica.cc:333] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.380949 30271 raft_consensus.cc:2243] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.381598 30271 raft_consensus.cc:2272] T 41d7370a77bc48eaaa344ded5091445b P b6bc3d9dbfb44e81b63071002a011f71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.383569 30271 tablet_replica.cc:333] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.384152 30271 raft_consensus.cc:2243] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.385166 30271 raft_consensus.cc:2272] T 8e64b21111bd41639226f8d37505e9a7 P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.387603 30271 tablet_replica.cc:333] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.388332 30271 raft_consensus.cc:2243] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.389393 30271 raft_consensus.cc:2272] T 1ed13c6144834a9a9349865442585b12 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.390792 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.391688 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.391822 30271 tablet_replica.cc:333] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.392573 30271 raft_consensus.cc:2243] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.393149 30271 raft_consensus.cc:2272] T f97e5105626c48be9d1768855511628a P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.395395 30271 tablet_replica.cc:333] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.396183 30271 raft_consensus.cc:2243] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.397284 30271 raft_consensus.cc:2272] T 987c407200734c78918f4e63b9c8f16f P b6bc3d9dbfb44e81b63071002a011f71 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.399386 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.399608 30271 tablet_replica.cc:333] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.400501 30271 raft_consensus.cc:2243] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.401154 30271 raft_consensus.cc:2272] T 6c70f01b47774cc48e80fabd1ef37f2e P b6bc3d9dbfb44e81b63071002a011f71 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.403726 30271 tablet_replica.cc:333] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.404454 30271 raft_consensus.cc:2243] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.404959 30271 raft_consensus.cc:2272] T a1af086d1060473f980f0bed9af34c07 P b6bc3d9dbfb44e81b63071002a011f71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.407408 30271 tablet_replica.cc:333] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
W20260709 12:25:18.407539 31540 consensus_peers.cc:597] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.407987 30271 raft_consensus.cc:2243] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.408586 30271 raft_consensus.cc:2272] T ab86e60df2854213b3c95a365e5f4807 P b6bc3d9dbfb44e81b63071002a011f71 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.410616 30271 tablet_replica.cc:333] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.411211 30271 raft_consensus.cc:2243] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.412077 30271 raft_consensus.cc:2272] T 7e61fb74a676405696e2d0e6b9027efe P b6bc3d9dbfb44e81b63071002a011f71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.414395 30271 tablet_replica.cc:333] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.415083 30271 raft_consensus.cc:2243] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.416069 30271 raft_consensus.cc:2272] T 076aa0801557438fb22bfc7b11769a33 P b6bc3d9dbfb44e81b63071002a011f71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.418633 30271 tablet_replica.cc:333] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.419370 30271 raft_consensus.cc:2243] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:25:18.420184 31540 consensus_peers.cc:597] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.420401 30271 raft_consensus.cc:2272] T dad6aaa667ee45cb985fe02da47448e3 P b6bc3d9dbfb44e81b63071002a011f71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.423091 30271 tablet_replica.cc:333] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.423756 30271 raft_consensus.cc:2243] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.424268 30271 raft_consensus.cc:2272] T 9dd7b78d2ef1488c970505878e67c6ca P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.426833 30271 tablet_replica.cc:333] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
W20260709 12:25:18.426860 31540 consensus_peers.cc:597] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:18.427654 30271 raft_consensus.cc:2243] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:18.428143 30271 raft_consensus.cc:2272] T 825684763f5c4e2dbf3597dc5a24f7df P b6bc3d9dbfb44e81b63071002a011f71 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:18.430037 30271 tablet_replica.cc:333] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71: stopping tablet replica
I20260709 12:25:18.430491 30271 raft_consensus.cc:2243] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:18.431260 30271 raft_consensus.cc:2272] T c28624eba07742ab91e568bf551106a4 P b6bc3d9dbfb44e81b63071002a011f71 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:18.441632 32080 consensus_peers.cc:597] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.442338 31540 consensus_peers.cc:597] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.453500 32080 consensus_peers.cc:597] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.454017 31540 consensus_peers.cc:597] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.514632 32080 consensus_peers.cc:597] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.556882 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.576505 32080 consensus_peers.cc:597] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.625414 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.657099 31540 consensus_peers.cc:597] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 -> Peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Couldn't send request to peer b6bc3d9dbfb44e81b63071002a011f71. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:18.700098 31540 consensus_peers.cc:597] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.705406 32080 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.833495 31540 consensus_peers.cc:597] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.843024 31540 consensus_peers.cc:597] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:18.942070 32080 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:19.040714 31540 consensus_peers.cc:597] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:19.188370 32080 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:19.256341  6700 raft_consensus.cc:493] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.256920  6700 raft_consensus.cc:515] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.261508  6700 leader_election.cc:290] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.265235 31540 leader_election.cc:336] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.265987 31540 leader_election.cc:336] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.266350 31540 leader_election.cc:304] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.267071  6700 raft_consensus.cc:2749] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:19.299479  6701 raft_consensus.cc:493] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.300038  6701 raft_consensus.cc:515] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.302347  6701 leader_election.cc:290] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.303607 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e01c7a1fa14a318bcfcf17308b0c63" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:25:19.305840 32080 leader_election.cc:336] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.306246 32080 leader_election.cc:304] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.306962  6701 raft_consensus.cc:2749] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:19.327189  6701 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.327775  6701 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.329906  6701 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.331513 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:25:19.335384 32080 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.335839 32080 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.336520  6696 raft_consensus.cc:2749] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:19.338255 32080 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:19.350718 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
I20260709 12:25:19.393891  6696 raft_consensus.cc:493] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.394842  6696 raft_consensus.cc:515] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.397221  6696 leader_election.cc:290] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.404618 32080 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.405352 32080 leader_election.cc:336] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.405803 32080 leader_election.cc:304] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.406559  6701 raft_consensus.cc:2749] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:25:19.425562  6701 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.426162  6701 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:19.427733 31540 consensus_peers.cc:597] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:19.429610  6701 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.429632 31566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8553a13b444649b9a19e5488aabaf1c5" is_pre_election: true
W20260709 12:25:19.434013 32080 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.434453 32080 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.435248  6701 raft_consensus.cc:2749] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:19.435902  6700 raft_consensus.cc:493] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.436441  6700 raft_consensus.cc:515] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.438742  6700 leader_election.cc:290] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.445961 31540 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.447104 31540 leader_election.cc:336] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.447552 31540 leader_election.cc:304] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.448386  6691 raft_consensus.cc:2749] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:19.449270  6691 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.449765  6691 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.452803  6691 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:19.453372 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:19.454088 32114 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 20.
I20260709 12:25:19.455181 31537 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
I20260709 12:25:19.456022  6691 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:19.456451  6691 raft_consensus.cc:493] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.456825  6691 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:19.460328  6696 raft_consensus.cc:493] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:25:19.461119 31540 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.460878  6696 raft_consensus.cc:515] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.463265  6701 raft_consensus.cc:493] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.464063  6696 leader_election.cc:290] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.463815  6701 raft_consensus.cc:515] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.464840  6691 raft_consensus.cc:515] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.466828 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
I20260709 12:25:19.467118  6691 leader_election.cc:290] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:25:19.467489 32080 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:19.468758 32080 consensus_peers.cc:597] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:19.471884 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed13c6144834a9a9349865442585b12" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:19.472326 32114 raft_consensus.cc:3060] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:19.474156  6701 leader_election.cc:290] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.474833 32080 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
W20260709 12:25:19.476066 32080 leader_election.cc:336] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.476557 32080 leader_election.cc:304] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.477319  6701 raft_consensus.cc:2749] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:19.480000 31540 leader_election.cc:336] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.481108  6696 raft_consensus.cc:493] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.481662  6696 raft_consensus.cc:515] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.482698 32114 raft_consensus.cc:2468] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 21.
I20260709 12:25:19.483937  6696 leader_election.cc:290] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.480544  6701 raft_consensus.cc:493] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:25:19.485276 32080 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.485869  6691 raft_consensus.cc:493] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.486500 31537 leader_election.cc:304] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.486829  6691 raft_consensus.cc:515] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.487747  6700 raft_consensus.cc:2804] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:25:19.487869 32080 leader_election.cc:336] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.488262  6700 raft_consensus.cc:697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:19.488423 32080 leader_election.cc:304] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.486568  6701 raft_consensus.cc:515] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.489283  6696 raft_consensus.cc:2749] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:19.492981  6691 leader_election.cc:290] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.493798 31540 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.497548 32079 consensus_peers.cc:597] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.489250  6700 consensus_queue.cc:237] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
W20260709 12:25:19.501039 31540 leader_election.cc:336] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.501652 31540 leader_election.cc:304] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.499548  6701 leader_election.cc:290] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.503625  6691 raft_consensus.cc:2749] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:19.504916 32080 leader_election.cc:336] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.508212  6696 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.508639  6696 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.510326  6696 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
W20260709 12:25:19.512440 32080 leader_election.cc:336] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.513000 32080 leader_election.cc:304] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.514146  6696 raft_consensus.cc:2749] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:19.514916 32079 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:19.516815 32080 leader_election.cc:336] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.517676  6666 raft_consensus.cc:493] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.518158  6666 raft_consensus.cc:515] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.519752  6666 leader_election.cc:290] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.521390 32080 leader_election.cc:336] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.521881 32080 leader_election.cc:304] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.522691  6696 raft_consensus.cc:2749] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:19.526324 31540 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.528822 32080 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.529505 32080 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.532133  6696 raft_consensus.cc:2749] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:19.533360 31540 leader_election.cc:336] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.528359 31321 catalog_manager.cc:5697] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 reported cstate change: term changed from 20 to 21, leader changed from b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194) to 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195). New cstate: current_term: 21 leader_uuid: "8553a13b444649b9a19e5488aabaf1c5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.534044 31540 leader_election.cc:304] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.534830  6666 raft_consensus.cc:2749] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:19.540341  6700 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.540863  6700 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.543123  6700 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:19.545706 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076aa0801557438fb22bfc7b11769a33" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
W20260709 12:25:19.549404 31540 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.549728 31540 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: b6bc3d9dbfb44e81b63071002a011f71, e166c1cb41f04d55a85e6c0d7966e32e
I20260709 12:25:19.550696  6700 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:19.564479 32079 consensus_peers.cc:597] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.570614  6700 raft_consensus.cc:493] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.571341  6700 raft_consensus.cc:515] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.573877  6700 leader_election.cc:290] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.575205  6700 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.575758  6700 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.577703  6700 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
W20260709 12:25:19.578225 31540 leader_election.cc:336] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
W20260709 12:25:19.579272 31540 leader_election.cc:336] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.579658 31540 leader_election.cc:304] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.579967 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:19.580572 32114 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:25:19.580911  6700 raft_consensus.cc:2749] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:19.582731 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: 
W20260709 12:25:19.583227 31540 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.583447  6700 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:19.583823  6700 raft_consensus.cc:493] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.584178  6700 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:19.586966 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:19.588148 30271 tablet_replica.cc:333] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.589597 30271 raft_consensus.cc:2243] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.590752 30271 raft_consensus.cc:2272] T ac6ba1e461fb4563910a86b4223e918c P 8553a13b444649b9a19e5488aabaf1c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.590592  6700 raft_consensus.cc:515] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.593216  6700 leader_election.cc:290] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:19.593478 30271 tablet_replica.cc:333] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.594521 30271 raft_consensus.cc:2243] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.594640 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68a65ccf8d5e42c1aa51a8761a850dd7" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
I20260709 12:25:19.595252 32114 raft_consensus.cc:3060] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:19.595427 30271 raft_consensus.cc:2272] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.598279 30271 tablet_replica.cc:333] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.599076 30271 raft_consensus.cc:2243] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.600272 30271 raft_consensus.cc:2272] T b1e4a1fb5dbb4dca99dc9fbc2881de05 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.601936 32114 raft_consensus.cc:2468] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 17.
I20260709 12:25:19.603111 30271 tablet_replica.cc:333] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
W20260709 12:25:19.603824 32079 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.603916 31540 leader_election.cc:336] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.604054 30271 raft_consensus.cc:2243] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.604564 31537 leader_election.cc:304] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.604759 30271 raft_consensus.cc:2272] T 81365ffbeca2466590e0e6d5e449c28b P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.605343  6700 raft_consensus.cc:2804] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:19.607167 32080 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:19.607592 30271 tablet_replica.cc:333] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.608400 30271 raft_consensus.cc:2243] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.609586 30271 raft_consensus.cc:2272] T 92b3a623c9be4f43853d9eeb42b92968 P 8553a13b444649b9a19e5488aabaf1c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.610364  6700 raft_consensus.cc:697] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Becoming Leader. State: Replica: 8553a13b444649b9a19e5488aabaf1c5, State: Running, Role: LEADER
I20260709 12:25:19.611302  6700 consensus_queue.cc:237] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.611765  6696 raft_consensus.cc:493] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.612272  6696 raft_consensus.cc:515] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.615939  6696 leader_election.cc:290] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.612231 30271 tablet_replica.cc:333] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.617122 30271 raft_consensus.cc:2243] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.618116 30271 raft_consensus.cc:2272] T e77a183300084f968171dcd68225d026 P 8553a13b444649b9a19e5488aabaf1c5 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.619035 32079 leader_election.cc:336] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:19.620668 30271 tablet_replica.cc:333] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.621538 30271 raft_consensus.cc:2243] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.622517 30271 raft_consensus.cc:2272] T c4cfa84e581647da8d228ad20eb18205 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.623011  6691 raft_consensus.cc:493] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.623646  6691 raft_consensus.cc:515] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } }
I20260709 12:25:19.625162 30271 tablet_replica.cc:333] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.626031 30271 raft_consensus.cc:2243] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.626143  6691 leader_election.cc:290] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.628072 30271 raft_consensus.cc:2272] T cbb15d4732f1472ea96078ec58ddade4 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.631186  6691 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
W20260709 12:25:19.631415 31540 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.631847 30271 tablet_replica.cc:333] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
W20260709 12:25:19.632079 31540 leader_election.cc:336] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.632650 30271 raft_consensus.cc:2243] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.632746 31540 leader_election.cc:304] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.631960  6691 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.633473  6666 raft_consensus.cc:2749] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:19.634498 30271 raft_consensus.cc:2272] T 70e01c7a1fa14a318bcfcf17308b0c63 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.636098 32080 leader_election.cc:336] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.636451 32080 leader_election.cc:304] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.638803 30271 tablet_replica.cc:333] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.638899  6691 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:19.639840 30271 raft_consensus.cc:2243] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.640506 30271 raft_consensus.cc:2272] T bfceb446d3434b4b8dad1af98ef2db39 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.641878  6696 raft_consensus.cc:2749] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:19.642361 31540 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.643317 30271 tablet_replica.cc:333] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.643463 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" is_pre_election: true
I20260709 12:25:19.644165 30271 raft_consensus.cc:2243] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.644117 32114 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 15.
I20260709 12:25:19.644915 30271 raft_consensus.cc:2272] T 46d2c7602ed046c6afb92739319e584c P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.646235 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.647332  6691 raft_consensus.cc:2804] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:19.647624  6691 raft_consensus.cc:493] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.647681 30271 tablet_replica.cc:333] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.647940  6691 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:19.648547 30271 raft_consensus.cc:2243] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.649639 30271 raft_consensus.cc:2272] T 1685dea95ca449998eaf8075418fda96 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.652283 30271 tablet_replica.cc:333] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.652743  6691 raft_consensus.cc:515] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.653450 30271 raft_consensus.cc:2243] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.654065 30271 raft_consensus.cc:2272] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.657076  6691 leader_election.cc:290] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Requested vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), e166c1cb41f04d55a85e6c0d7966e32e (127.29.143.196:35667)
I20260709 12:25:19.657286 32114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5303969e814b4481d74acd8c7997df" candidate_uuid: "8553a13b444649b9a19e5488aabaf1c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e166c1cb41f04d55a85e6c0d7966e32e"
W20260709 12:25:19.657691 32080 consensus_peers.cc:597] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:25:19.657852 32114 raft_consensus.cc:3060] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:19.658876 31540 leader_election.cc:336] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.661172 30271 tablet_replica.cc:333] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.662034 30271 raft_consensus.cc:2243] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.662642 30271 raft_consensus.cc:2272] T 21e357624c0f4e5f89de3446133ddb5c P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.665335 30271 tablet_replica.cc:333] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.666042 30271 raft_consensus.cc:2243] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.666604 30271 raft_consensus.cc:2272] T 91ffe6e1ad36492d95a9cf3251d2894c P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.666791 32114 raft_consensus.cc:2468] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8553a13b444649b9a19e5488aabaf1c5 in term 16.
I20260709 12:25:19.668736 31537 leader_election.cc:304] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8553a13b444649b9a19e5488aabaf1c5, e166c1cb41f04d55a85e6c0d7966e32e; no voters: b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.669198 30271 tablet_replica.cc:333] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
W20260709 12:25:19.669364 31537 raft_consensus.cc:2686] T 8b5303969e814b4481d74acd8c7997df P 8553a13b444649b9a19e5488aabaf1c5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:25:19.669598 32079 consensus_peers.cc:597] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.670066 30271 raft_consensus.cc:2243] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:25:19.670208 32079 consensus_peers.cc:597] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.671175 30271 raft_consensus.cc:2272] T bda3e60a745b4a24a244329f3c923858 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.674727 30271 tablet_replica.cc:333] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.675203 30271 raft_consensus.cc:2243] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:19.675406 31540 consensus_peers.cc:597] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:19.675879 30271 raft_consensus.cc:2272] T 97965a28958a4537ae9f58c98ca87319 P 8553a13b444649b9a19e5488aabaf1c5 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.677855 30271 tablet_replica.cc:333] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.678426 30271 raft_consensus.cc:2243] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.678874 30271 raft_consensus.cc:2272] T 5c09d681ba8545a397b540c3565c50ff P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.680627 30271 tablet_replica.cc:333] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.681226 30271 raft_consensus.cc:2243] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.681697 30271 raft_consensus.cc:2272] T e08d75cdb9c24b78bf644d1554c2c5fe P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.683590 30271 tablet_replica.cc:333] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.684087 30271 raft_consensus.cc:2243] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.684618 30271 raft_consensus.cc:2272] T 60738423610d43149226454d80d6b245 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.686419 30271 tablet_replica.cc:333] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.686986 30271 raft_consensus.cc:2243] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.687668 30271 pending_rounds.cc:70] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Trying to abort 1 pending ops.
I20260709 12:25:19.687880 30271 pending_rounds.cc:77] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305625270736736256 op_type: NO_OP noop_request { }
I20260709 12:25:19.688198 30271 raft_consensus.cc:2889] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:19.688495 30271 raft_consensus.cc:2272] T 68a65ccf8d5e42c1aa51a8761a850dd7 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.691145 30271 tablet_replica.cc:333] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.691669 30271 raft_consensus.cc:2243] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.692111 30271 raft_consensus.cc:2272] T f42c299f626148ba8af55613ab8e9bc4 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.693908 30271 tablet_replica.cc:333] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.694444 30271 raft_consensus.cc:2243] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.695254 30271 raft_consensus.cc:2272] T 5aa949305b1a42489bcc1e0b4287c6c3 P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.696985 30271 tablet_replica.cc:333] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.697504 30271 raft_consensus.cc:2243] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.697939 30271 raft_consensus.cc:2272] T 12a5ef370bb94f5abfccedf7e771d83c P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.700197 30271 tablet_replica.cc:333] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.700795 30271 raft_consensus.cc:2243] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.701314 30271 raft_consensus.cc:2272] T d385c04853e749af8fb00afe40a4a255 P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.703560 30271 tablet_replica.cc:333] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.704161 30271 raft_consensus.cc:2243] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.704612 30271 raft_consensus.cc:2272] T bca4f4ed71aa4cfd84010eb5f7ee80ea P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.706234 30271 tablet_replica.cc:333] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.706779 30271 raft_consensus.cc:2243] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.707547 30271 raft_consensus.cc:2272] T 46eaf930cd8a4253b8c4ad7982a44485 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.709367 30271 tablet_replica.cc:333] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.709884 30271 raft_consensus.cc:2243] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.710652 30271 raft_consensus.cc:2272] T d54aaf3e560149eca7c259e9a3b7e37e P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.712328 30271 tablet_replica.cc:333] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.712970 30271 raft_consensus.cc:2243] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.713745 30271 raft_consensus.cc:2272] T 341ae51396d44edeba0872b9567766e7 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.715551 30271 tablet_replica.cc:333] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.716058 30271 raft_consensus.cc:2243] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.716804 30271 raft_consensus.cc:2272] T f615aa4788f84d6fa066cd71bbdaeadb P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.718515 30271 tablet_replica.cc:333] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.718995  6701 raft_consensus.cc:493] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.719291 30271 raft_consensus.cc:2243] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.719988 30271 raft_consensus.cc:2272] T 19ad016bcdfe4c62a610fe4974bc52c2 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.719574  6701 raft_consensus.cc:515] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.721868  6701 leader_election.cc:290] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
W20260709 12:25:19.722570 32079 consensus_peers.cc:597] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.722762 30271 tablet_replica.cc:333] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.723584 30271 raft_consensus.cc:2243] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.724254 30271 raft_consensus.cc:2272] T dad6aaa667ee45cb985fe02da47448e3 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.726001 32080 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
W20260709 12:25:19.726647 32080 leader_election.cc:336] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.726655 30271 tablet_replica.cc:333] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.727074 32080 leader_election.cc:304] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.727604 30271 raft_consensus.cc:2243] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.728587  6701 raft_consensus.cc:2749] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.728832 30271 pending_rounds.cc:70] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Trying to abort 1 pending ops.
I20260709 12:25:19.729142 30271 pending_rounds.cc:77] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305625270286483456 op_type: NO_OP noop_request { }
I20260709 12:25:19.729413 30271 raft_consensus.cc:2889] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:19.729627 30271 raft_consensus.cc:2272] T 1ed13c6144834a9a9349865442585b12 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.730868 32079 consensus_peers.cc:597] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.732149 30271 tablet_replica.cc:333] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.732736 30271 raft_consensus.cc:2243] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.733352 30271 raft_consensus.cc:2272] T 987c407200734c78918f4e63b9c8f16f P 8553a13b444649b9a19e5488aabaf1c5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.735375 30271 tablet_replica.cc:333] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.735837 30271 raft_consensus.cc:2243] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.736721 30271 raft_consensus.cc:2272] T 825684763f5c4e2dbf3597dc5a24f7df P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.738626 30271 tablet_replica.cc:333] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.739146 30271 raft_consensus.cc:2243] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.739521 30271 raft_consensus.cc:2272] T 7d3e8b68142d4e34a867ce6d3a9fb56d P 8553a13b444649b9a19e5488aabaf1c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.741099 30271 tablet_replica.cc:333] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.741642 30271 raft_consensus.cc:2243] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.742072 30271 raft_consensus.cc:2272] T a899a61b216247dbbb91edb923e9eddf P 8553a13b444649b9a19e5488aabaf1c5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.745497  6696 raft_consensus.cc:493] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.745723 30271 tablet_replica.cc:333] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.746129  6696 raft_consensus.cc:515] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0065979e5b9a477f8abf064563426291" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 35273 } } peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.747694 30271 raft_consensus.cc:2243] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.748145  6696 leader_election.cc:290] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273), b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303)
I20260709 12:25:19.748558 30271 raft_consensus.cc:2272] T 8e64b21111bd41639226f8d37505e9a7 P 8553a13b444649b9a19e5488aabaf1c5 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.749074 32079 consensus_peers.cc:597] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.751437 30271 tablet_replica.cc:333] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.751550  6696 raft_consensus.cc:493] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.752610  6696 raft_consensus.cc:515] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.753029 30271 raft_consensus.cc:2243] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:25:19.753643 32080 leader_election.cc:336] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111)
I20260709 12:25:19.754186 30271 raft_consensus.cc:2272] T 08259dcf521e4914917a72febcb040d1 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.754256 32080 leader_election.cc:336] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.754527  6696 leader_election.cc:290] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.754817 32080 leader_election.cc:304] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 0065979e5b9a477f8abf064563426291, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.755587  6696 raft_consensus.cc:2749] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:19.757051 30271 tablet_replica.cc:333] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.757807 30271 raft_consensus.cc:2243] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:19.757798 32079 leader_election.cc:336] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:19.758554 30271 raft_consensus.cc:2272] T 076aa0801557438fb22bfc7b11769a33 P 8553a13b444649b9a19e5488aabaf1c5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.759599 32080 leader_election.cc:336] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
I20260709 12:25:19.760069 32080 leader_election.cc:304] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.760777  6696 raft_consensus.cc:2749] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:19.761317 30271 tablet_replica.cc:333] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.761881 30271 raft_consensus.cc:2243] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.762670 30271 raft_consensus.cc:2272] T 79f5f1e9d2894583bcc9bc45a5df0112 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.764423  6696 raft_consensus.cc:493] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b6bc3d9dbfb44e81b63071002a011f71)
I20260709 12:25:19.764837 30271 tablet_replica.cc:333] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.764868  6696 raft_consensus.cc:515] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b6bc3d9dbfb44e81b63071002a011f71" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40303 } } peers { permanent_uuid: "8553a13b444649b9a19e5488aabaf1c5" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 34217 } } peers { permanent_uuid: "e166c1cb41f04d55a85e6c0d7966e32e" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 35667 } attrs { promote: false } }
I20260709 12:25:19.765692 30271 raft_consensus.cc:2243] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.766297 30271 raft_consensus.cc:2272] T e0a95aee9cae4e239fa037efead078d5 P 8553a13b444649b9a19e5488aabaf1c5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:19.766978  6696 leader_election.cc:290] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303), 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217)
I20260709 12:25:19.768728 30271 tablet_replica.cc:333] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.769446 30271 raft_consensus.cc:2243] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.770035 30271 raft_consensus.cc:2272] T 27c769ef5464411f973f730390441710 P 8553a13b444649b9a19e5488aabaf1c5 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.770318 32080 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b6bc3d9dbfb44e81b63071002a011f71 (127.29.143.194:40303): Network error: Client connection negotiation failed: client connection to 127.29.143.194:40303: connect: Connection refused (error 111)
W20260709 12:25:19.771107 32079 leader_election.cc:336] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:19.771512 32079 leader_election.cc:304] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e166c1cb41f04d55a85e6c0d7966e32e; no voters: 8553a13b444649b9a19e5488aabaf1c5, b6bc3d9dbfb44e81b63071002a011f71
I20260709 12:25:19.772197  6696 raft_consensus.cc:2749] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:19.772739 30271 tablet_replica.cc:333] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.773307 30271 raft_consensus.cc:2243] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:19.774664 30271 raft_consensus.cc:2272] T b8f83500bdaf49a8ac53bb5ba49c3529 P 8553a13b444649b9a19e5488aabaf1c5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.778329 32079 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.779263 30271 tablet_replica.cc:333] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5: stopping tablet replica
I20260709 12:25:19.779824 30271 raft_consensus.cc:2243] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:19.780332 30271 raft_consensus.cc:2272] T c28624eba07742ab91e568bf551106a4 P 8553a13b444649b9a19e5488aabaf1c5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:19.910310 32080 consensus_peers.cc:597] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:19.927073 32079 consensus_peers.cc:597] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:34217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.934548 32079 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:34217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:19.958671 32080 consensus_peers.cc:597] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:19.963478 32080 consensus_peers.cc:597] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:25:19.990738 32079 consensus_peers.cc:597] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:34217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.046588 32080 consensus_peers.cc:597] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:25:20.059010 32079 consensus_peers.cc:597] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 8553a13b444649b9a19e5488aabaf1c5 (127.29.143.195:34217): Couldn't send request to peer 8553a13b444649b9a19e5488aabaf1c5. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:34217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:20.307780 32080 consensus_peers.cc:597] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e -> Peer 0065979e5b9a477f8abf064563426291 (127.29.143.193:35273): Couldn't send request to peer 0065979e5b9a477f8abf064563426291. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:35273: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:25:20.320580 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:25:20.421865 30271 tablet_server.cc:179] TabletServer@127.29.143.196:0 shutting down...
I20260709 12:25:20.462177 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:20.463284 30271 tablet_replica.cc:333] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.464344 30271 raft_consensus.cc:2243] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.465086 30271 raft_consensus.cc:2272] T 41d7370a77bc48eaaa344ded5091445b P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.468062 30271 tablet_replica.cc:333] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.468590 30271 raft_consensus.cc:2243] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.468968 30271 raft_consensus.cc:2272] T 68a65ccf8d5e42c1aa51a8761a850dd7 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.470827 30271 tablet_replica.cc:333] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.471290 30271 raft_consensus.cc:2243] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.471660 30271 raft_consensus.cc:2272] T e77a183300084f968171dcd68225d026 P e166c1cb41f04d55a85e6c0d7966e32e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.473572 30271 tablet_replica.cc:333] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.474211 30271 raft_consensus.cc:2243] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.474637 30271 raft_consensus.cc:2272] T d385c04853e749af8fb00afe40a4a255 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.476456 30271 tablet_replica.cc:333] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.476926 30271 raft_consensus.cc:2243] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.477519 30271 raft_consensus.cc:2272] T 91ffe6e1ad36492d95a9cf3251d2894c P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.479372 30271 tablet_replica.cc:333] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.479925 30271 raft_consensus.cc:2243] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.480618 30271 raft_consensus.cc:2272] T 97965a28958a4537ae9f58c98ca87319 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.482376 30271 tablet_replica.cc:333] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.483310 30271 raft_consensus.cc:2243] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.483852 30271 raft_consensus.cc:2272] T 70e01c7a1fa14a318bcfcf17308b0c63 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.485991 30271 tablet_replica.cc:333] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.486732 30271 raft_consensus.cc:2243] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.487385 30271 raft_consensus.cc:2272] T 19ad016bcdfe4c62a610fe4974bc52c2 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.489511 30271 tablet_replica.cc:333] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.490213 30271 raft_consensus.cc:2243] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.490978 30271 raft_consensus.cc:2272] T 9dd7b78d2ef1488c970505878e67c6ca P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.492730 30271 tablet_replica.cc:333] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.493259 30271 raft_consensus.cc:2243] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.493745 30271 raft_consensus.cc:2272] T 8b893ed7439d49939f7332cad4722c09 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.495468 30271 tablet_replica.cc:333] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.495977 30271 raft_consensus.cc:2243] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.496695 30271 raft_consensus.cc:2272] T 8e64b21111bd41639226f8d37505e9a7 P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.498404 30271 tablet_replica.cc:333] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.499002 30271 raft_consensus.cc:2243] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.499444 30271 raft_consensus.cc:2272] T 1685dea95ca449998eaf8075418fda96 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.501204 30271 tablet_replica.cc:333] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.501755 30271 raft_consensus.cc:2243] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.502285 30271 raft_consensus.cc:2272] T d54aaf3e560149eca7c259e9a3b7e37e P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.504169 30271 tablet_replica.cc:333] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.504731 30271 raft_consensus.cc:2243] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.505317 30271 raft_consensus.cc:2272] T 1ed13c6144834a9a9349865442585b12 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.507274 30271 tablet_replica.cc:333] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.507956 30271 raft_consensus.cc:2243] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.508740 30271 raft_consensus.cc:2272] T d4592ece2c344a3a8564f95da501ac46 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.510504 30271 tablet_replica.cc:333] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.511047 30271 raft_consensus.cc:2243] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.511752 30271 raft_consensus.cc:2272] T a1af086d1060473f980f0bed9af34c07 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.513588 30271 tablet_replica.cc:333] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.514110 30271 raft_consensus.cc:2243] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.514942 30271 raft_consensus.cc:2272] T 6c70f01b47774cc48e80fabd1ef37f2e P e166c1cb41f04d55a85e6c0d7966e32e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.516767 30271 tablet_replica.cc:333] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.517290 30271 raft_consensus.cc:2243] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.518090 30271 raft_consensus.cc:2272] T f97e5105626c48be9d1768855511628a P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.519942 30271 tablet_replica.cc:333] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.520557 30271 raft_consensus.cc:2243] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.521292 30271 raft_consensus.cc:2272] T bca4f4ed71aa4cfd84010eb5f7ee80ea P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.523023 30271 tablet_replica.cc:333] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.523555 30271 raft_consensus.cc:2243] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.524000 30271 raft_consensus.cc:2272] T 5aa949305b1a42489bcc1e0b4287c6c3 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.525614 30271 tablet_replica.cc:333] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.526140 30271 raft_consensus.cc:2243] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.526587 30271 raft_consensus.cc:2272] T 84c7d950f0b944939a3a24f8336687e2 P e166c1cb41f04d55a85e6c0d7966e32e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.528334 30271 tablet_replica.cc:333] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.528976 30271 raft_consensus.cc:2243] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.529803 30271 raft_consensus.cc:2272] T f42c299f626148ba8af55613ab8e9bc4 P e166c1cb41f04d55a85e6c0d7966e32e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.531733 30271 tablet_replica.cc:333] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.532738 30271 raft_consensus.cc:2243] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.533373 30271 raft_consensus.cc:2272] T 076aa0801557438fb22bfc7b11769a33 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.536613 30271 tablet_replica.cc:333] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.537143 30271 raft_consensus.cc:2243] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.537636 30271 raft_consensus.cc:2272] T 79f5f1e9d2894583bcc9bc45a5df0112 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.539458 30271 tablet_replica.cc:333] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.539974 30271 raft_consensus.cc:2243] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.540414 30271 raft_consensus.cc:2272] T 36ab0d648ab643bf8d74dbe6ee9503d8 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.542076 30271 tablet_replica.cc:333] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.542620 30271 raft_consensus.cc:2243] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.543143 30271 raft_consensus.cc:2272] T bb26db0e5b834d508281418291d5c108 P e166c1cb41f04d55a85e6c0d7966e32e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.544746 30271 tablet_replica.cc:333] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.545253 30271 raft_consensus.cc:2243] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.545693 30271 raft_consensus.cc:2272] T c4cfa84e581647da8d228ad20eb18205 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.547552 30271 tablet_replica.cc:333] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.548095 30271 raft_consensus.cc:2243] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.548816 30271 raft_consensus.cc:2272] T e0a95aee9cae4e239fa037efead078d5 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.550936 30271 tablet_replica.cc:333] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.551486 30271 raft_consensus.cc:2243] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.552093 30271 raft_consensus.cc:2272] T bda3e60a745b4a24a244329f3c923858 P e166c1cb41f04d55a85e6c0d7966e32e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.554373 30271 tablet_replica.cc:333] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.554967 30271 raft_consensus.cc:2243] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.555426 30271 raft_consensus.cc:2272] T 21e357624c0f4e5f89de3446133ddb5c P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.557245 30271 tablet_replica.cc:333] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.557698 30271 raft_consensus.cc:2243] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.558347 30271 raft_consensus.cc:2272] T bfceb446d3434b4b8dad1af98ef2db39 P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.560045 30271 tablet_replica.cc:333] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.560492 30271 raft_consensus.cc:2243] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.560973 30271 raft_consensus.cc:2272] T b8f83500bdaf49a8ac53bb5ba49c3529 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.562652 30271 tablet_replica.cc:333] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.563171 30271 raft_consensus.cc:2243] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.563879 30271 raft_consensus.cc:2272] T ab86e60df2854213b3c95a365e5f4807 P e166c1cb41f04d55a85e6c0d7966e32e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.565646 30271 tablet_replica.cc:333] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.566136 30271 raft_consensus.cc:2243] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.566563 30271 raft_consensus.cc:2272] T 519f567f2eff4e55b84df6d3edde6bc2 P e166c1cb41f04d55a85e6c0d7966e32e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.568303 30271 tablet_replica.cc:333] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.568744 30271 raft_consensus.cc:2243] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.569150 30271 raft_consensus.cc:2272] T 0650d5583d6f49e2aba22f8d696283ea P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.570883 30271 tablet_replica.cc:333] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.571331 30271 raft_consensus.cc:2243] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.571985 30271 raft_consensus.cc:2272] T 341ae51396d44edeba0872b9567766e7 P e166c1cb41f04d55a85e6c0d7966e32e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.574368 30271 tablet_replica.cc:333] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.574904 30271 raft_consensus.cc:2243] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.575366 30271 raft_consensus.cc:2272] T 8b5303969e814b4481d74acd8c7997df P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.577060 30271 tablet_replica.cc:333] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.577540 30271 raft_consensus.cc:2243] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.578011 30271 raft_consensus.cc:2272] T 7e61fb74a676405696e2d0e6b9027efe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.579998 30271 tablet_replica.cc:333] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.580425 30271 raft_consensus.cc:2243] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.581024 30271 raft_consensus.cc:2272] T 27c769ef5464411f973f730390441710 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.582911 30271 tablet_replica.cc:333] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.583432 30271 raft_consensus.cc:2243] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.584149 30271 raft_consensus.cc:2272] T 08259dcf521e4914917a72febcb040d1 P e166c1cb41f04d55a85e6c0d7966e32e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.586004 30271 tablet_replica.cc:333] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.586472 30271 raft_consensus.cc:2243] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.587157 30271 raft_consensus.cc:2272] T 2d39355c9d4d4e3b922b43b63d9f6ef6 P e166c1cb41f04d55a85e6c0d7966e32e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.588703 30271 tablet_replica.cc:333] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.589118 30271 raft_consensus.cc:2243] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.589804 30271 raft_consensus.cc:2272] T a899a61b216247dbbb91edb923e9eddf P e166c1cb41f04d55a85e6c0d7966e32e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.591583 30271 tablet_replica.cc:333] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.591990 30271 raft_consensus.cc:2243] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.592618 30271 raft_consensus.cc:2272] T 7d3e8b68142d4e34a867ce6d3a9fb56d P e166c1cb41f04d55a85e6c0d7966e32e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.594329 30271 tablet_replica.cc:333] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e: stopping tablet replica
I20260709 12:25:20.594830 30271 raft_consensus.cc:2243] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.595498 30271 raft_consensus.cc:2272] T e08d75cdb9c24b78bf644d1554c2c5fe P e166c1cb41f04d55a85e6c0d7966e32e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.720175 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.804327 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.864343 32079 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.935851 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.005839 32077 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.045898 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.107759 32080 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.245236 32078 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.849030 30271 tablet_server.cc:196] TabletServer@127.29.143.196:0 shutdown complete.
I20260709 12:25:21.952724 30271 master.cc:562] Master@127.29.143.254:45911 shutting down...
I20260709 12:25:21.996672 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.997562 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.997951 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 79dd877deb754ad9bbc3b169ee250de3: stopping tablet replica
I20260709 12:25:22.134451 30271 master.cc:584] Master@127.29.143.254:45911 shutdown complete.
I20260709 12:25:22.180140 30271 test_util.cc:182] -----------------------------------------------
I20260709 12:25:22.180367 30271 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599620637805-30271-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (241206 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:25:22.184065 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:44241
I20260709 12:25:22.185144 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.192803  6715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.192813  6714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.193326  6717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.194186 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:22.197100 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.197288 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.197479 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599922197457 us; error 0 us; skew 500 ppm
I20260709 12:25:22.198055 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.200517 30271 webserver.cc:533] Webserver started at http://127.29.143.254:44829/ using document root <none> and password file <none>
I20260709 12:25:22.201030 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.201236 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.201521 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.202899 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "1101d5c10fef41dc9a47c8a69646f4e9"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.207362 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:25:22.210953  6722 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.211879 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:25:22.212266 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "1101d5c10fef41dc9a47c8a69646f4e9"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.212647 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.235513 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.237170 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.278375 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:44241
I20260709 12:25:22.278491  6774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:44241 every 8 connection(s)
I20260709 12:25:22.282740  6775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.293169  6775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9: Bootstrap starting.
I20260709 12:25:22.297955  6775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.302205  6775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9: No bootstrap required, opened a new log
I20260709 12:25:22.304368  6775 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER }
I20260709 12:25:22.304823  6775 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.305045  6775 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1101d5c10fef41dc9a47c8a69646f4e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.305629  6775 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER }
I20260709 12:25:22.306092  6775 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:22.306293  6775 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:22.306589  6775 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.311823  6775 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER }
I20260709 12:25:22.312322  6775 leader_election.cc:304] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1101d5c10fef41dc9a47c8a69646f4e9; no voters: 
I20260709 12:25:22.313423  6775 leader_election.cc:290] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:22.313779  6778 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.315384  6778 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1101d5c10fef41dc9a47c8a69646f4e9, State: Running, Role: LEADER
I20260709 12:25:22.316115  6778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER }
I20260709 12:25:22.316432  6775 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:22.323552  6779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER } }
I20260709 12:25:22.323696  6780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1101d5c10fef41dc9a47c8a69646f4e9. Latest consensus state: current_term: 1 leader_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1101d5c10fef41dc9a47c8a69646f4e9" member_type: VOTER } }
I20260709 12:25:22.324579  6779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.324671  6780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:22.326550  6788 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:22.331516  6788 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:22.332775 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:22.340705  6788 catalog_manager.cc:1383] Generated new cluster ID: 51b65b5e5b54402fb00be333e289132a
I20260709 12:25:22.341102  6788 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:22.382222  6788 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:22.383509  6788 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:22.397768  6788 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9: Generated new TSK 0
I20260709 12:25:22.398591  6788 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:22.464282 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.471203  6796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.472222  6797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.473955  6799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.475571 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:22.477782 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.477986 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.478173 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599922478136 us; error 0 us; skew 500 ppm
I20260709 12:25:22.478814 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.481091 30271 webserver.cc:533] Webserver started at http://127.29.143.193:46015/ using document root <none> and password file <none>
I20260709 12:25:22.481557 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.481750 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.482016 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.483160 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "91e8bb7cfca34631a0d9c45d8b139301"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.487459 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:22.490741  6804 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.491524 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:22.491803 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "91e8bb7cfca34631a0d9c45d8b139301"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.492118 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.505033 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.506271 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.507799 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.509976 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.510206 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.510452 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.510651 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.552848 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:39751
I20260709 12:25:22.552960  6867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:39751 every 8 connection(s)
I20260709 12:25:22.558063 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.566377  6872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.567227  6873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.573369  6875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.573714  6868 heartbeater.cc:344] Connected to a master server at 127.29.143.254:44241
I20260709 12:25:22.574191  6868 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.574982 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:22.575042  6868 heartbeater.cc:507] Master 127.29.143.254:44241 requested a full tablet report, sending...
I20260709 12:25:22.577664  6739 ts_manager.cc:194] Registered new tserver with Master: 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:22.578436 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.578765 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.578974 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599922578955 us; error 0 us; skew 500 ppm
I20260709 12:25:22.579818 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.580228  6739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42152
I20260709 12:25:22.582633 30271 webserver.cc:533] Webserver started at http://127.29.143.194:44735/ using document root <none> and password file <none>
I20260709 12:25:22.583242 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.583436 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.583716 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.584864 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "d183b7afc3164213b30cb81edcc90c7d"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.589141 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:25:22.592613  6880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.593370 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:25:22.593724 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "d183b7afc3164213b30cb81edcc90c7d"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.594105 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.632889 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.634182 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.635735 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.638113 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.638365 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.638621 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.638866 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:25:22.681551 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:39331
I20260709 12:25:22.681599  6942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:39331 every 8 connection(s)
I20260709 12:25:22.686611 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.694250  6946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.698665  6947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.699343 30271 server_base.cc:1061] running on GCE node
W20260709 12:25:22.701766  6949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.702471  6943 heartbeater.cc:344] Connected to a master server at 127.29.143.254:44241
I20260709 12:25:22.702904  6943 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.702950 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.703313 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.703493 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599922703477 us; error 0 us; skew 500 ppm
I20260709 12:25:22.703822  6943 heartbeater.cc:507] Master 127.29.143.254:44241 requested a full tablet report, sending...
I20260709 12:25:22.704200 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.706050  6739 ts_manager.cc:194] Registered new tserver with Master: d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:22.707082 30271 webserver.cc:533] Webserver started at http://127.29.143.195:34531/ using document root <none> and password file <none>
I20260709 12:25:22.707728 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.707964 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.707957  6739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42162
I20260709 12:25:22.708515 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.709960 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.717078 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:25:22.720552  6954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.721364 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:22.721671 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.721966 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.737449 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.738646 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.740185 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.742455 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.742720 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.742985 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.743171 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.781760 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:40793
I20260709 12:25:22.781867  7017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:40793 every 8 connection(s)
I20260709 12:25:22.786645 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.793809  7021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.795670  7022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.798983 30271 server_base.cc:1061] running on GCE node
W20260709 12:25:22.798925  7024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.799211  7018 heartbeater.cc:344] Connected to a master server at 127.29.143.254:44241
I20260709 12:25:22.799894  7018 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.800577  7018 heartbeater.cc:507] Master 127.29.143.254:44241 requested a full tablet report, sending...
I20260709 12:25:22.801842 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.802248 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.802567 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599922802544 us; error 0 us; skew 500 ppm
I20260709 12:25:22.803498 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.803717  6739 ts_manager.cc:194] Registered new tserver with Master: 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:22.805827  6739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42170
I20260709 12:25:22.806512 30271 webserver.cc:533] Webserver started at http://127.29.143.196:36019/ using document root <none> and password file <none>
I20260709 12:25:22.807309 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.807530 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:22.807823 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:22.809055 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-3-root/instance:
uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.813948 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:22.817845  7029 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.818837 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:22.819185 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:22.819509 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.839895 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.842480 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.848076 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:22.850248 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:22.850517 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.850783 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:22.851158 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.894913 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.196:39137
I20260709 12:25:22.895036  7091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.196:39137 every 8 connection(s)
I20260709 12:25:22.909642  7092 heartbeater.cc:344] Connected to a master server at 127.29.143.254:44241
I20260709 12:25:22.910000  7092 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.910766  7092 heartbeater.cc:507] Master 127.29.143.254:44241 requested a full tablet report, sending...
I20260709 12:25:22.912882  6739 ts_manager.cc:194] Registered new tserver with Master: 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:22.913843 30271 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015224773s
I20260709 12:25:22.914474  6739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42178
I20260709 12:25:22.941844  6739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42180:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:25:23.184487  7057 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac83c19fd794ce0b286a09a261b6406 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:23.187243  7057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac83c19fd794ce0b286a09a261b6406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.191144  7056 tablet_service.cc:1511] Processing CreateTablet for tablet 9b534ea90b954a8aaa26488b181a5cd7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:23.192579  7056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b534ea90b954a8aaa26488b181a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.200201  7055 tablet_service.cc:1511] Processing CreateTablet for tablet 8b811e6cffc24cfdb05f8a591b81e5a7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:23.202028  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b811e6cffc24cfdb05f8a591b81e5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.206532  6832 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac83c19fd794ce0b286a09a261b6406 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:23.207978  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac83c19fd794ce0b286a09a261b6406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.212033  7054 tablet_service.cc:1511] Processing CreateTablet for tablet dfee8d38cdcf420886d30dfc614d2dcd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:23.212363  6831 tablet_service.cc:1511] Processing CreateTablet for tablet aa2b22be3870440ea4db26e751648dbb (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:23.213671  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee8d38cdcf420886d30dfc614d2dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.217175  7053 tablet_service.cc:1511] Processing CreateTablet for tablet 957994df5dd14b04a9ac6f7b24bd13dd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:23.218935  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957994df5dd14b04a9ac6f7b24bd13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.219050  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 9b534ea90b954a8aaa26488b181a5cd7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:23.213889  6831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2b22be3870440ea4db26e751648dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.221625  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b534ea90b954a8aaa26488b181a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.224128  7052 tablet_service.cc:1511] Processing CreateTablet for tablet af80e3d9967348169f8ab8bece79c333 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:23.225560  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af80e3d9967348169f8ab8bece79c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.228133  6829 tablet_service.cc:1511] Processing CreateTablet for tablet cd5451dbc9a6416781d842e1c7709a45 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:23.229574  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5451dbc9a6416781d842e1c7709a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.233233  6983 tablet_service.cc:1511] Processing CreateTablet for tablet aa2b22be3870440ea4db26e751648dbb (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:23.236662  6982 tablet_service.cc:1511] Processing CreateTablet for tablet 9b534ea90b954a8aaa26488b181a5cd7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:23.238312  6983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2b22be3870440ea4db26e751648dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.240726  6982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b534ea90b954a8aaa26488b181a5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.244357  6981 tablet_service.cc:1511] Processing CreateTablet for tablet 8b811e6cffc24cfdb05f8a591b81e5a7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:23.245826  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b811e6cffc24cfdb05f8a591b81e5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.253715  7051 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd28e008e3f4cc6b3a052fee4d4688c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:23.255378  7051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd28e008e3f4cc6b3a052fee4d4688c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.255928  6980 tablet_service.cc:1511] Processing CreateTablet for tablet cd5451dbc9a6416781d842e1c7709a45 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:23.257323  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5451dbc9a6416781d842e1c7709a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.260936  7050 tablet_service.cc:1511] Processing CreateTablet for tablet 3a2750742f4f4dceab13f4552a75ff9f (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:23.262320  7050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2750742f4f4dceab13f4552a75ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.263912  6979 tablet_service.cc:1511] Processing CreateTablet for tablet 957994df5dd14b04a9ac6f7b24bd13dd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:23.265313  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957994df5dd14b04a9ac6f7b24bd13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.272352  6977 tablet_service.cc:1511] Processing CreateTablet for tablet af80e3d9967348169f8ab8bece79c333 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:23.272706  7049 tablet_service.cc:1511] Processing CreateTablet for tablet f74d9ce0b448489aa3fb7ae932cca398 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:23.274086  6977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af80e3d9967348169f8ab8bece79c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.274614  7049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74d9ce0b448489aa3fb7ae932cca398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.280361  6976 tablet_service.cc:1511] Processing CreateTablet for tablet 75510e59268a4275bd685ff5b496ce33 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:23.280779  7048 tablet_service.cc:1511] Processing CreateTablet for tablet df5ab4fca4284754b2922f9348679d77 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:23.281793  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75510e59268a4275bd685ff5b496ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.282022  7048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5ab4fca4284754b2922f9348679d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.292320  6975 tablet_service.cc:1511] Processing CreateTablet for tablet 3a2750742f4f4dceab13f4552a75ff9f (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:23.293833  6975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2750742f4f4dceab13f4552a75ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.295056  6828 tablet_service.cc:1511] Processing CreateTablet for tablet dfee8d38cdcf420886d30dfc614d2dcd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:23.296504  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee8d38cdcf420886d30dfc614d2dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.296900  6974 tablet_service.cc:1511] Processing CreateTablet for tablet f74d9ce0b448489aa3fb7ae932cca398 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:23.300284  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1d3eff0cf142feb6edf343c482e453 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:23.302276  6974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74d9ce0b448489aa3fb7ae932cca398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.307592  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1d3eff0cf142feb6edf343c482e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.324947  6826 tablet_service.cc:1511] Processing CreateTablet for tablet 75510e59268a4275bd685ff5b496ce33 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:23.326450  6826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75510e59268a4275bd685ff5b496ce33. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:23.329129  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:23.330379  6827 tablet_service.cc:1511] Processing CreateTablet for tablet 957994df5dd14b04a9ac6f7b24bd13dd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:23.345582  6824 tablet_service.cc:1511] Processing CreateTablet for tablet 3a2750742f4f4dceab13f4552a75ff9f (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:23.347090  6827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 957994df5dd14b04a9ac6f7b24bd13dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.348869  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2750742f4f4dceab13f4552a75ff9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.351511  6825 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd28e008e3f4cc6b3a052fee4d4688c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:23.353461  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd28e008e3f4cc6b3a052fee4d4688c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.345860  6823 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1d3eff0cf142feb6edf343c482e453 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:23.383764  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1d3eff0cf142feb6edf343c482e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.384671  7048 tablet_service.cc:1511] Processing CreateTablet for tablet a96ad1dde254427db317a4daf42aaa96 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:23.386566  7048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96ad1dde254427db317a4daf42aaa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.424858  7055 tablet_service.cc:1511] Processing CreateTablet for tablet e93f31c1947a442ab8d8329061c6f3d4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:23.434489  7111 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:23.471796  7057 tablet_service.cc:1511] Processing CreateTablet for tablet 9448e5bc5adc4a0383825437ec1a466b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:23.469235  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f31c1947a442ab8d8329061c6f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.479872  6826 tablet_service.cc:1511] Processing CreateTablet for tablet df5ab4fca4284754b2922f9348679d77 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:23.481266  6826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5ab4fca4284754b2922f9348679d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.489647  7111 tablet_bootstrap.cc:654] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.491818  6824 tablet_service.cc:1511] Processing CreateTablet for tablet e93f31c1947a442ab8d8329061c6f3d4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:23.494222  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f31c1947a442ab8d8329061c6f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.504664  6908 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac83c19fd794ce0b286a09a261b6406 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:23.505230  6907 tablet_service.cc:1511] Processing CreateTablet for tablet aa2b22be3870440ea4db26e751648dbb (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:23.506138  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac83c19fd794ce0b286a09a261b6406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.506814  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2b22be3870440ea4db26e751648dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.507445  7112 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:23.512389  6906 tablet_service.cc:1511] Processing CreateTablet for tablet 8b811e6cffc24cfdb05f8a591b81e5a7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:23.513795  6906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b811e6cffc24cfdb05f8a591b81e5a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.517195  6905 tablet_service.cc:1511] Processing CreateTablet for tablet cd5451dbc9a6416781d842e1c7709a45 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:23.518702  7049 tablet_service.cc:1511] Processing CreateTablet for tablet e1944db928834f84aa29c6a0b169c353 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:23.519208  7050 tablet_service.cc:1511] Processing CreateTablet for tablet d085654055944f75b6657bc46c50ffad (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:23.518630  6905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5451dbc9a6416781d842e1c7709a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.521204  6977 tablet_service.cc:1511] Processing CreateTablet for tablet 712a0e1312454258ae9e75b931463c73 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:23.522476  6977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712a0e1312454258ae9e75b931463c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.519939  6980 tablet_service.cc:1511] Processing CreateTablet for tablet a96ad1dde254427db317a4daf42aaa96 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:23.523427  6904 tablet_service.cc:1511] Processing CreateTablet for tablet dfee8d38cdcf420886d30dfc614d2dcd (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:23.524822  6904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee8d38cdcf420886d30dfc614d2dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.527011  7057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9448e5bc5adc4a0383825437ec1a466b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.526804  6973 tablet_service.cc:1511] Processing CreateTablet for tablet e93f31c1947a442ab8d8329061c6f3d4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:23.532629  6903 tablet_service.cc:1511] Processing CreateTablet for tablet af80e3d9967348169f8ab8bece79c333 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:23.534134  6901 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd28e008e3f4cc6b3a052fee4d4688c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:23.491817  7052 tablet_service.cc:1511] Processing CreateTablet for tablet ab49fd7331d54059a88d037ef5ada96d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:23.535964  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab49fd7331d54059a88d037ef5ada96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.535912  6902 tablet_service.cc:1511] Processing CreateTablet for tablet 75510e59268a4275bd685ff5b496ce33 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:23.534503  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af80e3d9967348169f8ab8bece79c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.537727  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd28e008e3f4cc6b3a052fee4d4688c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.538359  6902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75510e59268a4275bd685ff5b496ce33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.539466  6974 tablet_service.cc:1511] Processing CreateTablet for tablet 9448e5bc5adc4a0383825437ec1a466b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:23.542176  6900 tablet_service.cc:1511] Processing CreateTablet for tablet f74d9ce0b448489aa3fb7ae932cca398 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:23.543882  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96ad1dde254427db317a4daf42aaa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.544379  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74d9ce0b448489aa3fb7ae932cca398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.544541  7049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1944db928834f84aa29c6a0b169c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.546239  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93f31c1947a442ab8d8329061c6f3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.534312  6828 tablet_service.cc:1511] Processing CreateTablet for tablet fca85df8d7a44f0a828ea763c94db545 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:23.558229  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca85df8d7a44f0a828ea763c94db545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.570827  7112 tablet_bootstrap.cc:654] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.572134  6899 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1d3eff0cf142feb6edf343c482e453 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:23.573585  6899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1d3eff0cf142feb6edf343c482e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.550549  7051 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0e0c62b350442fb08e7e7b97ab3322 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:23.587061  6974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9448e5bc5adc4a0383825437ec1a466b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.583491  6868 heartbeater.cc:499] Master 127.29.143.254:44241 was elected leader, sending a full tablet report...
I20260709 12:25:23.588863  7051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0e0c62b350442fb08e7e7b97ab3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.586701  7053 tablet_service.cc:1511] Processing CreateTablet for tablet d34b89b5da1b4f08a98b364573d20b49 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:23.591723  6981 tablet_service.cc:1511] Processing CreateTablet for tablet d085654055944f75b6657bc46c50ffad (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:23.615898  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085654055944f75b6657bc46c50ffad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.611325  7113 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:23.612475  6832 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1e963d9d640e3b4179db45fd20492 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:23.625319  6975 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0e0c62b350442fb08e7e7b97ab3322 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:23.626955  7113 tablet_bootstrap.cc:654] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.629000  6979 tablet_service.cc:1511] Processing CreateTablet for tablet 8c85168e3fee4b5682576a9098aebf37 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:23.630431  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34b89b5da1b4f08a98b364573d20b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.609587  6831 tablet_service.cc:1511] Processing CreateTablet for tablet 712a0e1312454258ae9e75b931463c73 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:23.631940  6831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712a0e1312454258ae9e75b931463c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.635522  7050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085654055944f75b6657bc46c50ffad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.619872  7048 tablet_service.cc:1511] Processing CreateTablet for tablet ae235a7a1ddc48aaa37f8297a848f365 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:23.644464  6975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0e0c62b350442fb08e7e7b97ab3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.644595  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1e963d9d640e3b4179db45fd20492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.645035  7048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae235a7a1ddc48aaa37f8297a848f365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.647009  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c85168e3fee4b5682576a9098aebf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.649205  6976 tablet_service.cc:1511] Processing CreateTablet for tablet ae235a7a1ddc48aaa37f8297a848f365 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:23.650568  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae235a7a1ddc48aaa37f8297a848f365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.587013  7054 tablet_service.cc:1511] Processing CreateTablet for tablet fca85df8d7a44f0a828ea763c94db545 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:23.582639  6983 tablet_service.cc:1511] Processing CreateTablet for tablet ab49fd7331d54059a88d037ef5ada96d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:23.671708  6906 tablet_service.cc:1511] Processing CreateTablet for tablet e1944db928834f84aa29c6a0b169c353 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:23.673471  6901 tablet_service.cc:1511] Processing CreateTablet for tablet df5ab4fca4284754b2922f9348679d77 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:23.672734  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 9448e5bc5adc4a0383825437ec1a466b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:23.603127  6982 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1e963d9d640e3b4179db45fd20492 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:23.691516  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5ab4fca4284754b2922f9348679d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.695168  6906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1944db928834f84aa29c6a0b169c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.697576  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9448e5bc5adc4a0383825437ec1a466b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.710973  6983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab49fd7331d54059a88d037ef5ada96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.711202  6943 heartbeater.cc:499] Master 127.29.143.254:44241 was elected leader, sending a full tablet report...
I20260709 12:25:23.718184  7112 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:23.721524  7112 ts_tablet_manager.cc:1403] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.214s	user 0.014s	sys 0.009s
I20260709 12:25:23.724812  7112 raft_consensus.cc:359] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:23.728235  7117 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:23.716220  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca85df8d7a44f0a828ea763c94db545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.741082  7056 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbe8b6f63694ab0af9a366a0096ef0b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:23.743290  6980 tablet_service.cc:1511] Processing CreateTablet for tablet 0a234f4a74e149dba651295b231774a6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:23.745342  6829 tablet_service.cc:1511] Processing CreateTablet for tablet e1944db928834f84aa29c6a0b169c353 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:23.746763  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1944db928834f84aa29c6a0b169c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.754719  6982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1e963d9d640e3b4179db45fd20492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.736490  6908 tablet_service.cc:1511] Processing CreateTablet for tablet a96ad1dde254427db317a4daf42aaa96 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:23.757217  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a96ad1dde254427db317a4daf42aaa96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.767307  7056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbe8b6f63694ab0af9a366a0096ef0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.767462  7113 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:23.768081  7113 ts_tablet_manager.cc:1403] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.011s
I20260709 12:25:23.775230  7051 tablet_service.cc:1511] Processing CreateTablet for tablet 83e59c66e8424098a23bcccb441ed821 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:23.776798  7051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e59c66e8424098a23bcccb441ed821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.779017  7111 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:23.779621  7111 ts_tablet_manager.cc:1403] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.346s	user 0.019s	sys 0.000s
I20260709 12:25:23.779868  6827 tablet_service.cc:1511] Processing CreateTablet for tablet d34b89b5da1b4f08a98b364573d20b49 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:23.781193  6827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34b89b5da1b4f08a98b364573d20b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.783586  6907 tablet_service.cc:1511] Processing CreateTablet for tablet 712a0e1312454258ae9e75b931463c73 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:23.783741  6899 tablet_service.cc:1511] Processing CreateTablet for tablet fca85df8d7a44f0a828ea763c94db545 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:23.785408  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712a0e1312454258ae9e75b931463c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.785204  6902 tablet_service.cc:1511] Processing CreateTablet for tablet ab49fd7331d54059a88d037ef5ada96d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:23.787653  7113 raft_consensus.cc:359] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:23.788424  7113 raft_consensus.cc:385] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.788717  7113 raft_consensus.cc:740] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.790410  7113 consensus_queue.cc:260] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:23.793169  7052 tablet_service.cc:1511] Processing CreateTablet for tablet 0a234f4a74e149dba651295b231774a6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:23.803095  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a234f4a74e149dba651295b231774a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.805665  6902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab49fd7331d54059a88d037ef5ada96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.730997  7112 raft_consensus.cc:385] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.808314  7112 raft_consensus.cc:740] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.808741  7018 heartbeater.cc:499] Master 127.29.143.254:44241 was elected leader, sending a full tablet report...
I20260709 12:25:23.809545  7112 consensus_queue.cc:260] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:23.819550  6976 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:23.820901  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.827093  7111 raft_consensus.cc:359] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:23.828039  7111 raft_consensus.cc:385] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:23.828363  7111 raft_consensus.cc:740] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:23.833782  6900 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1e963d9d640e3b4179db45fd20492 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:23.834867  6899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca85df8d7a44f0a828ea763c94db545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.837479  7053 tablet_service.cc:1511] Processing CreateTablet for tablet 8f24fa29e8f341e6919b603667ee2245 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:23.754120  6904 tablet_service.cc:1511] Processing CreateTablet for tablet d34b89b5da1b4f08a98b364573d20b49 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:23.838860  6824 tablet_service.cc:1511] Processing CreateTablet for tablet 8c85168e3fee4b5682576a9098aebf37 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:23.838917  7111 consensus_queue.cc:260] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:23.840508  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c85168e3fee4b5682576a9098aebf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.842357  7113 ts_tablet_manager.cc:1434] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:25:23.843497  7113 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:23.850075  7113 tablet_bootstrap.cc:654] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.855048  7092 heartbeater.cc:499] Master 127.29.143.254:44241 was elected leader, sending a full tablet report...
I20260709 12:25:23.863909  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 83e59c66e8424098a23bcccb441ed821 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:23.865351  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e59c66e8424098a23bcccb441ed821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.743378  6823 tablet_service.cc:1511] Processing CreateTablet for tablet d085654055944f75b6657bc46c50ffad (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:23.894124  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d085654055944f75b6657bc46c50ffad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.872099  7111 ts_tablet_manager.cc:1434] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.006s
I20260709 12:25:23.896880  7111 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:23.897316  6981 tablet_service.cc:1511] Processing CreateTablet for tablet 87bd67d607704cc6a801ef7ecc2fa2b3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:23.879948  6832 tablet_service.cc:1511] Processing CreateTablet for tablet 83e59c66e8424098a23bcccb441ed821 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:23.880741  6828 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbe8b6f63694ab0af9a366a0096ef0b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:23.823504  6825 tablet_service.cc:1511] Processing CreateTablet for tablet ae235a7a1ddc48aaa37f8297a848f365 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:23.882829  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a234f4a74e149dba651295b231774a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.882654  6976 tablet_service.cc:1511] Processing CreateTablet for tablet 8f24fa29e8f341e6919b603667ee2245 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:23.889509  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1e963d9d640e3b4179db45fd20492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.892221  6826 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:23.892416  6905 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0e0c62b350442fb08e7e7b97ab3322 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:23.883862  7055 tablet_service.cc:1511] Processing CreateTablet for tablet ed2255b163114a85a8a2aa5394891f9e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:23.907308  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbe8b6f63694ab0af9a366a0096ef0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:23.914333  7093 tablet.cc:2406] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:23.915467  7117 tablet_bootstrap.cc:654] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.955192  6904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34b89b5da1b4f08a98b364573d20b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.958997  6905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0e0c62b350442fb08e7e7b97ab3322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.959466  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bd67d607704cc6a801ef7ecc2fa2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.962963  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f24fa29e8f341e6919b603667ee2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.963110  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e59c66e8424098a23bcccb441ed821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.968309  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2255b163114a85a8a2aa5394891f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.963214  6829 tablet_service.cc:1511] Processing CreateTablet for tablet 87bd67d607704cc6a801ef7ecc2fa2b3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:23.973773  7111 tablet_bootstrap.cc:654] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:23.976771  6907 tablet_service.cc:1511] Processing CreateTablet for tablet 0a234f4a74e149dba651295b231774a6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:23.978132  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a234f4a74e149dba651295b231774a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.981925  7112 ts_tablet_manager.cc:1434] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.260s	user 0.009s	sys 0.000s
I20260709 12:25:23.983142  6979 tablet_service.cc:1511] Processing CreateTablet for tablet 4a46d9ac5bf4436ebd73557d3bf268d3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:23.985390  6908 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:23.986733  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.987793  6906 tablet_service.cc:1511] Processing CreateTablet for tablet 7bbe8b6f63694ab0af9a366a0096ef0b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:23.989068  6906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bbe8b6f63694ab0af9a366a0096ef0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.919199  6903 tablet_service.cc:1511] Processing CreateTablet for tablet 8c85168e3fee4b5682576a9098aebf37 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:23.994625  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c85168e3fee4b5682576a9098aebf37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:23.997277  7113 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:23.997833  7113 ts_tablet_manager.cc:1403] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.020s
I20260709 12:25:23.999205  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f24fa29e8f341e6919b603667ee2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.001185  7113 raft_consensus.cc:359] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.001994  7113 raft_consensus.cc:385] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.002287  7113 raft_consensus.cc:740] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.003165  7120 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.003695  7120 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.003309  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a46d9ac5bf4436ebd73557d3bf268d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.007916  7120 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:24.039721  6826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6dcc5bfa4141c08fdff7d85ee1bea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.041500  7119 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.042016  7119 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:24.055838  7119 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:24.083854  6902 tablet_service.cc:1511] Processing CreateTablet for tablet 8f24fa29e8f341e6919b603667ee2245 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:24.085399  6902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f24fa29e8f341e6919b603667ee2245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.050499  7113 consensus_queue.cc:260] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.088126  6899 tablet_service.cc:1511] Processing CreateTablet for tablet 87bd67d607704cc6a801ef7ecc2fa2b3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:24.088900  7113 ts_tablet_manager.cc:1434] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.003s
I20260709 12:25:24.089417  6899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bd67d607704cc6a801ef7ecc2fa2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.090029  7113 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:24.101372  6830 tablet_service.cc:1511] Processing CreateTablet for tablet ed2255b163114a85a8a2aa5394891f9e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:24.103521  7112 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:24.118733  6824 tablet_service.cc:1511] Processing CreateTablet for tablet 4a46d9ac5bf4436ebd73557d3bf268d3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:24.128453  7111 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:24.129045  7111 ts_tablet_manager.cc:1403] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.233s	user 0.012s	sys 0.013s
I20260709 12:25:24.128513  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2255b163114a85a8a2aa5394891f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.132865  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87bd67d607704cc6a801ef7ecc2fa2b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.132593  7111 raft_consensus.cc:359] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.133013  6980 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad9396234554969a1f5fc355e659c5a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:24.133483  7111 raft_consensus.cc:385] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.133960  7111 raft_consensus.cc:740] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.134326  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad9396234554969a1f5fc355e659c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.135039  7111 consensus_queue.cc:260] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.138069  7118 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.142278  7112 tablet_bootstrap.cc:654] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.142911  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae235a7a1ddc48aaa37f8297a848f365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.150069  6827 tablet_service.cc:1511] Processing CreateTablet for tablet ef29f51530fd4a5e872b7df967e9aa9a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:24.155900  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:24.166502  6827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef29f51530fd4a5e872b7df967e9aa9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.162956  7118 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:24.174155  7118 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:24.174979  7053 tablet_service.cc:1511] Processing CreateTablet for tablet 4a46d9ac5bf4436ebd73557d3bf268d3 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:24.175882  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a46d9ac5bf4436ebd73557d3bf268d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.176379  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a46d9ac5bf4436ebd73557d3bf268d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:24.179355  7032 leader_election.cc:343] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.201215  6976 tablet_service.cc:1511] Processing CreateTablet for tablet ef29f51530fd4a5e872b7df967e9aa9a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:24.201241  6823 tablet_service.cc:1511] Processing CreateTablet for tablet de46948cdeaa436392d55477ede3126c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:24.202924  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef29f51530fd4a5e872b7df967e9aa9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.202951  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de46948cdeaa436392d55477ede3126c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.207894  7055 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad9396234554969a1f5fc355e659c5a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:24.208643  7054 tablet_service.cc:1511] Processing CreateTablet for tablet de46948cdeaa436392d55477ede3126c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:24.209240  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad9396234554969a1f5fc355e659c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.209964  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de46948cdeaa436392d55477ede3126c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.229174  6979 tablet_service.cc:1511] Processing CreateTablet for tablet b5e75070838e424ca6c903634ffb3bf7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:24.230852  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e75070838e424ca6c903634ffb3bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.232654  7113 tablet_bootstrap.cc:654] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.235780  7111 ts_tablet_manager.cc:1434] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.000s
I20260709 12:25:24.242066  7111 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:24.250902  6900 tablet_service.cc:1511] Processing CreateTablet for tablet ed2255b163114a85a8a2aa5394891f9e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:24.252367  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2255b163114a85a8a2aa5394891f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.244596  6908 tablet_service.cc:1511] Processing CreateTablet for tablet de46948cdeaa436392d55477ede3126c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:24.255728  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de46948cdeaa436392d55477ede3126c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.259721  6899 tablet_service.cc:1511] Processing CreateTablet for tablet ef29f51530fd4a5e872b7df967e9aa9a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:24.261584  6899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef29f51530fd4a5e872b7df967e9aa9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.286499  6903 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:24.287132  7052 tablet_service.cc:1511] Processing CreateTablet for tablet b5e75070838e424ca6c903634ffb3bf7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:24.287919  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.288414  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e75070838e424ca6c903634ffb3bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.289011  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
W20260709 12:25:24.290704  6806 leader_election.cc:343] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.288441  7117 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:24.291740  7117 ts_tablet_manager.cc:1403] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.564s	user 0.024s	sys 0.023s
I20260709 12:25:24.293959  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:24.295109  6901 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad9396234554969a1f5fc355e659c5a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:24.296556  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad9396234554969a1f5fc355e659c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.298993  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:24.295027  7117 raft_consensus.cc:359] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:24.300638  7030 leader_election.cc:343] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.300859  7117 raft_consensus.cc:385] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.301112  7030 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.302362  7120 raft_consensus.cc:2749] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.306197  7111 tablet_bootstrap.cc:654] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.301314  7117 raft_consensus.cc:740] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.315438  7118 raft_consensus.cc:493] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.318774  7112 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:24.318418  7118 raft_consensus.cc:515] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.319296  7112 ts_tablet_manager.cc:1403] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.012s
I20260709 12:25:24.322796  7118 leader_election.cc:290] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:24.325300  7117 consensus_queue.cc:260] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.335316  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.339713  7056 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:24.341038  7056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8fb6a484de42a9b96c3cc5d38ca2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.343425  6825 tablet_service.cc:1511] Processing CreateTablet for tablet b5e75070838e424ca6c903634ffb3bf7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:25:24.346899  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:24.347069  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:24.347711  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:24.348367  6993 raft_consensus.cc:2468] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:24.322350  7112 raft_consensus.cc:359] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.348891  7112 raft_consensus.cc:385] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.349246  7112 raft_consensus.cc:740] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.349809  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:24.351397  6957 leader_election.cc:343] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.354128  6907 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:25:24.355250  6956 leader_election.cc:343] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.344705  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e75070838e424ca6c903634ffb3bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.361063  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.370889  6832 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:24.372579  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.378402  6976 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:24.379843  6976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9e2b4d7b24e86bb0226e3c0c8a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.393167  7112 consensus_queue.cc:260] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.394590  6805 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:24.397013  7119 raft_consensus.cc:493] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.399276  7119 raft_consensus.cc:515] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.394968  6824 tablet_service.cc:1511] Processing CreateTablet for tablet 2250baee2f594167a763ebb190c6ef85 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:24.400717  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2250baee2f594167a763ebb190c6ef85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.400662  6900 tablet_service.cc:1511] Processing CreateTablet for tablet 2250baee2f594167a763ebb190c6ef85 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:24.402060  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2250baee2f594167a763ebb190c6ef85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.403241  7119 leader_election.cc:290] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:24.403788  7119 raft_consensus.cc:2804] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:24.404141  7119 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.404472  7119 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.417184  6981 tablet_service.cc:1511] Processing CreateTablet for tablet 78ec6be90d254ce1874ea9379f54f53a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:24.418625  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ec6be90d254ce1874ea9379f54f53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.427294  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:24.427563  7055 tablet_service.cc:1511] Processing CreateTablet for tablet 2250baee2f594167a763ebb190c6ef85 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:25:24.428846  6807 leader_election.cc:343] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.432813  7113 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:24.433342  7113 ts_tablet_manager.cc:1403] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.344s	user 0.024s	sys 0.006s
I20260709 12:25:24.437966  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2250baee2f594167a763ebb190c6ef85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.439043  7113 raft_consensus.cc:359] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.439873  7113 raft_consensus.cc:385] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.440227  7113 raft_consensus.cc:740] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.441170  7113 consensus_queue.cc:260] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.446358  7120 raft_consensus.cc:493] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.446905  7120 raft_consensus.cc:515] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.448939  7120 leader_election.cc:290] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:24.449685  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:24.450001  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:24.450814  7117 ts_tablet_manager.cc:1434] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.014s
W20260709 12:25:24.451180  7030 leader_election.cc:343] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:24.453047  7032 leader_election.cc:343] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.454388  7112 ts_tablet_manager.cc:1434] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.135s	user 0.005s	sys 0.012s
I20260709 12:25:24.455701  7032 leader_election.cc:304] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.457295  7112 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:24.462754  7052 tablet_service.cc:1511] Processing CreateTablet for tablet 78ec6be90d254ce1874ea9379f54f53a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:25:24.445838  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 50557.1us
I20260709 12:25:24.464787  7117 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:24.464198  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ec6be90d254ce1874ea9379f54f53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.464500  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:24.465025  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:24.471369  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:24.473235  6955 leader_election.cc:343] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.473501  6823 tablet_service.cc:1511] Processing CreateTablet for tablet 78ec6be90d254ce1874ea9379f54f53a (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:24.473794  6907 tablet_service.cc:1511] Processing CreateTablet for tablet e465e32dc8914014a33a2237e61a82d5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:24.474901  6823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ec6be90d254ce1874ea9379f54f53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.473769  6955 leader_election.cc:304] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.466022  7120 raft_consensus.cc:2749] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.475617  7118 raft_consensus.cc:2749] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.480473  7111 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:24.481055  7111 ts_tablet_manager.cc:1403] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.239s	user 0.010s	sys 0.009s
W20260709 12:25:24.474066  6805 leader_election.cc:343] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.490712  6805 leader_election.cc:304] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.491859  7113 ts_tablet_manager.cc:1434] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:25:24.492333  7142 raft_consensus.cc:2749] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.499056  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e465e32dc8914014a33a2237e61a82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.498238  6979 tablet_service.cc:1511] Processing CreateTablet for tablet e465e32dc8914014a33a2237e61a82d5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:24.500782  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e465e32dc8914014a33a2237e61a82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.504794  7053 tablet_service.cc:1511] Processing CreateTablet for tablet e465e32dc8914014a33a2237e61a82d5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:24.506121  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e465e32dc8914014a33a2237e61a82d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.463596  7119 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:24.492998  7113 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:24.507828  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 939129fdb05c4c798051c85011070991 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:24.509171  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939129fdb05c4c798051c85011070991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.510341  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:24.511610  6843 raft_consensus.cc:2393] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
W20260709 12:25:24.512574  6806 leader_election.cc:343] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.513346  7139 raft_consensus.cc:493] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.513864  6828 tablet_service.cc:1511] Processing CreateTablet for tablet e330099c2e664276a6db9bfa41dd79e4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:24.513875  7139 raft_consensus.cc:515] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.514485  6955 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:24.515403  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e330099c2e664276a6db9bfa41dd79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.516116  7118 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.519091  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:24.525825  6900 tablet_service.cc:1511] Processing CreateTablet for tablet 939129fdb05c4c798051c85011070991 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:24.526117  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 939129fdb05c4c798051c85011070991 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:24.526180  7111 raft_consensus.cc:359] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.527101  7111 raft_consensus.cc:385] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.527247  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939129fdb05c4c798051c85011070991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.527415  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 939129fdb05c4c798051c85011070991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.523236  7139 leader_election.cc:290] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:24.534840  7112 tablet_bootstrap.cc:654] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.527457  7111 raft_consensus.cc:740] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.545790  6980 tablet_service.cc:1511] Processing CreateTablet for tablet 5c661acabb704e839938f81b5474853d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:24.547269  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c661acabb704e839938f81b5474853d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.547607  7113 tablet_bootstrap.cc:654] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.548062  7118 raft_consensus.cc:2749] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.522832  7119 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:24.557614  7111 consensus_queue.cc:260] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.561240  6993 raft_consensus.cc:2468] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:24.563149  6805 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:24.564070  7142 raft_consensus.cc:2804] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:24.564512  7142 raft_consensus.cc:697] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:24.565392  7142 consensus_queue.cc:237] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:24.573331  7117 tablet_bootstrap.cc:654] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.585785  7056 tablet_service.cc:1511] Processing CreateTablet for tablet e330099c2e664276a6db9bfa41dd79e4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:24.587186  7056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e330099c2e664276a6db9bfa41dd79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.592381  7111 ts_tablet_manager.cc:1434] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 12:25:24.593060  7055 tablet_service.cc:1511] Processing CreateTablet for tablet 5c661acabb704e839938f81b5474853d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:24.599637  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c661acabb704e839938f81b5474853d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.605584  7111 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:24.607419  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 5c661acabb704e839938f81b5474853d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:24.608765  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c661acabb704e839938f81b5474853d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.618474  6739 catalog_manager.cc:5697] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:24.625452  6981 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14f3d8aa30470eba2fcf88fba00745 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:24.627007  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14f3d8aa30470eba2fcf88fba00745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.634433  7112 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:24.635025  7112 ts_tablet_manager.cc:1403] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.007s
I20260709 12:25:24.640161  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:24.638165  7112 raft_consensus.cc:359] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:24.641714  6881 leader_election.cc:343] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.645779  7054 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14f3d8aa30470eba2fcf88fba00745 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:24.647114  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14f3d8aa30470eba2fcf88fba00745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.643414  7112 raft_consensus.cc:385] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.648420  7112 raft_consensus.cc:740] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.661201  7113 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:24.661805  7113 ts_tablet_manager.cc:1403] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.009s
I20260709 12:25:24.661636  6907 tablet_service.cc:1511] Processing CreateTablet for tablet e330099c2e664276a6db9bfa41dd79e4 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:24.663044  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e330099c2e664276a6db9bfa41dd79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.664177  6981 tablet_service.cc:1511] Processing CreateTablet for tablet dea4f98636ae4352bed12ff04f780dc5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:24.665541  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea4f98636ae4352bed12ff04f780dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.664983  7113 raft_consensus.cc:359] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.666358  7113 raft_consensus.cc:385] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.666775  7113 raft_consensus.cc:740] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.667840  7112 consensus_queue.cc:260] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.670075  7112 ts_tablet_manager.cc:1434] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 12:25:24.671154  7112 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:24.672219  7111 tablet_bootstrap.cc:654] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.672293  7052 tablet_service.cc:1511] Processing CreateTablet for tablet b4474482b286401ba6a66908093c0af1 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:24.673870  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4474482b286401ba6a66908093c0af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.680678  7113 consensus_queue.cc:260] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.681679  6901 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14f3d8aa30470eba2fcf88fba00745 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:24.684015  7113 ts_tablet_manager.cc:1434] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:25:24.683686  6830 tablet_service.cc:1511] Processing CreateTablet for tablet dea4f98636ae4352bed12ff04f780dc5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:24.685527  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea4f98636ae4352bed12ff04f780dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.687685  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14f3d8aa30470eba2fcf88fba00745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.690060  7113 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:24.708065  7112 tablet_bootstrap.cc:654] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.716202  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:24.716413  6825 tablet_service.cc:1511] Processing CreateTablet for tablet b4474482b286401ba6a66908093c0af1 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:24.717792  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4474482b286401ba6a66908093c0af1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:24.717941  6882 leader_election.cc:343] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.726890  6882 leader_election.cc:304] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:24.727867  7139 raft_consensus.cc:2749] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.734005  6907 tablet_service.cc:1511] Processing CreateTablet for tablet dea4f98636ae4352bed12ff04f780dc5 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:24.735602  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea4f98636ae4352bed12ff04f780dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.744051  6900 tablet_service.cc:1511] Processing CreateTablet for tablet b4474482b286401ba6a66908093c0af1 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:24.751268  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4474482b286401ba6a66908093c0af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.763443  7113 tablet_bootstrap.cc:654] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.768587  7054 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae7f3dde5214382bea50b9b700d4ced (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:24.769157  7111 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:24.769701  7111 ts_tablet_manager.cc:1403] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.014s
I20260709 12:25:24.769989  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae7f3dde5214382bea50b9b700d4ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.770910  6901 tablet_service.cc:1511] Processing CreateTablet for tablet ad8f7290a19046fba7ff4bf9acad43b2 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:24.772202  7117 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:24.772843  7117 ts_tablet_manager.cc:1403] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.308s	user 0.014s	sys 0.023s
I20260709 12:25:24.772915  7111 raft_consensus.cc:359] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.772264  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8f7290a19046fba7ff4bf9acad43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.773756  7111 raft_consensus.cc:385] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.774134  7111 raft_consensus.cc:740] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.774938  7111 consensus_queue.cc:260] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.775602  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae7f3dde5214382bea50b9b700d4ced (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:24.776923  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae7f3dde5214382bea50b9b700d4ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.777045  6981 tablet_service.cc:1511] Processing CreateTablet for tablet ad8f7290a19046fba7ff4bf9acad43b2 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:24.778335  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8f7290a19046fba7ff4bf9acad43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.780236  7053 tablet_service.cc:1511] Processing CreateTablet for tablet ad8f7290a19046fba7ff4bf9acad43b2 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:24.781508  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8f7290a19046fba7ff4bf9acad43b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.782162  7117 raft_consensus.cc:359] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.782994  7117 raft_consensus.cc:385] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.783283  7117 raft_consensus.cc:740] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.785049  7111 ts_tablet_manager.cc:1434] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:25:24.795145  7112 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:24.795873  7112 ts_tablet_manager.cc:1403] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.125s	user 0.035s	sys 0.007s
I20260709 12:25:24.796111  6830 tablet_service.cc:1511] Processing CreateTablet for tablet f43ba15ae68f4e60954a666740ae7ec7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:24.799371  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43ba15ae68f4e60954a666740ae7ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.799474  6825 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae7f3dde5214382bea50b9b700d4ced (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:24.800870  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae7f3dde5214382bea50b9b700d4ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.800803  6908 tablet_service.cc:1511] Processing CreateTablet for tablet f43ba15ae68f4e60954a666740ae7ec7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:24.802201  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43ba15ae68f4e60954a666740ae7ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.812803  7112 raft_consensus.cc:359] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.813796  7112 raft_consensus.cc:385] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.814100  7112 raft_consensus.cc:740] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.821105  7118 raft_consensus.cc:493] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.821604  6979 tablet_service.cc:1511] Processing CreateTablet for tablet f43ba15ae68f4e60954a666740ae7ec7 (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:24.823119  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43ba15ae68f4e60954a666740ae7ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.824364  7055 tablet_service.cc:1511] Processing CreateTablet for tablet c924f3222be749da91d981faff44dc5e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:24.825806  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c924f3222be749da91d981faff44dc5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.821652  7118 raft_consensus.cc:515] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:24.815034  7117 consensus_queue.cc:260] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.830132  7118 leader_election.cc:290] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:24.831894  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:24.833577  6955 leader_election.cc:343] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.819803  7111 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:24.835414  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:24.836846  6957 leader_election.cc:343] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.837288  6957 leader_election.cc:304] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.832165  7117 ts_tablet_manager.cc:1434] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 12:25:24.841900  6828 tablet_service.cc:1511] Processing CreateTablet for tablet c924f3222be749da91d981faff44dc5e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:24.847512  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c924f3222be749da91d981faff44dc5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.837814  7118 raft_consensus.cc:493] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.848908  7118 raft_consensus.cc:515] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.854518  7117 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:24.870100  7118 leader_election.cc:290] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:24.870795  7118 raft_consensus.cc:2749] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.870609  6900 tablet_service.cc:1511] Processing CreateTablet for tablet c924f3222be749da91d981faff44dc5e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:24.871448  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:24.871989  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c924f3222be749da91d981faff44dc5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:24.872874  6956 leader_election.cc:343] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:24.892861  6957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 56050.1us
I20260709 12:25:24.899438  7111 tablet_bootstrap.cc:654] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.901626  7117 tablet_bootstrap.cc:654] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.902971  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:24.905093  6979 tablet_service.cc:1511] Processing CreateTablet for tablet da57db9ef59345a2a1467f6952f3364d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:24.907718  6901 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9697377f5245aea57a49232473283e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:24.910321  6901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9697377f5245aea57a49232473283e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.913244  6979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da57db9ef59345a2a1467f6952f3364d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.916725  7113 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:24.917253  7113 ts_tablet_manager.cc:1403] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.001s
I20260709 12:25:24.921732  7113 raft_consensus.cc:359] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.922452  7113 raft_consensus.cc:385] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.922765  7113 raft_consensus.cc:740] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.923449  7113 consensus_queue.cc:260] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.907618  7054 tablet_service.cc:1511] Processing CreateTablet for tablet da57db9ef59345a2a1467f6952f3364d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:24.924373  7053 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9697377f5245aea57a49232473283e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:24.937597  7054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da57db9ef59345a2a1467f6952f3364d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.939076  7120 raft_consensus.cc:493] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.939293  6832 tablet_service.cc:1511] Processing CreateTablet for tablet de6a6075ba174637ba0ca8a688bcaafe (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:24.939801  7120 raft_consensus.cc:515] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.940627  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a6075ba174637ba0ca8a688bcaafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.943754  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:24.944589  6918 raft_consensus.cc:2468] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:24.946269  7032 leader_election.cc:304] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:24.886844  7112 consensus_queue.cc:260] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:24.946621  7053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9697377f5245aea57a49232473283e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.948529  6973 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9697377f5245aea57a49232473283e (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:25:24.949391  6957 leader_election.cc:343] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:24.950153  7120 leader_election.cc:290] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:24.963855  7120 raft_consensus.cc:2804] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:24.968693  7120 raft_consensus.cc:493] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.969548  6973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9697377f5245aea57a49232473283e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.971931  7120 raft_consensus.cc:3060] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.963454  6957 leader_election.cc:304] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:24.980815  6908 tablet_service.cc:1511] Processing CreateTablet for tablet de6a6075ba174637ba0ca8a688bcaafe (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:24.981637  7156 raft_consensus.cc:2749] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:24.982316  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a6075ba174637ba0ca8a688bcaafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.983485  6981 tablet_service.cc:1511] Processing CreateTablet for tablet de6a6075ba174637ba0ca8a688bcaafe (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:24.984829  6981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6a6075ba174637ba0ca8a688bcaafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.985952  6900 tablet_service.cc:1511] Processing CreateTablet for tablet a9623b1b1de04219ac9d959598fc006c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:24.987289  6900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9623b1b1de04219ac9d959598fc006c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.988819  7117 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:24.989348  7117 ts_tablet_manager.cc:1403] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.009s
I20260709 12:25:24.991535  7111 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:24.992065  7111 ts_tablet_manager.cc:1403] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.036s
I20260709 12:25:24.991719  6830 tablet_service.cc:1511] Processing CreateTablet for tablet a9623b1b1de04219ac9d959598fc006c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:24.993651  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9623b1b1de04219ac9d959598fc006c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.995311  7111 raft_consensus.cc:359] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.996237  7111 raft_consensus.cc:385] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.996604  7111 raft_consensus.cc:740] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.997409  7111 consensus_queue.cc:260] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:24.999552  7120 raft_consensus.cc:515] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.005909  7113 ts_tablet_manager.cc:1434] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.004s
I20260709 12:25:25.039705  7113 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.041025  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.041707  6918 raft_consensus.cc:3060] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.042058  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.007081  6825 tablet_service.cc:1511] Processing CreateTablet for tablet da57db9ef59345a2a1467f6952f3364d (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:25.043489  6825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da57db9ef59345a2a1467f6952f3364d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:25.043584  7030 leader_election.cc:343] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.044179  7120 leader_election.cc:290] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.008807  7112 ts_tablet_manager.cc:1434] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.213s	user 0.005s	sys 0.002s
I20260709 12:25:25.009814  6980 tablet_service.cc:1511] Processing CreateTablet for tablet 986ed6daa4ed4fdb805d9d5eef38b40b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:25.010655  7055 tablet_service.cc:1511] Processing CreateTablet for tablet a9623b1b1de04219ac9d959598fc006c (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:25.046847  7112 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.047360  7055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9623b1b1de04219ac9d959598fc006c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.011852  7142 raft_consensus.cc:493] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.014195  7117 raft_consensus.cc:359] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.050980  7117 raft_consensus.cc:385] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.051362  7117 raft_consensus.cc:740] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.051007  7142 raft_consensus.cc:515] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.052156  7117 consensus_queue.cc:260] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.053423  7142 leader_election.cc:290] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.054394  7117 ts_tablet_manager.cc:1434] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.065s	user 0.001s	sys 0.005s
I20260709 12:25:25.055450  7117 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.057191  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.016805  7052 tablet_service.cc:1511] Processing CreateTablet for tablet 986ed6daa4ed4fdb805d9d5eef38b40b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:25.058391  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:25.058765  6805 leader_election.cc:343] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.059557  7052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986ed6daa4ed4fdb805d9d5eef38b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.059783  7113 tablet_bootstrap.cc:654] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.059916  6807 leader_election.cc:343] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.060384  6807 leader_election.cc:304] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.061623  7142 raft_consensus.cc:2749] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.065289  7112 tablet_bootstrap.cc:654] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.019840  7119 consensus_queue.cc:1048] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:25.024463  6832 tablet_service.cc:1511] Processing CreateTablet for tablet 986ed6daa4ed4fdb805d9d5eef38b40b (DEFAULT_TABLE table=test-workload [id=78d295579db54bbaaa8e4b80297f1fbb]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:25.026554  7111 ts_tablet_manager.cc:1434] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 12:25:25.068532  6832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986ed6daa4ed4fdb805d9d5eef38b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.068835  7111 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.069121  7120 raft_consensus.cc:493] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.069602  7120 raft_consensus.cc:515] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.035238  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:25.072165  7030 leader_election.cc:343] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.072563  7120 leader_election.cc:290] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.073398  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.074028  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.074654  6993 raft_consensus.cc:2468] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.075887  7030 leader_election.cc:304] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
W20260709 12:25:25.077677  7032 leader_election.cc:343] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.081264  7111 tablet_bootstrap.cc:654] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.083257  6806 consensus_peers.cc:597] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 -> Peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Couldn't send request to peer 735ce7f4a3244c7d877ce5feb5fb4ffc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:25.085991  6980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 986ed6daa4ed4fdb805d9d5eef38b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.087602  7117 tablet_bootstrap.cc:654] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.095119  7120 raft_consensus.cc:2804] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.096187  7120 raft_consensus.cc:493] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.096530  7120 raft_consensus.cc:3060] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.113708  6918 raft_consensus.cc:2468] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.115805  7032 leader_election.cc:304] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:25.117063  7159 raft_consensus.cc:2804] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.121584  7111 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.122160  7111 ts_tablet_manager.cc:1403] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 12:25:25.132769  7120 raft_consensus.cc:515] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.135371  7117 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.135715  7111 raft_consensus.cc:359] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.136091  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.129348  7113 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.136516  7111 raft_consensus.cc:385] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.136873  7111 raft_consensus.cc:740] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.136909  7113 ts_tablet_manager.cc:1403] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.006s
W20260709 12:25:25.137334  7032 leader_election.cc:343] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.136211  7117 ts_tablet_manager.cc:1403] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.002s
I20260709 12:25:25.140161  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.140748  6993 raft_consensus.cc:3060] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.141165  7113 raft_consensus.cc:359] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.141847  7113 raft_consensus.cc:385] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.139307  7120 leader_election.cc:290] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.142393  7113 raft_consensus.cc:740] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.143904  7159 raft_consensus.cc:697] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.144796  7113 consensus_queue.cc:260] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.145252  7159 consensus_queue.cc:237] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.143690  7111 consensus_queue.cc:260] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.148700  7111 ts_tablet_manager.cc:1434] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:25:25.149703  7111 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.160805  7117 raft_consensus.cc:359] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.161821  7117 raft_consensus.cc:385] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.162212  7117 raft_consensus.cc:740] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.163573  6993 raft_consensus.cc:2468] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.163867  7113 ts_tablet_manager.cc:1434] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 12:25:25.160341  7112 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.165606  7030 leader_election.cc:304] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.166920  7167 raft_consensus.cc:2804] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.167455  7167 raft_consensus.cc:697] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.168325  7167 consensus_queue.cc:237] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.171636  7142 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.173123  7112 ts_tablet_manager.cc:1403] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.017s
I20260709 12:25:25.172670  7142 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.173686  6737 catalog_manager.cc:5697] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.177100  7142 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.178290  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.179087  6918 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.179380  7117 consensus_queue.cc:260] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.180297  6807 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.181202  7142 raft_consensus.cc:2804] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.181468  7113 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.181658  7142 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.182204  7142 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.181809  7117 ts_tablet_manager.cc:1434] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:25:25.183081  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.183924  7067 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.184296  7117 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.186827  7159 raft_consensus.cc:493] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.187330  7159 raft_consensus.cc:515] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.191316  7159 leader_election.cc:290] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.176256  7112 raft_consensus.cc:359] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.191382  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.194126  7117 tablet_bootstrap.cc:654] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.196780  7032 leader_election.cc:343] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.192497  7112 raft_consensus.cc:385] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.198068  7112 raft_consensus.cc:740] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.198871  7112 consensus_queue.cc:260] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.201340  7112 ts_tablet_manager.cc:1434] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:25:25.202860  7112 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.203960  7113 tablet_bootstrap.cc:654] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.206681  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.207423  6993 raft_consensus.cc:2468] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.208715  7030 leader_election.cc:304] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.212271  7167 raft_consensus.cc:2804] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.212646  7167 raft_consensus.cc:493] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.212976  7167 raft_consensus.cc:3060] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.216444  7111 tablet_bootstrap.cc:654] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.223140  7112 tablet_bootstrap.cc:654] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.224282  7117 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.224798  7117 ts_tablet_manager.cc:1403] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.012s
I20260709 12:25:25.228168  7117 raft_consensus.cc:359] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.228883  7117 raft_consensus.cc:385] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.229221  7117 raft_consensus.cc:740] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.229971  7117 consensus_queue.cc:260] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.231594  7142 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.232993  7113 tablet_bootstrap.cc:492] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.232965  7117 ts_tablet_manager.cc:1434] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:25.234642  7117 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.234582  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:25.235626  7067 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.242173  7117 tablet_bootstrap.cc:654] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.243278  7156 raft_consensus.cc:493] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.233647  7113 ts_tablet_manager.cc:1403] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 12:25:25.243927  7156 raft_consensus.cc:515] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.247617  7142 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.247601  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.248438  6843 raft_consensus.cc:2468] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:25.248867  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.249478  6917 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.249369  7113 raft_consensus.cc:359] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.250166  7113 raft_consensus.cc:385] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.250504  7113 raft_consensus.cc:740] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.250582  6955 leader_election.cc:304] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.251744  7118 raft_consensus.cc:2804] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.251574  7113 consensus_queue.cc:260] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.252183  7118 raft_consensus.cc:493] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.252604  7118 raft_consensus.cc:3060] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.254221  7111 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.254758  7111 ts_tablet_manager.cc:1403] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.000s
I20260709 12:25:25.259678  7111 raft_consensus.cc:359] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.260408  7111 raft_consensus.cc:385] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.260708  7111 raft_consensus.cc:740] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.261461  7111 consensus_queue.cc:260] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.262090  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.262784  6918 raft_consensus.cc:2468] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:25.264302  7156 leader_election.cc:290] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.264474  7112 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.265110  7120 raft_consensus.cc:493] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.265822  7120 raft_consensus.cc:515] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.266925  7111 ts_tablet_manager.cc:1434] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:25.268060  7111 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.271073  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.271981  6918 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.273502  7032 leader_election.cc:304] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.274416  7111 tablet_bootstrap.cc:654] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.265482  7112 ts_tablet_manager.cc:1403] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.021s
I20260709 12:25:25.274670  7159 raft_consensus.cc:2804] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.275249  7159 raft_consensus.cc:493] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.275718  7159 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.277369  7118 raft_consensus.cc:515] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.277756  7112 raft_consensus.cc:359] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.284833  7112 raft_consensus.cc:385] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.285162  7112 raft_consensus.cc:740] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.285995  7112 consensus_queue.cc:260] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.287288  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.287909  6842 raft_consensus.cc:3060] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.288543  7112 ts_tablet_manager.cc:1434] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:25:25.288820  6917 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:25.289590  7112 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.290199  6807 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.279217  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.279865  7120 leader_election.cc:290] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.291582  6843 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.293596  7159 raft_consensus.cc:515] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.298781  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.299403  6843 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.301456  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.302273  6917 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.299365  7112 tablet_bootstrap.cc:654] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.307336  7118 leader_election.cc:290] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.283721  7167 raft_consensus.cc:515] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.291110  7119 raft_consensus.cc:2804] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.307498  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.298941  6842 raft_consensus.cc:2468] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:25.309918  6955 leader_election.cc:304] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.281086  7067 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:25.308610  6918 raft_consensus.cc:3060] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.308012  7159 leader_election.cc:290] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.312636  6843 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.313836  7030 leader_election.cc:304] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.308586  7119 raft_consensus.cc:697] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:25.315488  7119 consensus_queue.cc:237] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.316639  7117 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.317325  7117 ts_tablet_manager.cc:1403] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.005s
I20260709 12:25:25.319752  7111 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.320307  7111 ts_tablet_manager.cc:1403] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.006s
I20260709 12:25:25.320958  7159 raft_consensus.cc:2804] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.321769  7159 raft_consensus.cc:697] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.322608  7159 consensus_queue.cc:237] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.323084  7111 raft_consensus.cc:359] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.323303  6918 raft_consensus.cc:2468] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:25.323797  7111 raft_consensus.cc:385] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.324122  7111 raft_consensus.cc:740] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.324883  7111 consensus_queue.cc:260] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.325610  7118 raft_consensus.cc:2804] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.326871  7118 raft_consensus.cc:697] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:25.326946  7117 raft_consensus.cc:359] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.327780  7117 raft_consensus.cc:385] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.328171  7117 raft_consensus.cc:740] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.327661  6738 catalog_manager.cc:5697] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.327915  7118 consensus_queue.cc:237] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.329777  7111 ts_tablet_manager.cc:1434] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:25.331090  7167 leader_election.cc:290] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.332365  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.333079  6992 raft_consensus.cc:3060] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.338064  7112 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.337523  6739 catalog_manager.cc:5697] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.338950  7112 ts_tablet_manager.cc:1403] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.000s
I20260709 12:25:25.338883  7117 consensus_queue.cc:260] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.341410  6917 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.330896  7111 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.343387  7112 raft_consensus.cc:359] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.343865  7113 ts_tablet_manager.cc:1434] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.099s	user 0.035s	sys 0.029s
I20260709 12:25:25.344560  7112 raft_consensus.cc:385] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.345223  7113 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.345197  7112 raft_consensus.cc:740] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.346741  7112 consensus_queue.cc:260] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.350247  7111 tablet_bootstrap.cc:654] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.351469  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:25.352525  7112 ts_tablet_manager.cc:1434] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:25:25.353706  7117 ts_tablet_manager.cc:1434] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:25:25.343395  6992 raft_consensus.cc:2468] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.354805  7117 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.355125  7030 leader_election.cc:304] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:25.354868  7112 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.357684  7167 raft_consensus.cc:2804] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.358261  7167 raft_consensus.cc:697] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.359596  7167 consensus_queue.cc:237] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.360208  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:25.361618  7032 leader_election.cc:343] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.368360  7112 tablet_bootstrap.cc:654] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.377100  7117 tablet_bootstrap.cc:654] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.378319  6738 catalog_manager.cc:5697] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.388384  7113 tablet_bootstrap.cc:654] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.391677  7139 raft_consensus.cc:493] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.392246  7139 raft_consensus.cc:515] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.394551  7139 leader_election.cc:290] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.394214  6737 catalog_manager.cc:5697] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.397336  6737 catalog_manager.cc:5697] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.399914  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.401945  7111 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.402372  7111 ts_tablet_manager.cc:1403] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.002s
I20260709 12:25:25.404563  7112 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.405095  7112 ts_tablet_manager.cc:1403] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.011s
I20260709 12:25:25.405191  7111 raft_consensus.cc:359] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.405875  7111 raft_consensus.cc:385] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.406155  7111 raft_consensus.cc:740] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.406947  7111 consensus_queue.cc:260] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.408206  7112 raft_consensus.cc:359] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.408907  7112 raft_consensus.cc:385] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.409145  7111 ts_tablet_manager.cc:1434] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:25.409269  7112 raft_consensus.cc:740] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.410185  7111 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.410218  7112 consensus_queue.cc:260] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.412470  7112 ts_tablet_manager.cc:1434] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:25.416324  7117 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.416503  7112 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.416853  7117 ts_tablet_manager.cc:1403] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.005s
I20260709 12:25:25.418071  7113 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.420560  7113 ts_tablet_manager.cc:1403] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.003s
I20260709 12:25:25.423373  7113 raft_consensus.cc:359] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.424043  7113 raft_consensus.cc:385] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.424401  7113 raft_consensus.cc:740] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
W20260709 12:25:25.424538  6881 leader_election.cc:343] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.424837  7111 tablet_bootstrap.cc:654] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.425201  7113 consensus_queue.cc:260] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.427026  7117 raft_consensus.cc:359] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.427749  7117 raft_consensus.cc:385] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.428047  7117 raft_consensus.cc:740] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.428767  7117 consensus_queue.cc:260] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.429579  7112 tablet_bootstrap.cc:654] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.430970  7117 ts_tablet_manager.cc:1434] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:25.432078  7117 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.440658  7113 ts_tablet_manager.cc:1434] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:25.443318  7111 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.444193  7111 ts_tablet_manager.cc:1403] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:25:25.447891  7111 raft_consensus.cc:359] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.448701  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.448840  7111 raft_consensus.cc:385] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.449426  6992 raft_consensus.cc:2468] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:25.449391  7111 raft_consensus.cc:740] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.451021  6881 leader_election.cc:304] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.451014  7111 consensus_queue.cc:260] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.452364  7139 raft_consensus.cc:2804] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.452788  7139 raft_consensus.cc:493] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.453140  7139 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.454154  7111 ts_tablet_manager.cc:1434] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:25:25.455318  7111 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.458619  7118 raft_consensus.cc:493] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.459172  7118 raft_consensus.cc:515] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.461417  7118 leader_election.cc:290] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.462627  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.463227  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b811e6cffc24cfdb05f8a591b81e5a7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.464306  6918 raft_consensus.cc:2393] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:25.460958  7139 raft_consensus.cc:515] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.465759  6957 leader_election.cc:304] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.466424  7111 tablet_bootstrap.cc:654] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.467012  7118 raft_consensus.cc:3060] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.468159  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.468827  6843 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.470512  7167 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.471019  7167 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.472410  7113 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.473135  7167 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:25.474941  7112 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.475075  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.478571  7112 ts_tablet_manager.cc:1403] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.021s
I20260709 12:25:25.478854  7113 tablet_bootstrap.cc:654] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.479626  7030 leader_election.cc:343] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.475863  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.477610  6843 raft_consensus.cc:2468] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
W20260709 12:25:25.481360  7030 leader_election.cc:343] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.481575  7112 raft_consensus.cc:359] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.481801  7030 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.482275  7112 raft_consensus.cc:385] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.481735  6881 leader_election.cc:304] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.482574  7112 raft_consensus.cc:740] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.482833  7167 raft_consensus.cc:2749] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.479807  7111 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.483407  7112 consensus_queue.cc:260] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.484388  7111 ts_tablet_manager.cc:1403] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 12:25:25.487222  7111 raft_consensus.cc:359] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.487893  7111 raft_consensus.cc:385] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.488217  7111 raft_consensus.cc:740] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.488987  7111 consensus_queue.cc:260] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.492293  7111 ts_tablet_manager.cc:1434] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:25.492121  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.492738  7139 leader_election.cc:290] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.493153  6992 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.493671  7112 ts_tablet_manager.cc:1434] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:25.494269  7117 tablet_bootstrap.cc:654] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.477873  7118 raft_consensus.cc:2749] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.492563  7193 raft_consensus.cc:2804] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.501497  7193 raft_consensus.cc:697] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:25.503499  7193 consensus_queue.cc:237] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.505841  7112 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.504635  6992 raft_consensus.cc:2468] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:25.502655  7111 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.508761  7117 tablet_bootstrap.cc:492] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.509253  7117 ts_tablet_manager.cc:1403] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.006s
I20260709 12:25:25.512236  7112 tablet_bootstrap.cc:654] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.515211  7111 tablet_bootstrap.cc:654] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.516059  7113 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.516569  7113 ts_tablet_manager.cc:1403] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.013s
I20260709 12:25:25.517994  7117 raft_consensus.cc:359] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.518847  7117 raft_consensus.cc:385] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.519136  7117 raft_consensus.cc:740] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.519516  7113 raft_consensus.cc:359] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.519830  7117 consensus_queue.cc:260] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.520223  7113 raft_consensus.cc:385] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.520569  7113 raft_consensus.cc:740] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.521358  7113 consensus_queue.cc:260] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.522270  7117 ts_tablet_manager.cc:1434] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:25.526067  7117 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.531545  7113 ts_tablet_manager.cc:1434] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:25.533425  7112 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.534358  7112 ts_tablet_manager.cc:1403] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.003s
I20260709 12:25:25.534083  6737 catalog_manager.cc:5697] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.536172  7117 tablet_bootstrap.cc:654] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.535907  7167 consensus_queue.cc:1048] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.537571  7112 raft_consensus.cc:359] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.538363  7112 raft_consensus.cc:385] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.538723  7112 raft_consensus.cc:740] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.539820  7112 consensus_queue.cc:260] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.540671  7111 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.541172  7111 ts_tablet_manager.cc:1403] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 12:25:25.544180  7111 raft_consensus.cc:359] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.544857  7111 raft_consensus.cc:385] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.545138  7111 raft_consensus.cc:740] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.545712  7112 ts_tablet_manager.cc:1434] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:25.546290  7111 consensus_queue.cc:260] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.546818  7112 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.548035  7167 raft_consensus.cc:493] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.548503  7167 raft_consensus.cc:515] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.551604  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:25.553303  7030 leader_election.cc:343] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.555714  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.556559  6918 raft_consensus.cc:2468] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.557998  7032 leader_election.cc:304] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.558983  7119 raft_consensus.cc:493] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.559576  7119 raft_consensus.cc:515] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.563647  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.564811  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
W20260709 12:25:25.565304  6805 leader_election.cc:343] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.565924  7159 raft_consensus.cc:2804] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.565999  7119 leader_election.cc:290] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.566545  7159 raft_consensus.cc:493] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.567044  7159 raft_consensus.cc:3060] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.568821  7113 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
W20260709 12:25:25.571424  6806 leader_election.cc:343] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.572142  6806 leader_election.cc:304] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:25.573786  7119 raft_consensus.cc:2749] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.576712  7167 leader_election.cc:290] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.583256  7159 raft_consensus.cc:515] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.586623  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
W20260709 12:25:25.588236  7030 leader_election.cc:343] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.590626  7112 tablet_bootstrap.cc:654] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.590952  7117 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.592597  7117 ts_tablet_manager.cc:1403] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.026s
I20260709 12:25:25.591243  7111 ts_tablet_manager.cc:1434] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:25:25.591486  7113 tablet_bootstrap.cc:654] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.596488  7117 raft_consensus.cc:359] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.597391  7117 raft_consensus.cc:385] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.597751  7117 raft_consensus.cc:740] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.598657  7117 consensus_queue.cc:260] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.601764  7117 ts_tablet_manager.cc:1434] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:25:25.606845  7117 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.612583  7111 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.617370  7113 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.618029  7113 ts_tablet_manager.cc:1403] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.008s
I20260709 12:25:25.611351  7200 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.620690  7159 leader_election.cc:290] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:25.621541  7200 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.626003  7111 tablet_bootstrap.cc:654] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.626567  7067 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.631426  7113 raft_consensus.cc:359] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.632092  7113 raft_consensus.cc:385] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.632344  7113 raft_consensus.cc:740] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.633024  7113 consensus_queue.cc:260] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.635016  7113 ts_tablet_manager.cc:1434] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:25.635847  7113 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.637151  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.639508  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:25.640290  6917 raft_consensus.cc:3060] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.641495  7113 tablet_bootstrap.cc:654] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.643201  7193 raft_consensus.cc:493] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.643836  7193 raft_consensus.cc:515] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.646381  7193 leader_election.cc:290] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.646371  7119 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.647506  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.647120  7119 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.649049  7030 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.649463  7119 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.650522  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.651324  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.651362  6992 raft_consensus.cc:2468] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:25.651791  6843 raft_consensus.cc:2468] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:25.650990  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.653208  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.653401  6993 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.653891  7066 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.654664  6805 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.655366  7119 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.655725  7119 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.656044  7119 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.656836  7117 tablet_bootstrap.cc:654] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.646543  7139 raft_consensus.cc:493] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.659305  7139 raft_consensus.cc:515] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.661336  7139 leader_election.cc:290] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.662645  6881 leader_election.cc:304] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.662705  7119 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.663337  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.664201  6992 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:25.665536  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.666124  6992 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.665810  6881 leader_election.cc:304] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.667212  7193 raft_consensus.cc:2804] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.667593  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.667666  7193 raft_consensus.cc:493] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.668359  6843 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:25.668391  7193 raft_consensus.cc:3060] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.669679  7139 raft_consensus.cc:2804] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.670094  7139 raft_consensus.cc:493] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.670549  7139 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.628458  7200 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:25.676227  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:25.676867  7066 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.686669  7167 consensus_queue.cc:1048] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.690137  7193 raft_consensus.cc:515] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.694329  6992 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:25.695590  6805 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.696381  7142 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.686467  6917 raft_consensus.cc:2468] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:25.679925  7119 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.705188  7032 leader_election.cc:304] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.706439  7167 raft_consensus.cc:2804] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.708822  7066 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:25.710451  7117 tablet_bootstrap.cc:492] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:25.710985  7117 ts_tablet_manager.cc:1403] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.000s
I20260709 12:25:25.714838  7117 raft_consensus.cc:359] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.715721  7117 raft_consensus.cc:385] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.716060  7117 raft_consensus.cc:740] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.716919  7117 consensus_queue.cc:260] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.718664  7112 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:25.719266  7112 ts_tablet_manager.cc:1403] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.173s	user 0.031s	sys 0.040s
I20260709 12:25:25.707239  7167 raft_consensus.cc:697] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.722600  7193 leader_election.cc:290] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.726882  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.727365  7111 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.727747  6992 raft_consensus.cc:3060] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.727988  7111 ts_tablet_manager.cc:1403] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.008s
I20260709 12:25:25.728835  7112 raft_consensus.cc:359] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.729557  7112 raft_consensus.cc:385] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.729846  7112 raft_consensus.cc:740] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.730099  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5451dbc9a6416781d842e1c7709a45" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.722520  7167 consensus_queue.cc:237] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.730928  6843 raft_consensus.cc:3060] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.731207  7111 raft_consensus.cc:359] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.732053  7111 raft_consensus.cc:385] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.732369  7111 raft_consensus.cc:740] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.733212  7111 consensus_queue.cc:260] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.730509  7112 consensus_queue.cc:260] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:25.734752  7120 raft_consensus.cc:493] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.735886  7112 ts_tablet_manager.cc:1434] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:25:25.735857  7120 raft_consensus.cc:515] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.734776  7142 raft_consensus.cc:697] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:25.738090  7120 leader_election.cc:290] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
W20260709 12:25:25.738389  7032 consensus_peers.cc:597] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:25.739861  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.740767  6843 raft_consensus.cc:2468] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
W20260709 12:25:25.741457  7030 leader_election.cc:343] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.739300  7142 consensus_queue.cc:237] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.742125  6881 leader_election.cc:304] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.743158  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:25.743462  7207 raft_consensus.cc:2804] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.744050  7207 raft_consensus.cc:697] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
W20260709 12:25:25.744671  7032 leader_election.cc:343] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.743407  7113 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:25.744836  7111 ts_tablet_manager.cc:1434] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:25:25.745190  7032 leader_election.cc:304] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.748972  7111 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:25.749460  7120 raft_consensus.cc:2749] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.745035  7207 consensus_queue.cc:237] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.748172  7113 ts_tablet_manager.cc:1403] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.018s
I20260709 12:25:25.756071  7139 raft_consensus.cc:515] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.760134  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.761358  6843 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.772073  7118 raft_consensus.cc:493] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.772677  7118 raft_consensus.cc:515] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.776412  7112 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:25.777228  7113 raft_consensus.cc:359] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.778184  7113 raft_consensus.cc:385] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.763864  7139 leader_election.cc:290] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.778537  7113 raft_consensus.cc:740] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.780193  6992 raft_consensus.cc:2468] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:25.782089  7118 leader_election.cc:290] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:25.782760  7208 raft_consensus.cc:493] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.783366  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.783277  7208 raft_consensus.cc:515] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.783977  6993 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.787024  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.787668  6992 raft_consensus.cc:2468] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.787701  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.787895  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:25.788471  7066 raft_consensus.cc:2468] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:25.788621  6842 raft_consensus.cc:2468] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:25.789746  7208 leader_election.cc:290] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.791635  6805 leader_election.cc:304] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.792408  6955 leader_election.cc:304] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:25.793838  7159 raft_consensus.cc:2749] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.795217  7208 raft_consensus.cc:2804] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.795377  7176 raft_consensus.cc:2804] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.795671  7208 raft_consensus.cc:493] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.795917  7176 raft_consensus.cc:493] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.796155  7208 raft_consensus.cc:3060] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.796352  7176 raft_consensus.cc:3060] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.808275  7111 tablet_bootstrap.cc:654] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.805670  7113 consensus_queue.cc:260] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.808990  7176 raft_consensus.cc:515] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.799865  7156 consensus_queue.cc:1048] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:25:25.816095  6843 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:25.816953  7118 consensus_queue.cc:1048] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.817406  6881 leader_election.cc:304] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:25.818557  7139 raft_consensus.cc:2804] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.819304  7139 raft_consensus.cc:697] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:25.820181  7139 consensus_queue.cc:237] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:25.812031  7176 leader_election.cc:290] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:25.812618  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:25.826840  7067 raft_consensus.cc:3060] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.805240  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.823799  6993 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:25.839742  7113 ts_tablet_manager.cc:1434] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 12:25:25.840580  7113 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:25.844573  7117 ts_tablet_manager.cc:1434] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.133s	user 0.020s	sys 0.013s
I20260709 12:25:25.845665  7117 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:25.839144  7112 tablet_bootstrap.cc:654] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.849555  6738 catalog_manager.cc:5697] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.856940  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:25.839414  7193 raft_consensus.cc:493] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.863011  7193 raft_consensus.cc:515] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.865448  7193 leader_election.cc:290] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.866532  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.868119  7167 raft_consensus.cc:493] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.868613  7167 raft_consensus.cc:515] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.865815  6739 catalog_manager.cc:5697] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.870764  7167 leader_election.cc:290] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.875368  6918 raft_consensus.cc:3060] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.875806  6916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:25.878527  7032 leader_election.cc:343] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.882862  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.883334  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74d9ce0b448489aa3fb7ae932cca398" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.883594  6991 raft_consensus.cc:2468] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:25.884135  6993 raft_consensus.cc:2393] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:25.884186  7167 consensus_queue.cc:1048] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.885875  6881 leader_election.cc:304] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:25.887512  7113 tablet_bootstrap.cc:654] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.865940  7193 raft_consensus.cc:493] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.891615  7030 leader_election.cc:304] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:25.891875  7193 raft_consensus.cc:515] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.892774  7167 consensus_queue.cc:1048] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.894199  7193 leader_election.cc:290] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.895388  7067 raft_consensus.cc:2468] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:25.895015  7208 raft_consensus.cc:515] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.896010  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:25.896793  6843 raft_consensus.cc:2393] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
I20260709 12:25:25.909789  6956 leader_election.cc:304] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:25.894199  7167 raft_consensus.cc:2804] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.913527  7118 raft_consensus.cc:2804] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.914247  7167 raft_consensus.cc:493] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.925582  7159 consensus_queue.cc:1048] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:25:25.926923  7167 raft_consensus.cc:3060] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.920221  7118 raft_consensus.cc:697] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:25.939556  7118 consensus_queue.cc:237] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:25.944079  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af80e3d9967348169f8ab8bece79c333" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:25.944417  7208 leader_election.cc:290] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:25.944599  7159 consensus_queue.cc:1048] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:25.946339  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.954299  7142 consensus_queue.cc:1048] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:25.981283  7111 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:25.982120  7111 ts_tablet_manager.cc:1403] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.010s
I20260709 12:25:25.958094  6881 leader_election.cc:304] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:25.988224  7193 raft_consensus.cc:2749] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.989794  7117 tablet_bootstrap.cc:654] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.991717  7167 raft_consensus.cc:515] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:25.994400  7167 leader_election.cc:290] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:25.996628  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:25.997438  6991 raft_consensus.cc:3060] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.000216  7119 consensus_queue.cc:1048] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:26.002018  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 47817.5us
I20260709 12:25:26.003803  7139 raft_consensus.cc:2749] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.004783  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:26.012393  6991 raft_consensus.cc:2468] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:26.014930  7030 leader_election.cc:304] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
W20260709 12:25:26.016588  7032 leader_election.cc:343] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.016614  7159 raft_consensus.cc:2804] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.017627  7159 raft_consensus.cc:697] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:25.978039  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:26.043551  7113 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.044323  7113 ts_tablet_manager.cc:1403] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.001s
I20260709 12:25:26.035683  7066 raft_consensus.cc:2393] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:26.025426  7167 raft_consensus.cc:493] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.021587  7220 consensus_queue.cc:1048] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:25:26.019219  7159 consensus_queue.cc:237] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.064096  6806 leader_election.cc:304] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:26.066723  7142 raft_consensus.cc:2749] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.050541  7167 raft_consensus.cc:515] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.069095  7167 leader_election.cc:290] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.069813  7167 consensus_queue.cc:1048] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.058167  7111 raft_consensus.cc:359] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.075918  7111 raft_consensus.cc:385] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.076323  7111 raft_consensus.cc:740] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.077193  7111 consensus_queue.cc:260] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.071130  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.082907  7113 raft_consensus.cc:359] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:26.084280  7032 leader_election.cc:343] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.083652  7113 raft_consensus.cc:385] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.085152  7113 raft_consensus.cc:740] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.090813  7113 consensus_queue.cc:260] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.087755  6739 catalog_manager.cc:5697] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.094923  7111 ts_tablet_manager.cc:1434] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.001s
I20260709 12:25:26.107944  7113 ts_tablet_manager.cc:1434] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 12:25:26.109117  7111 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.113700  7113 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.125762  7112 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.126298  7112 ts_tablet_manager.cc:1403] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.360s	user 0.029s	sys 0.033s
I20260709 12:25:26.128468  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.129012  7113 tablet_bootstrap.cc:654] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.136976  7117 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.137063  7193 consensus_queue.cc:1048] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.137449  7117 ts_tablet_manager.cc:1403] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.292s	user 0.012s	sys 0.004s
I20260709 12:25:26.140192  7119 raft_consensus.cc:493] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.140857  7111 tablet_bootstrap.cc:654] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.140694  7119 raft_consensus.cc:515] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.151805  7117 raft_consensus.cc:359] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.152673  7117 raft_consensus.cc:385] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.152936  7117 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.153582  7117 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.154577  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.155159  6918 raft_consensus.cc:3060] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.155376  6915 raft_consensus.cc:2393] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:26.155859  7117 ts_tablet_manager.cc:1434] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:25:26.156796  7117 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.160245  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd28e008e3f4cc6b3a052fee4d4688c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.161939  6806 leader_election.cc:304] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.149296  7119 leader_election.cc:290] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.163518  7142 raft_consensus.cc:3060] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.167968  7112 raft_consensus.cc:359] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.168695  7112 raft_consensus.cc:385] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.168969  7112 raft_consensus.cc:740] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.169668  7112 consensus_queue.cc:260] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.172780  6842 raft_consensus.cc:2468] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:26.174220  7117 tablet_bootstrap.cc:654] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.180938  7112 ts_tablet_manager.cc:1434] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 12:25:26.174537  7030 leader_election.cc:304] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.183132  7120 raft_consensus.cc:2804] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.183334  7112 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.183537  7120 raft_consensus.cc:493] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.183887  7120 raft_consensus.cc:3060] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:26.185827  7235 log.cc:927] Time spent T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:25:26.188032  6738 catalog_manager.cc:5697] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.192425  7112 tablet_bootstrap.cc:654] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.191220  6739 catalog_manager.cc:5697] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.197830  7113 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.198385  7113 ts_tablet_manager.cc:1403] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.005s
I20260709 12:25:26.207432  7142 raft_consensus.cc:2749] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.216607  7111 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.217170  7111 ts_tablet_manager.cc:1403] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.002s
I20260709 12:25:26.223011  7113 raft_consensus.cc:359] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.224509  7113 raft_consensus.cc:385] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.224839  7113 raft_consensus.cc:740] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.222880  7193 consensus_queue.cc:1048] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:26.226951  7202 raft_consensus.cc:493] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.228806  7119 consensus_queue.cc:1048] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.229164  7202 raft_consensus.cc:515] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.231530  7202 leader_election.cc:290] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:26.233582  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:26.235666  7030 leader_election.cc:343] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.239275  7120 raft_consensus.cc:515] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.239439  7111 raft_consensus.cc:359] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.240097  7111 raft_consensus.cc:385] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.240384  7111 raft_consensus.cc:740] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.241048  7111 consensus_queue.cc:260] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.243208  7111 ts_tablet_manager.cc:1434] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:25:26.244071  7111 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.244079  7113 consensus_queue.cc:260] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.248203  6737 catalog_manager.cc:5697] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.249615  7113 ts_tablet_manager.cc:1434] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:25:26.251717  7113 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.263691  7117 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.264250  7117 ts_tablet_manager.cc:1403] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.108s	user 0.021s	sys 0.020s
W20260709 12:25:26.273466  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 49162.5us
I20260709 12:25:26.280611  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:26.283587  7032 leader_election.cc:343] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.284153  7032 leader_election.cc:304] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.285341  7202 raft_consensus.cc:2749] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.285993  7120 leader_election.cc:290] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.287300  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:26.288120  6840 raft_consensus.cc:3060] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.289043  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:26.290751  7032 leader_election.cc:343] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.296375  7232 consensus_queue.cc:1048] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:26.306439  7113 tablet_bootstrap.cc:654] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.310122  7111 tablet_bootstrap.cc:654] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.310971  7193 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.311851  6840 raft_consensus.cc:2468] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:26.311615  7193 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.313498  7030 leader_election.cc:304] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.314278  7120 raft_consensus.cc:2804] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.314422  7193 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:26.314823  7120 raft_consensus.cc:697] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:26.315681  7120 consensus_queue.cc:237] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.316778  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:26.309711  7117 raft_consensus.cc:359] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.321410  7117 raft_consensus.cc:385] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.321759  7117 raft_consensus.cc:740] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
W20260709 12:25:26.322110  6881 leader_election.cc:343] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.322700  7117 consensus_queue.cc:260] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.326627  7119 consensus_queue.cc:1048] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.338626  7220 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.339370  7220 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.344285  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.345132  7220 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.345489  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.338586  7117 ts_tablet_manager.cc:1434] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:25:26.346832  7232 consensus_queue.cc:1048] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.347110  7117 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
W20260709 12:25:26.347780  6882 leader_election.cc:343] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:26.349102  6881 leader_election.cc:343] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.349573  6881 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:26.360584  7112 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.361299  7112 ts_tablet_manager.cc:1403] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.028s
I20260709 12:25:26.358065  7193 raft_consensus.cc:2749] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.333449  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.391952  7112 raft_consensus.cc:359] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.392894  7112 raft_consensus.cc:385] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.393275  7112 raft_consensus.cc:740] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.394496  7112 consensus_queue.cc:260] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.394804  7176 consensus_queue.cc:1048] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.397241  7112 ts_tablet_manager.cc:1434] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
W20260709 12:25:26.404443  6881 leader_election.cc:343] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.404953  6881 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:26.405767  7207 raft_consensus.cc:2749] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:26.409166  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:26.409323  7207 consensus_queue.cc:1048] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.410907  7117 tablet_bootstrap.cc:654] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.412039  7113 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.412535  7113 ts_tablet_manager.cc:1403] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.038s
I20260709 12:25:26.414292  7112 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.423038  7113 raft_consensus.cc:359] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.423938  7111 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.424573  7111 ts_tablet_manager.cc:1403] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.008s
I20260709 12:25:26.423964  7113 raft_consensus.cc:385] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.427778  7113 raft_consensus.cc:740] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.431221  7111 raft_consensus.cc:359] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.431937  7111 raft_consensus.cc:385] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.432204  7111 raft_consensus.cc:740] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.432226  7207 consensus_queue.cc:1048] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:26.433341  7111 consensus_queue.cc:260] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.435743  7111 ts_tablet_manager.cc:1434] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:26.437203  7111 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.441041  7120 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.441562  7120 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.443091  7176 raft_consensus.cc:493] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.443616  7176 raft_consensus.cc:515] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.445964  7176 leader_election.cc:290] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.451185  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.448349  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.453208  6839 raft_consensus.cc:2468] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:26.454923  6955 leader_election.cc:304] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:26.455997  7156 raft_consensus.cc:493] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.455600  7113 consensus_queue.cc:260] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.456629  7156 raft_consensus.cc:515] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.462049  7113 ts_tablet_manager.cc:1434] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 12:25:26.462826  7159 raft_consensus.cc:493] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.469851  7120 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.460026  7118 raft_consensus.cc:2804] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.470078  7112 tablet_bootstrap.cc:654] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.470706  7118 raft_consensus.cc:493] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.471081  7118 raft_consensus.cc:3060] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.470036  7156 leader_election.cc:290] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.485656  7111 tablet_bootstrap.cc:654] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.463488  7159 raft_consensus.cc:515] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.488744  7159 leader_election.cc:290] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.490917  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.491804  7113 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.492272  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:26.479090  6956 leader_election.cc:343] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.496655  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.497249  7067 raft_consensus.cc:2468] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
W20260709 12:25:26.500073  7032 leader_election.cc:343] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.500722  7139 consensus_queue.cc:1048] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.502840  7113 tablet_bootstrap.cc:654] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.506249  7118 raft_consensus.cc:515] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.508409  7118 leader_election.cc:290] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.490191  6736 catalog_manager.cc:5697] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.509454  6956 leader_election.cc:304] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:26.511119  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:26.472785  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.515635  7118 raft_consensus.cc:2804] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:26.517349  6956 leader_election.cc:343] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:26.527415  7030 leader_election.cc:343] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.516091  7118 raft_consensus.cc:493] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.532487  7118 raft_consensus.cc:3060] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.536101  7113 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.536847  7113 ts_tablet_manager.cc:1403] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.008s
I20260709 12:25:26.539371  7117 tablet_bootstrap.cc:492] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.539858  7117 ts_tablet_manager.cc:1403] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.193s	user 0.023s	sys 0.033s
I20260709 12:25:26.536262  7111 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.540114  7113 raft_consensus.cc:359] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.542637  7111 ts_tablet_manager.cc:1403] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.011s
I20260709 12:25:26.542914  7113 raft_consensus.cc:385] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.543265  7113 raft_consensus.cc:740] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.543900  7113 consensus_queue.cc:260] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.545369  7117 raft_consensus.cc:359] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.545950  7113 ts_tablet_manager.cc:1434] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:25:26.546067  7117 raft_consensus.cc:385] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.546283  7111 raft_consensus.cc:359] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:26.542560  7030 leader_election.cc:343] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.547043  7113 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.547264  7111 raft_consensus.cc:385] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.547341  7030 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.547863  7111 raft_consensus.cc:740] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.548668  7111 consensus_queue.cc:260] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.551074  7111 ts_tablet_manager.cc:1434] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:26.548714  7159 raft_consensus.cc:2749] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.553556  7113 tablet_bootstrap.cc:654] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.556893  7118 raft_consensus.cc:515] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:26.515120  6955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 55176us
I20260709 12:25:26.560926  7176 consensus_queue.cc:1048] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.546409  7117 raft_consensus.cc:740] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.563261  7117 consensus_queue.cc:260] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.563820  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:26.564414  6840 raft_consensus.cc:3060] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.565804  7111 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.566576  7117 ts_tablet_manager.cc:1434] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:25:26.568692  7112 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.569187  7112 ts_tablet_manager.cc:1403] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.012s
I20260709 12:25:26.573864  7112 raft_consensus.cc:359] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.574791  7112 raft_consensus.cc:385] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.575150  7112 raft_consensus.cc:740] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.576289  7112 consensus_queue.cc:260] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.577286  6840 raft_consensus.cc:2468] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:26.578812  7117 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.582140  7159 consensus_queue.cc:1048] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.582716  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:26.583169  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.585060  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:26.586153  7118 leader_election.cc:290] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.592515  6992 raft_consensus.cc:2393] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:26.593575  7112 ts_tablet_manager.cc:1434] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:25:26.594935  7112 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.594069  7065 raft_consensus.cc:3060] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.596200  7159 raft_consensus.cc:493] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.597754  7159 raft_consensus.cc:515] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.599900  7159 leader_election.cc:290] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.600378  7111 tablet_bootstrap.cc:654] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.601974  7117 tablet_bootstrap.cc:654] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.604180  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:26.612296  7065 raft_consensus.cc:2468] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:26.613626  6956 leader_election.cc:304] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:26.614544  7118 raft_consensus.cc:2804] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.614825  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.615080  7118 raft_consensus.cc:697] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:26.615597  7142 raft_consensus.cc:493] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.615829  6840 raft_consensus.cc:2393] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:26.616093  7142 raft_consensus.cc:515] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.613651  7113 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.617542  7112 tablet_bootstrap.cc:654] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.617959  7113 ts_tablet_manager.cc:1403] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.010s
I20260709 12:25:26.618302  7142 leader_election.cc:290] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:26.615995  7118 consensus_queue.cc:237] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.622639  7113 raft_consensus.cc:359] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.624478  7113 raft_consensus.cc:385] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.624904  7113 raft_consensus.cc:740] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.627280  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.630534  7117 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.632850  7117 ts_tablet_manager.cc:1403] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.002s
W20260709 12:25:26.633813  6807 leader_election.cc:343] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.622437  6955 leader_election.cc:304] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:26.635461  7113 consensus_queue.cc:260] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.637605  7156 raft_consensus.cc:2804] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.638180  7156 raft_consensus.cc:697] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:26.639204  7156 consensus_queue.cc:237] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.641974  7117 raft_consensus.cc:359] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.643638  7113 ts_tablet_manager.cc:1434] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:25:26.644222  7117 raft_consensus.cc:385] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.644565  7117 raft_consensus.cc:740] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.645272  7113 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.652046  7117 consensus_queue.cc:260] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.660897  6918 raft_consensus.cc:3060] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.660974  7176 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.663924  7176 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.674165  7176 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.674356  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.675626  7200 consensus_queue.cc:1048] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:26.675817  6957 leader_election.cc:343] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:26.684690  6955 leader_election.cc:343] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:26.685719  6955 leader_election.cc:343] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.686924  7030 leader_election.cc:304] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:26.687783  7200 raft_consensus.cc:2749] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.693650  7117 ts_tablet_manager.cc:1434] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.005s
I20260709 12:25:26.694759  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.699074  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:26.702124  7112 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.702797  7112 ts_tablet_manager.cc:1403] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.108s	user 0.028s	sys 0.002s
I20260709 12:25:26.709311  7117 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.706440  7112 raft_consensus.cc:359] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.711606  7112 raft_consensus.cc:385] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.711871  7112 raft_consensus.cc:740] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.716450  7112 consensus_queue.cc:260] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.723891  7112 ts_tablet_manager.cc:1434] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:25:26.724713  7112 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.728796  7193 raft_consensus.cc:493] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 735ce7f4a3244c7d877ce5feb5fb4ffc)
I20260709 12:25:26.729362  7193 raft_consensus.cc:515] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:26.728658  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:26.737927  6805 leader_election.cc:343] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.738420  6805 leader_election.cc:304] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.739821  7208 raft_consensus.cc:2749] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.744346  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:26.747216  7112 tablet_bootstrap.cc:654] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.752027  7111 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.752512  7111 ts_tablet_manager.cc:1403] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.031s
I20260709 12:25:26.752581  7193 leader_election.cc:290] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
W20260709 12:25:26.753631  6955 leader_election.cc:343] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.754173  6955 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.755481  7111 raft_consensus.cc:359] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.757203  7111 raft_consensus.cc:385] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.757551  7111 raft_consensus.cc:740] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.758204  7111 consensus_queue.cc:260] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.759176  7112 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.755872  7208 raft_consensus.cc:493] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.759665  7112 ts_tablet_manager.cc:1403] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 12:25:26.759768  7208 raft_consensus.cc:515] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.760391  7111 ts_tablet_manager.cc:1434] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:26.761355  7111 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.755926  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a96ad1dde254427db317a4daf42aaa96" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.763018  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:26.764510  6807 leader_election.cc:343] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.765303  7112 raft_consensus.cc:359] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.765971  7112 raft_consensus.cc:385] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.766063  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.766268  7112 raft_consensus.cc:740] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.767133  7156 raft_consensus.cc:2749] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.767150  7112 consensus_queue.cc:260] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.767799  7030 leader_election.cc:304] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:26.767942  6882 leader_election.cc:304] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
W20260709 12:25:26.769059  6806 leader_election.cc:343] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.769253  7208 leader_election.cc:290] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.769457  7120 raft_consensus.cc:3060] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.769542  6806 leader_election.cc:304] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.770363  7111 tablet_bootstrap.cc:654] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.775607  7111 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.776095  7111 ts_tablet_manager.cc:1403] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:25:26.779225  7111 raft_consensus.cc:359] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.779909  7111 raft_consensus.cc:385] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.780185  7111 raft_consensus.cc:740] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.780778  7193 raft_consensus.cc:2749] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:26.780812  7111 consensus_queue.cc:260] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.781881  7142 raft_consensus.cc:2749] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.783223  7111 ts_tablet_manager.cc:1434] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:26.784200  7111 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.783517  6739 catalog_manager.cc:5697] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.785178  6739 catalog_manager.cc:5697] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.788270  7113 tablet_bootstrap.cc:654] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.788305  7156 raft_consensus.cc:493] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.790035  7156 raft_consensus.cc:515] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.790607  7111 tablet_bootstrap.cc:654] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.742286  7117 tablet_bootstrap.cc:654] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.792130  7156 leader_election.cc:290] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.792366  7120 raft_consensus.cc:2749] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.793849  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.793970  7112 ts_tablet_manager.cc:1434] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 12:25:26.794476  7066 raft_consensus.cc:2468] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:26.795364  7112 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.797680  6956 leader_election.cc:304] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:26.798815  7156 raft_consensus.cc:2804] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.799283  7156 raft_consensus.cc:493] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.799722  7156 raft_consensus.cc:3060] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.802362  7112 tablet_bootstrap.cc:654] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.806562  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:26.808151  6955 leader_election.cc:343] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.809087  7120 raft_consensus.cc:493] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.809618  7120 raft_consensus.cc:515] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.811919  7120 leader_election.cc:290] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.814031  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:26.815630  7030 leader_election.cc:343] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.815979  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.816915  6840 raft_consensus.cc:2468] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:26.819550  7156 raft_consensus.cc:515] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.819641  7030 leader_election.cc:304] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:26.822194  7120 raft_consensus.cc:2804] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.822574  7120 raft_consensus.cc:493] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.822901  7120 raft_consensus.cc:3060] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.830777  7120 raft_consensus.cc:515] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.832147  7117 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.832700  7117 ts_tablet_manager.cc:1403] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.005s
I20260709 12:25:26.834388  7111 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:26.835081  7111 ts_tablet_manager.cc:1403] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.005s
I20260709 12:25:26.834961  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:26.820452  7113 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:26.837309  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:26.837898  6840 raft_consensus.cc:3060] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.837867  7113 ts_tablet_manager.cc:1403] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.001s
I20260709 12:25:26.840662  7112 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:26.841024  7112 ts_tablet_manager.cc:1403] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.010s
I20260709 12:25:26.843051  7117 raft_consensus.cc:359] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.843154  7111 raft_consensus.cc:359] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.843358  7113 raft_consensus.cc:359] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.843845  7117 raft_consensus.cc:385] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.843981  7111 raft_consensus.cc:385] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.844111  7113 raft_consensus.cc:385] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.844241  7117 raft_consensus.cc:740] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.844379  7111 raft_consensus.cc:740] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.845181  7117 consensus_queue.cc:260] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.845240  7111 consensus_queue.cc:260] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:26.843436  7030 leader_election.cc:343] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.845696  7112 raft_consensus.cc:359] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.846354  7112 raft_consensus.cc:385] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.846622  7112 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.846915  7200 consensus_queue.cc:1048] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.847460  7117 ts_tablet_manager.cc:1434] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:25:26.847422  7112 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.844480  7113 raft_consensus.cc:740] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.848765  7117 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.848901  7113 consensus_queue.cc:260] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.852999  7193 raft_consensus.cc:493] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.853518  7193 raft_consensus.cc:515] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.854784  7117 tablet_bootstrap.cc:654] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.858055  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.858952  6842 raft_consensus.cc:2468] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:26.866050  7117 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.868244  7112 ts_tablet_manager.cc:1434] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:25:26.864878  6881 leader_election.cc:304] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:26.869192  7117 ts_tablet_manager.cc:1403] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 12:25:26.869819  7112 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.869932  7207 raft_consensus.cc:2804] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.870316  7207 raft_consensus.cc:493] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.870641  7207 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.860168  7193 leader_election.cc:290] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.872042  7117 raft_consensus.cc:359] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.859944  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:26.872738  7117 raft_consensus.cc:385] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.873039  7117 raft_consensus.cc:740] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
W20260709 12:25:26.873961  6882 leader_election.cc:343] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.873708  7117 consensus_queue.cc:260] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.878293  6840 raft_consensus.cc:2468] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:26.882813  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:26.860656  7111 ts_tablet_manager.cc:1434] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
W20260709 12:25:26.884318  6955 leader_election.cc:343] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.880100  7117 ts_tablet_manager.cc:1434] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:25:26.880517  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:26.885350  7066 raft_consensus.cc:3060] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.881704  7156 leader_election.cc:290] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.886940  7111 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:26.884696  7030 leader_election.cc:304] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:26.882117  7120 leader_election.cc:290] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.887640  7159 raft_consensus.cc:2804] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.887712  7156 raft_consensus.cc:493] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.894655  7112 tablet_bootstrap.cc:654] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.897203  7066 raft_consensus.cc:2468] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:26.898993  7117 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.899367  7200 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.898821  6956 leader_election.cc:304] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:26.899887  7200 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.900889  7118 raft_consensus.cc:2804] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.901458  7118 raft_consensus.cc:697] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:26.901916  7200 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.903314  7159 raft_consensus.cc:697] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:26.904541  7159 consensus_queue.cc:237] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.905829  7117 tablet_bootstrap.cc:654] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.902432  7118 consensus_queue.cc:237] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:26.908926  6918 raft_consensus.cc:3060] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.909106  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.910347  7112 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
W20260709 12:25:26.910671  7030 leader_election.cc:343] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.910864  7112 ts_tablet_manager.cc:1403] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.002s
I20260709 12:25:26.913690  7112 raft_consensus.cc:359] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.917517  7112 raft_consensus.cc:385] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.862053  7113 ts_tablet_manager.cc:1434] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:25:26.917974  7112 raft_consensus.cc:740] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.905248  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.922840  7113 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:26.923009  7112 consensus_queue.cc:260] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:26.924405  7032 leader_election.cc:343] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.924906  7032 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:26.925410  7112 ts_tablet_manager.cc:1434] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:25:26.926370  7112 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:26.927860  7159 raft_consensus.cc:2749] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:26.888471  7156 raft_consensus.cc:515] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.932312  7112 tablet_bootstrap.cc:654] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.932372  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:26.933146  6842 raft_consensus.cc:2468] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:26.934515  6955 leader_election.cc:304] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:26.937198  6738 catalog_manager.cc:5697] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.939294  7111 tablet_bootstrap.cc:654] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.916762  7207 raft_consensus.cc:515] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:26.946136  7207 leader_election.cc:290] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:26.948844  7113 tablet_bootstrap.cc:654] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:26.950623  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:26.952353  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
W20260709 12:25:26.952565  6882 leader_election.cc:343] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.952919  7176 raft_consensus.cc:2804] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.953531  7176 raft_consensus.cc:493] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.953899  7176 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.953016  6843 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:26.959741  7156 leader_election.cc:290] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:26.961987  7176 raft_consensus.cc:515] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.966231  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.967113  7208 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.970983  7208 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.973948  7208 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:26.974426  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:26.976073  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:26.976902  6917 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:26.978545  6807 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:26.980389  7208 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:26.980891  7208 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.981361  7208 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:26.982963  6805 leader_election.cc:343] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.968952  6843 raft_consensus.cc:2468] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:26.986397  7117 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:26.986943  7117 ts_tablet_manager.cc:1403] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.007s
W20260709 12:25:26.990063  6957 leader_election.cc:343] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:26.991415  7117 raft_consensus.cc:359] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.990718  6738 catalog_manager.cc:5697] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.992126  7117 raft_consensus.cc:385] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:26.992444  7117 raft_consensus.cc:740] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:26.993106  7117 consensus_queue.cc:260] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:26.995867  7117 ts_tablet_manager.cc:1434] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:26.985278  6881 leader_election.cc:304] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:26.997355  7117 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:26.998834  7207 raft_consensus.cc:2804] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:26.999841  7207 raft_consensus.cc:697] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:27.000674  7207 consensus_queue.cc:237] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.006822  7142 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.007349  7142 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.009469  7142 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.010917  7176 leader_election.cc:290] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.016810  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.017511  6915 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:27.018946  7233 consensus_queue.cc:1048] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.019735  6807 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:27.020903  7119 raft_consensus.cc:2804] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.020834  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.021461  7119 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.021670  7117 tablet_bootstrap.cc:654] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.021844  7119 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.021903  7066 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:27.026954  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:27.029186  6843 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.028177  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.026166  7208 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.035876  7113 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:27.036257  7113 ts_tablet_manager.cc:1403] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.007s
I20260709 12:25:27.037883  7112 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:27.043282  7112 ts_tablet_manager.cc:1403] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.117s	user 0.032s	sys 0.010s
I20260709 12:25:27.040325  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.032557  6918 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.044775  6917 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.039891  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:27.045060  7207 raft_consensus.cc:493] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.050137  7111 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.049892  7207 raft_consensus.cc:515] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.050828  7111 ts_tablet_manager.cc:1403] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.017s
I20260709 12:25:27.053022  7207 leader_election.cc:290] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.053702  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.054140  7156 raft_consensus.cc:493] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.054416  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.034583  7119 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.038656  7208 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.072170  7066 raft_consensus.cc:2468] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:27.076404  7111 raft_consensus.cc:359] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.078473  7111 raft_consensus.cc:385] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.078799  7111 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.080044  7112 raft_consensus.cc:359] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.080279  7111 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.069501  7156 raft_consensus.cc:515] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.082670  6918 raft_consensus.cc:2468] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:27.083927  6916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.084949  6843 raft_consensus.cc:2468] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:27.085556  7111 ts_tablet_manager.cc:1434] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:25:27.077664  7113 raft_consensus.cc:359] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.086494  7111 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:27.086593  7113 raft_consensus.cc:385] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.086968  7113 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
W20260709 12:25:27.088549  6805 leader_election.cc:343] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.080749  7112 raft_consensus.cc:385] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.089488  7113 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.089877  7112 raft_consensus.cc:740] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
W20260709 12:25:27.070755  6881 leader_election.cc:343] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.091743  6955 leader_election.cc:304] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:27.092592  6882 leader_election.cc:304] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:27.093346  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.094005  7065 raft_consensus.cc:2468] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:27.094580  7193 raft_consensus.cc:2804] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.094983  7193 raft_consensus.cc:493] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.094396  6735 catalog_manager.cc:5697] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.095311  7193 raft_consensus.cc:3060] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.082569  7156 leader_election.cc:290] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.097157  7176 consensus_queue.cc:1048] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.100226  6956 leader_election.cc:304] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:27.100735  7156 raft_consensus.cc:2804] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.101049  7118 raft_consensus.cc:2804] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.101265  7156 raft_consensus.cc:697] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:27.101497  7118 raft_consensus.cc:493] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.101868  7113 ts_tablet_manager.cc:1434] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:25:27.102962  7113 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
W20260709 12:25:27.103462  6957 leader_election.cc:343] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.102216  7156 consensus_queue.cc:237] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.103622  7112 consensus_queue.cc:260] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.101874  7118 raft_consensus.cc:3060] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.108894  6917 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.110035  6807 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:27.119042  7112 ts_tablet_manager.cc:1434] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 12:25:27.119441  7208 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.119925  7208 raft_consensus.cc:697] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:27.120096  7112 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:27.120744  7208 consensus_queue.cc:237] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.128360  7112 tablet_bootstrap.cc:654] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.132820  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:27.136183  7117 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:27.136478  7119 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.136664  7117 ts_tablet_manager.cc:1403] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.016s
I20260709 12:25:27.138279  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.138896  6915 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.139068  7113 tablet_bootstrap.cc:654] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.133667  7066 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.147926  7111 tablet_bootstrap.cc:654] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.147961  7117 raft_consensus.cc:359] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.149123  7117 raft_consensus.cc:385] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.149428  7117 raft_consensus.cc:740] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.150208  7117 consensus_queue.cc:260] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.155177  6915 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.155970  7117 ts_tablet_manager.cc:1434] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:27.157014  7117 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:27.156751  6807 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:27.157986  7119 raft_consensus.cc:2804] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.158330  7066 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.159379  7193 raft_consensus.cc:515] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.163123  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:27.164892  6881 leader_election.cc:343] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.158880  7119 raft_consensus.cc:697] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:27.167419  7118 raft_consensus.cc:515] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:27.214072  6955 consensus_peers.cc:597] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:27.216231  7193 leader_election.cc:290] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.219734  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:27.220371  7065 raft_consensus.cc:3060] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.227420  7111 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.227829  7112 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:27.227970  7111 ts_tablet_manager.cc:1403] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.142s	user 0.025s	sys 0.026s
I20260709 12:25:27.228439  7112 ts_tablet_manager.cc:1403] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.004s
I20260709 12:25:27.191957  7119 consensus_queue.cc:237] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.235502  7113 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:27.236038  7113 ts_tablet_manager.cc:1403] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.014s
I20260709 12:25:27.237802  7117 tablet_bootstrap.cc:654] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.239374  7299 consensus_queue.cc:1048] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.248452  7065 raft_consensus.cc:2468] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:27.249635  6882 leader_election.cc:304] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:27.249539  7112 raft_consensus.cc:359] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.250276  7112 raft_consensus.cc:385] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.250720  7118 leader_election.cc:290] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.250903  7207 raft_consensus.cc:2804] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.251573  7207 raft_consensus.cc:697] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:27.250555  7112 raft_consensus.cc:740] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.256183  7207 consensus_queue.cc:237] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.245831  6735 catalog_manager.cc:5697] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.262732  7111 raft_consensus.cc:359] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.263440  7111 raft_consensus.cc:385] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.263727  7111 raft_consensus.cc:740] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.270002  7112 consensus_queue.cc:260] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.272123  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.272859  7112 ts_tablet_manager.cc:1434] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:25:27.274271  7112 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:27.278275  7113 raft_consensus.cc:359] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
W20260709 12:25:27.275300  6957 leader_election.cc:343] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.275090  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0e0c62b350442fb08e7e7b97ab3322" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:27.280325  7113 raft_consensus.cc:385] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.280982  7113 raft_consensus.cc:740] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.265646  7111 consensus_queue.cc:260] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.290263  7117 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:27.290468  7111 ts_tablet_manager.cc:1434] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.004s
I20260709 12:25:27.281889  7113 consensus_queue.cc:260] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.291831  7117 ts_tablet_manager.cc:1403] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.021s
I20260709 12:25:27.293824  7111 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:27.293818  6738 catalog_manager.cc:5697] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.287854  7065 raft_consensus.cc:3060] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.301177  7113 ts_tablet_manager.cc:1434] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:25:27.302618  7113 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:27.298101  7208 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.306283  7208 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.312352  7299 consensus_queue.cc:1048] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.312700  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:27.314414  6807 leader_election.cc:343] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.300395  7119 raft_consensus.cc:493] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.316191  7208 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.320065  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.321265  7067 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:27.324157  6806 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.325011  7142 raft_consensus.cc:2804] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.325389  7142 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.325531  7111 tablet_bootstrap.cc:654] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.325798  7142 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.316207  7119 raft_consensus.cc:515] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.329490  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.330344  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d085654055944f75b6657bc46c50ffad" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.331219  7067 raft_consensus.cc:2393] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:27.336771  7112 tablet_bootstrap.cc:654] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.336788  6806 leader_election.cc:304] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:27.338104  7119 leader_election.cc:290] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.338829  7208 raft_consensus.cc:3060] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.349319  6736 catalog_manager.cc:5697] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.363932  7065 raft_consensus.cc:2468] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:27.368268  7117 raft_consensus.cc:359] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.370142  7117 raft_consensus.cc:385] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.369886  6956 leader_election.cc:304] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.370517  7117 raft_consensus.cc:740] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.371042  7298 raft_consensus.cc:2804] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.371521  7298 raft_consensus.cc:697] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
W20260709 12:25:27.371538  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:27.371538  7117 consensus_queue.cc:260] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.372442  7298 consensus_queue.cc:237] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.376032  7117 ts_tablet_manager.cc:1434] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 12:25:27.375990  7142 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.380719  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:27.382416  6807 leader_election.cc:343] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.385794  7117 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:27.384027  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:27.384256  7142 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.390872  7208 raft_consensus.cc:2749] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.392781  7065 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.401160  7112 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:27.401780  7112 ts_tablet_manager.cc:1403] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.001s
I20260709 12:25:27.404919  7112 raft_consensus.cc:359] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.405514  7112 raft_consensus.cc:385] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.405786  7112 raft_consensus.cc:740] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.409149  7112 consensus_queue.cc:260] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.409622  7299 raft_consensus.cc:493] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.410530  7299 raft_consensus.cc:515] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.411634  7112 ts_tablet_manager.cc:1434] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:25:27.413177  7112 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:27.415095  7299 leader_election.cc:290] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.423620  7220 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.427605  7220 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.429035  7233 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.429764  7220 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.430361  7200 raft_consensus.cc:493] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.435304  7113 tablet_bootstrap.cc:654] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.426159  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.429526  7233 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.424528  7111 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.435835  6843 raft_consensus.cc:2468] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:27.436040  7111 ts_tablet_manager.cc:1403] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.006s
I20260709 12:25:27.423405  7193 consensus_queue.cc:1048] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.431923  7112 tablet_bootstrap.cc:654] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.434962  7200 raft_consensus.cc:515] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.424599  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.434204  7065 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.441857  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:27.443985  6881 leader_election.cc:343] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.445166  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.447621  6955 leader_election.cc:304] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:27.447675  6806 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.449435  7142 raft_consensus.cc:2804] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.449260  7111 raft_consensus.cc:359] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.449999  7111 raft_consensus.cc:385] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.450359  7159 consensus_queue.cc:1048] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.451860  7200 leader_election.cc:290] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:27.452160  6957 leader_election.cc:343] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.437319  7233 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:27.449296  7118 raft_consensus.cc:2804] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.453336  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.454232  7299 consensus_queue.cc:1048] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.454608  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.449947  7142 raft_consensus.cc:697] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:27.456599  7142 consensus_queue.cc:237] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.456990  6735 catalog_manager.cc:5697] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.457787  7118 raft_consensus.cc:493] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.458287  7118 raft_consensus.cc:3060] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:27.460302  7030 leader_election.cc:343] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.453274  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.450400  7111 raft_consensus.cc:740] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.464921  7111 consensus_queue.cc:260] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.471431  7117 tablet_bootstrap.cc:654] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:27.473469  6881 leader_election.cc:343] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.474021  6881 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:27.474830  7207 raft_consensus.cc:2749] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.475528  7208 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.477221  7208 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.479416  7208 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.481019  7118 raft_consensus.cc:515] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.483376  7118 leader_election.cc:290] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:27.476014  7030 leader_election.cc:343] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.484457  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.484789  7065 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.485163  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.486824  7111 ts_tablet_manager.cc:1434] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 12:25:27.507434  7111 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
W20260709 12:25:27.503916  6957 leader_election.cc:343] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.508392  7030 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:27.512897  7200 raft_consensus.cc:2749] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.515769  6736 catalog_manager.cc:5697] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.513698  7030 leader_election.cc:304] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.535516  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:27.536361  6838 raft_consensus.cc:3060] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.534739  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.539101  6917 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:27.539595  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.540316  6991 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:27.540411  6807 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:27.541393  7208 raft_consensus.cc:2804] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.541837  7208 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.545822  7208 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.550472  7118 consensus_queue.cc:1048] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.556274  7208 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.564878  7111 tablet_bootstrap.cc:654] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.566207  7117 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:27.566952  7117 ts_tablet_manager.cc:1403] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.012s
I20260709 12:25:27.569952  7117 raft_consensus.cc:359] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.570608  7117 raft_consensus.cc:385] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.573730  7200 raft_consensus.cc:2749] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.577937  7193 consensus_queue.cc:1048] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.584033  7113 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:27.584383  6991 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.584605  7113 ts_tablet_manager.cc:1403] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.283s	user 0.026s	sys 0.021s
I20260709 12:25:27.586790  7112 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:27.587277  7112 ts_tablet_manager.cc:1403] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.000s
I20260709 12:25:27.589138  7113 raft_consensus.cc:359] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.589843  7113 raft_consensus.cc:385] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.590114  7113 raft_consensus.cc:740] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.592170  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.592768  6917 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.593544  7113 consensus_queue.cc:260] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.597802  7298 consensus_queue.cc:1048] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.599963  7113 ts_tablet_manager.cc:1434] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:27.600538  6917 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.601864  6807 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:27.602754  7119 raft_consensus.cc:2804] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.603360  7119 raft_consensus.cc:697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:27.590046  7112 raft_consensus.cc:359] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.603950  7112 raft_consensus.cc:385] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.604254  7112 raft_consensus.cc:740] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.604511  7119 consensus_queue.cc:237] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.606269  7208 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.607321  7118 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.584638  6838 raft_consensus.cc:2468] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:27.607903  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:27.608165  7118 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.608582  6993 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.570883  7117 raft_consensus.cc:740] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.612051  6955 leader_election.cc:304] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.612198  7117 consensus_queue.cc:260] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.613464  7298 raft_consensus.cc:2804] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:27.605062  7112 consensus_queue.cc:260] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.614300  7298 raft_consensus.cc:697] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:27.633615  7298 consensus_queue.cc:237] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.634222  7113 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:27.618551  7299 raft_consensus.cc:493] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.637272  7299 raft_consensus.cc:515] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.639436  7299 leader_election.cc:290] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:27.623054  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.640457  6917 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:27.641469  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.621670  7118 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.620213  7111 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.614550  7142 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:25:27.644045  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9448e5bc5adc4a0383825437ec1a466b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.644337  7111 ts_tablet_manager.cc:1403] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.005s
I20260709 12:25:27.646967  6955 leader_election.cc:304] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:27.648290  6993 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:27.649235  7299 raft_consensus.cc:2749] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.647279  7111 raft_consensus.cc:359] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.652258  7111 raft_consensus.cc:385] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.652583  7111 raft_consensus.cc:740] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.653602  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.653927  7111 consensus_queue.cc:260] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.654541  6957 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:27.656710  7111 ts_tablet_manager.cc:1434] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
W20260709 12:25:27.626583  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:27.657805  7111 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:27.661830  7113 tablet_bootstrap.cc:654] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.662257  7200 raft_consensus.cc:493] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.662868  7200 raft_consensus.cc:515] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:27.663643  6737 catalog_manager.cc:5697] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.665135  7200 leader_election.cc:290] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.666927  7208 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.669353  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:27.669705  7112 ts_tablet_manager.cc:1434] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 12:25:27.673429  7112 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:27.674839  7030 leader_election.cc:343] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.675035  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.677745  7111 tablet_bootstrap.cc:654] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.614261  7117 ts_tablet_manager.cc:1434] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.000s
I20260709 12:25:27.685451  6739 catalog_manager.cc:5697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.688795  7117 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:27.689522  6739 catalog_manager.cc:5697] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.684562  7298 consensus_queue.cc:1048] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 12:25:27.693979  7032 leader_election.cc:343] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.698629  7032 leader_election.cc:304] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.712212  7113 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:27.712728  7113 ts_tablet_manager.cc:1403] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.011s
I20260709 12:25:27.708603  7233 raft_consensus.cc:2749] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.721431  7299 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:27.736335  7112 tablet_bootstrap.cc:654] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.738883  7113 raft_consensus.cc:359] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.739624  7113 raft_consensus.cc:385] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.739869  7113 raft_consensus.cc:740] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.741528  7113 consensus_queue.cc:260] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.745427  7117 tablet_bootstrap.cc:654] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.745833  7321 consensus_queue.cc:1048] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:25:27.763726  7113 ts_tablet_manager.cc:1434] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:25:27.766019  7113 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:27.772966  7111 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.773926  7111 ts_tablet_manager.cc:1403] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.028s
I20260709 12:25:27.777413  7111 raft_consensus.cc:359] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.778138  7111 raft_consensus.cc:385] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.778402  7111 raft_consensus.cc:740] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.789834  7111 consensus_queue.cc:260] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.794658  7299 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:27.795228  7299 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:27.811314  7299 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.814927  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:27.816591  7112 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:27.816671  7299 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:27.817276  7112 ts_tablet_manager.cc:1403] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.006s
I20260709 12:25:27.819494  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:27.822256  6955 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.823763  7118 raft_consensus.cc:2749] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:27.824783  7142 consensus_queue.cc:1048] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.825677  7111 ts_tablet_manager.cc:1434] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.003s
I20260709 12:25:27.826653  7111 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:27.831715  6992 raft_consensus.cc:3060] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.832154  7112 raft_consensus.cc:359] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.832928  7112 raft_consensus.cc:385] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.833206  7112 raft_consensus.cc:740] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.833516  7119 raft_consensus.cc:493] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.833871  7112 consensus_queue.cc:260] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:27.834040  7119 raft_consensus.cc:515] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:27.837697  7111 tablet_bootstrap.cc:654] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.839541  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.835508  7112 ts_tablet_manager.cc:1434] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:25:27.841934  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.843606  7112 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:27.844427  6807 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:27.849772  6881 consensus_peers.cc:597] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:27.852288  6805 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.855350  7113 tablet_bootstrap.cc:654] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.859179  6805 leader_election.cc:304] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.839684  7119 leader_election.cc:290] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.862721  7208 raft_consensus.cc:2749] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:27.865803  7299 raft_consensus.cc:493] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.866412  7299 raft_consensus.cc:515] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.866672  7139 consensus_queue.cc:1048] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.895912  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:27.897642  6957 leader_election.cc:343] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.902464  7299 leader_election.cc:290] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:27.903139  7112 tablet_bootstrap.cc:654] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:27.904629  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:27.905534  7066 raft_consensus.cc:2468] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:27.907297  6956 leader_election.cc:304] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:27.908152  7299 consensus_queue.cc:1048] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.908470  7118 raft_consensus.cc:2804] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.909042  7118 raft_consensus.cc:493] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.909487  7118 raft_consensus.cc:3060] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.909919  7117 tablet_bootstrap.cc:492] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:27.910393  7117 ts_tablet_manager.cc:1403] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.004s
I20260709 12:25:27.912710  7200 raft_consensus.cc:493] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.913380  7200 raft_consensus.cc:515] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.916185  7200 leader_election.cc:290] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:27.915990  7117 raft_consensus.cc:359] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.916749  7117 raft_consensus.cc:385] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:27.917047  7117 raft_consensus.cc:740] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:27.917249  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:27.923018  7139 raft_consensus.cc:493] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.923528  7139 raft_consensus.cc:515] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.974383  7117 consensus_queue.cc:260] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.982712  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:27.983552  6915 raft_consensus.cc:2468] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:27.984308  6917 raft_consensus.cc:3060] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:27.984741  7030 leader_election.cc:343] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:27.985345  7032 leader_election.cc:304] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:27.986862  7159 raft_consensus.cc:2804] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:27.987299  7159 raft_consensus.cc:493] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.987022  7118 raft_consensus.cc:515] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:27.987692  7159 raft_consensus.cc:3060] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:27.991605  7142 consensus_queue.cc:1048] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:27.993321  7299 consensus_queue.cc:1048] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:27.997153  7111 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:27.997673  7111 ts_tablet_manager.cc:1403] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.022s
I20260709 12:25:27.999614  7112 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:28.000217  7112 ts_tablet_manager.cc:1403] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.157s	user 0.006s	sys 0.018s
I20260709 12:25:27.999500  7159 raft_consensus.cc:515] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.003239  7117 ts_tablet_manager.cc:1434] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:25:28.003180  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:28.004288  7117 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
W20260709 12:25:28.004846  7030 leader_election.cc:343] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:28.007778  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:28.009179  6957 leader_election.cc:343] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:28.009361  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:28.005748  7159 leader_election.cc:290] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:28.012614  7112 raft_consensus.cc:359] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:28.032805  7112 raft_consensus.cc:385] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.016942  7111 raft_consensus.cc:359] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.010005  7064 raft_consensus.cc:3060] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.037469  7112 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.038452  7111 raft_consensus.cc:385] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.039667  7111 raft_consensus.cc:740] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.039803  7112 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:28.014802  7118 leader_election.cc:290] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:28.043828  7139 leader_election.cc:290] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:28.044589  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
W20260709 12:25:28.023403  6807 consensus_peers.cc:597] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:28.048203  7111 consensus_queue.cc:260] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.050360  7063 raft_consensus.cc:2393] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:28.056860  7117 tablet_bootstrap.cc:654] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.041749  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:28.059296  6917 raft_consensus.cc:3060] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.060554  7321 consensus_queue.cc:1048] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:28.062642  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:28.067574  6881 leader_election.cc:343] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:28.069536  6881 leader_election.cc:304] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
W20260709 12:25:28.091809  7339 log.cc:927] Time spent T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:28.094417  6917 raft_consensus.cc:2468] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:28.100939  7330 raft_consensus.cc:2749] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:28.094975  7111 ts_tablet_manager.cc:1434] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.011s
I20260709 12:25:28.105556  7111 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:28.108556  7032 leader_election.cc:304] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:28.111431  7112 ts_tablet_manager.cc:1434] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.111s	user 0.013s	sys 0.009s
I20260709 12:25:28.112768  7112 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:28.074723  7064 raft_consensus.cc:2468] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:28.114056  7233 raft_consensus.cc:2804] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:28.124922  7119 consensus_queue.cc:1048] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:28.125381  7233 raft_consensus.cc:697] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:28.143191  6956 leader_election.cc:304] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:28.151264  7112 tablet_bootstrap.cc:654] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.151907  7176 raft_consensus.cc:2804] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:28.154345  7176 raft_consensus.cc:697] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:28.155586  7176 consensus_queue.cc:237] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.159416  7233 consensus_queue.cc:237] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.161986  7117 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:28.162487  7117 ts_tablet_manager.cc:1403] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.001s
W20260709 12:25:28.163538  6957 consensus_peers.cc:597] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:28.165729  7117 raft_consensus.cc:359] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.166428  7117 raft_consensus.cc:385] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.166724  7117 raft_consensus.cc:740] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.167487  7117 consensus_queue.cc:260] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.169971  7117 ts_tablet_manager.cc:1434] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:28.170986  7117 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:28.171345  7111 tablet_bootstrap.cc:654] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.177510  7117 tablet_bootstrap.cc:654] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.179983  7113 tablet_bootstrap.cc:492] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:28.180594  7113 ts_tablet_manager.cc:1403] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.416s	user 0.052s	sys 0.033s
I20260709 12:25:28.193656  7113 raft_consensus.cc:359] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.194742  7113 raft_consensus.cc:385] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.201931  7113 raft_consensus.cc:740] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.202667  7113 consensus_queue.cc:260] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.205260  7113 ts_tablet_manager.cc:1434] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:25:28.206205  7113 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:28.209810  7299 consensus_queue.cc:1048] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:28.233551  6992 raft_consensus.cc:1240] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Rejecting Update request from peer 91e8bb7cfca34631a0d9c45d8b139301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:28.236511  7117 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:28.237080  7117 ts_tablet_manager.cc:1403] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.004s
I20260709 12:25:28.240291  7117 raft_consensus.cc:359] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:28.241117  7117 raft_consensus.cc:385] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.241387  7117 raft_consensus.cc:740] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.241469  7113 tablet_bootstrap.cc:654] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.242113  7117 consensus_queue.cc:260] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:28.245298  7117 ts_tablet_manager.cc:1434] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:28.246512  7117 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:28.254817  7117 tablet_bootstrap.cc:654] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.632040  7321 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.632793  7321 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:28.633695  7139 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.634338  7139 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.636230  7321 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:28.636973  7139 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:28.668639  6838 raft_consensus.cc:3060] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:28.676354  7112 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.018s	sys 0.042s
I20260709 12:25:28.676717  7113 tablet_bootstrap.cc:492] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:28.687273  7113 ts_tablet_manager.cc:1403] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.481s	user 0.012s	sys 0.001s
I20260709 12:25:28.690078  7113 raft_consensus.cc:359] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.690790  7113 raft_consensus.cc:385] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.691082  7113 raft_consensus.cc:740] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.691751  7113 consensus_queue.cc:260] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.694773  7113 ts_tablet_manager.cc:1434] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
W20260709 12:25:28.676772  7112 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.018s	sys 0.042s
W20260709 12:25:28.701288  7111 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.013s	sys 0.013s
W20260709 12:25:28.701723  7111 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.013s	sys 0.013s
I20260709 12:25:28.710991  7355 consensus_queue.cc:1059] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:28.712155  7355 raft_consensus.cc:3055] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:28.712519  7355 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:28.713363  7355 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:28.716931  7355 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:28.718827  6916 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.731539  7176 raft_consensus.cc:493] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.732106  7176 raft_consensus.cc:515] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.734261  7176 leader_election.cc:290] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:28.737455  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:28.742441  6805 leader_election.cc:343] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:28.759696  7111 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:28.760356  7111 ts_tablet_manager.cc:1403] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.655s	user 0.021s	sys 0.013s
I20260709 12:25:28.779608  7111 raft_consensus.cc:359] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.780333  7111 raft_consensus.cc:385] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.780598  7111 raft_consensus.cc:740] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.783618  7112 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:28.784178  7112 ts_tablet_manager.cc:1403] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.672s	user 0.028s	sys 0.043s
I20260709 12:25:28.787976  7111 consensus_queue.cc:260] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:28.813853  6991 raft_consensus.cc:3060] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.829698  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:28.831374  7113 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:28.854696  7113 tablet_bootstrap.cc:654] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:28.864365  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:28.908535  6915 raft_consensus.cc:3060] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:28.909924  6957 consensus_peers.cc:597] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:28.917608  7117 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.007s	sys 0.005s
W20260709 12:25:28.918021  7117 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.005s
I20260709 12:25:28.923753  7112 raft_consensus.cc:359] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:28.924346  7112 raft_consensus.cc:385] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.924574  7112 raft_consensus.cc:740] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.925210  7112 consensus_queue.cc:260] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:28.927479  7112 ts_tablet_manager.cc:1434] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.001s
I20260709 12:25:28.932298  7117 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:28.932906  7117 ts_tablet_manager.cc:1403] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.687s	user 0.018s	sys 0.007s
I20260709 12:25:28.951838  7117 raft_consensus.cc:359] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.954578  7117 raft_consensus.cc:385] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.954945  7117 raft_consensus.cc:740] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.955789  7117 consensus_queue.cc:260] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.957367  7111 ts_tablet_manager.cc:1434] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.197s	user 0.016s	sys 0.005s
I20260709 12:25:28.958704  7111 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:28.961359  7117 ts_tablet_manager.cc:1434] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:25:28.961899  7113 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:28.962592  7113 ts_tablet_manager.cc:1403] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.014s
I20260709 12:25:28.966818  6739 catalog_manager.cc:5697] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:28.966313  7374 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.970484  7374 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:28.972573  7374 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:28.976926  7112 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:28.982577  7113 raft_consensus.cc:359] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:28.984354  7113 raft_consensus.cc:385] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.984809  7113 raft_consensus.cc:740] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.986768  7113 consensus_queue.cc:260] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:28.988792  7111 tablet_bootstrap.cc:654] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.991142  7113 ts_tablet_manager.cc:1434] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 12:25:28.992782  7113 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:28.999781  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.000777  7113 tablet_bootstrap.cc:654] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.002151  7111 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.002595  7111 ts_tablet_manager.cc:1403] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 12:25:29.010859  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.012290  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.014829  7117 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:29.018484  7375 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.019096  7375 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.021279  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.021942  7064 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:29.022189  7111 raft_consensus.cc:359] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.022881  7111 raft_consensus.cc:385] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.023130  7111 raft_consensus.cc:740] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.023743  7111 consensus_queue.cc:260] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.024224  7375 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:29.025609  7111 ts_tablet_manager.cc:1434] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:25:29.028636  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab49fd7331d54059a88d037ef5ada96d" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.033296  6956 leader_election.cc:304] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:29.034505  7299 raft_consensus.cc:2749] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.033538  7117 tablet_bootstrap.cc:654] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.036829  7299 consensus_queue.cc:1048] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:29.040071  7111 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
W20260709 12:25:29.046195  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 46749.6us
I20260709 12:25:29.056030  6989 raft_consensus.cc:3060] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.057193  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.072325  7112 tablet_bootstrap.cc:654] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.072233  6806 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:29.076799  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.079515  6918 raft_consensus.cc:2468] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
W20260709 12:25:29.072125  7032 leader_election.cc:343] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.080780  7355 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.082507  7355 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.085124  7355 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:29.082129  7030 leader_election.cc:343] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.087589  7030 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:29.088729  7111 tablet_bootstrap.cc:654] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.094786  7117 tablet_bootstrap.cc:492] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:29.095345  7117 ts_tablet_manager.cc:1403] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.006s
I20260709 12:25:29.103693  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.103756  7375 consensus_queue.cc:1048] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:29.102974  7032 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.091428  7382 raft_consensus.cc:2749] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.114661  7117 raft_consensus.cc:359] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.119006  7117 raft_consensus.cc:385] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.119503  7117 raft_consensus.cc:740] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.109107  7362 raft_consensus.cc:2804] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.123498  7362 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.124014  7362 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.124617  7321 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.125128  7321 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.107887  6882 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:29.127215  7321 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.128690  7139 raft_consensus.cc:2749] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.129225  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.129724  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.129891  6915 raft_consensus.cc:2468] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:29.131016  6807 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.131938  7353 raft_consensus.cc:2804] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.132313  7353 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.132650  7353 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.123696  7117 consensus_queue.cc:260] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:29.137022  7030 leader_election.cc:343] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:29.140019  6805 leader_election.cc:343] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.144326  7117 ts_tablet_manager.cc:1434] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:25:29.152084  7117 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:29.153719  7353 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.107252  7355 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.157258  7355 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:29.158778  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:29.160269  6805 leader_election.cc:343] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.160055  7375 consensus_queue.cc:1048] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:29.210992  7365 raft_consensus.cc:493] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.211759  7365 raft_consensus.cc:515] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.217806  7375 raft_consensus.cc:493] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.218513  7375 raft_consensus.cc:515] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.227339  7362 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.229589  7362 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:29.230238  7032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 67308.2us
I20260709 12:25:29.231340  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:29.232450  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:29.232489  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:29.233153  7065 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.233258  6915 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:29.234602  7030 leader_election.cc:343] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.240439  7353 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.227385  7112 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:29.249292  7112 ts_tablet_manager.cc:1403] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.273s	user 0.031s	sys 0.030s
I20260709 12:25:29.250036  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:29.250690  6917 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.279718  7111 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.233229  7117 tablet_bootstrap.cc:654] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.282642  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.284055  6915 raft_consensus.cc:2468] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:29.279796  7065 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:29.280371  7111 ts_tablet_manager.cc:1403] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.241s	user 0.019s	sys 0.009s
I20260709 12:25:29.282027  7112 raft_consensus.cc:359] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.287649  7112 raft_consensus.cc:385] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.288725  7112 raft_consensus.cc:740] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.289575  7112 consensus_queue.cc:260] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.289762  7111 raft_consensus.cc:359] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.290537  7111 raft_consensus.cc:385] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.290879  7111 raft_consensus.cc:740] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.291779  7111 consensus_queue.cc:260] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.292734  7117 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
W20260709 12:25:29.293047  7030 leader_election.cc:343] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.293213  7117 ts_tablet_manager.cc:1403] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.147s	user 0.008s	sys 0.014s
I20260709 12:25:29.293468  7111 ts_tablet_manager.cc:1434] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:29.294114  7299 raft_consensus.cc:493] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.294423  7111 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:29.294759  7299 raft_consensus.cc:515] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.297052  7299 leader_election.cc:290] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.298317  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.299044  7064 raft_consensus.cc:2468] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:29.300329  6956 leader_election.cc:304] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:29.301525  7111 tablet_bootstrap.cc:654] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.301579  6806 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:29.302624  7392 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.291815  7112 ts_tablet_manager.cc:1434] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.005s
I20260709 12:25:29.304714  7112 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:29.307564  6738 catalog_manager.cc:5697] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.311326  7112 tablet_bootstrap.cc:654] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.303097  7392 raft_consensus.cc:697] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:29.312631  7392 consensus_queue.cc:237] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.296113  7117 raft_consensus.cc:359] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.315521  7299 raft_consensus.cc:2804] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.327343  7299 raft_consensus.cc:493] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.327688  7299 raft_consensus.cc:3060] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.315289  7117 raft_consensus.cc:385] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.330797  7117 raft_consensus.cc:740] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.330868  7375 leader_election.cc:290] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.331526  7117 consensus_queue.cc:260] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.333666  7117 ts_tablet_manager.cc:1434] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.003s
I20260709 12:25:29.333456  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.333984  7365 leader_election.cc:290] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:29.333385  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f24fa29e8f341e6919b603667ee2245" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.334596  7117 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:29.340062  6956 leader_election.cc:304] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:29.341424  7369 raft_consensus.cc:2749] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:29.321883  7111 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.346197  7299 raft_consensus.cc:515] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.348250  7299 leader_election.cc:290] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.349138  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:29.349766  7064 raft_consensus.cc:3060] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.350018  7111 ts_tablet_manager.cc:1403] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.010s
W20260709 12:25:29.350876  6806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 49397.1us
I20260709 12:25:29.354175  7111 raft_consensus.cc:359] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.354933  7111 raft_consensus.cc:385] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.355195  7111 raft_consensus.cc:740] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.355866  7111 consensus_queue.cc:260] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.357798  7064 raft_consensus.cc:2468] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:29.358820  7117 tablet_bootstrap.cc:654] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.359254  6956 leader_election.cc:304] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:29.359551  6917 raft_consensus.cc:2468] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:29.360777  7299 raft_consensus.cc:2804] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.362967  7111 ts_tablet_manager.cc:1434] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:29.363976  7358 raft_consensus.cc:493] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.364171  7111 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:29.364496  7358 raft_consensus.cc:515] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.366652  7358 leader_election.cc:290] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:29.369217  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.370811  7299 raft_consensus.cc:697] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:29.362339  6736 catalog_manager.cc:5697] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:29.369508  6807 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.372189  7299 consensus_queue.cc:237] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.380395  7392 raft_consensus.cc:2804] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.380970  7392 raft_consensus.cc:697] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:29.383414  6917 raft_consensus.cc:3060] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.382066  7392 consensus_queue.cc:237] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.370833  7111 tablet_bootstrap.cc:654] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.315294  6739 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42178 (request call id 52) took 1081 ms. Trace:
I20260709 12:25:29.390017  6739 rpcz_store.cc:276] 0709 12:25:28.234335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.664083 (+429748us) service_pool.cc:224] Handling call
0709 12:25:29.315234 (+651151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:29.074163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:29.079434 (+  5271us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:29.079472 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:25:29.079493 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:29.079855 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:29.079944 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:29.079987 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:29.080179 (+   192us) tablet.cc:701] Row locks acquired
0709 12:25:29.080201 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:25:29.080344 (+   143us) write_op.cc:270] Start()
0709 12:25:29.080458 (+   114us) write_op.cc:276] Timestamp: P: 1783599929080302 usec, L: 0
0709 12:25:29.080479 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:25:29.081201 (+   722us) log.cc:844] Serialized 543 byte log entry
0709 12:25:29.279971 (+198770us) op_driver.cc:464] REPLICATION: finished
0709 12:25:29.292660 (+ 12689us) write_op.cc:301] APPLY: starting
0709 12:25:29.293316 (+   656us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:29.293404 (+    88us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:29.293726 (+   322us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:29.293933 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:29.294088 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:29.294154 (+    66us) write_op.cc:312] APPLY: finished
0709 12:25:29.294333 (+   179us) log.cc:844] Serialized 22 byte log entry
0709 12:25:29.303030 (+  8697us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:29.303136 (+   106us) write_op.cc:454] Released schema lock
0709 12:25:29.303177 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:29.303512 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:29.303542 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27540,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":12469,"apply.run_cpu_time_us":1589,"apply.run_wall_time_us":10844,"num_ops":1,"prepare.queue_time_us":75004,"prepare.run_cpu_time_us":14283,"prepare.run_wall_time_us":55131,"raft.queue_time_us":34093,"raft.run_cpu_time_us":1275,"raft.run_wall_time_us":13862,"replication_time_us":199340,"thread_start_us":83982,"threads_started":4,"wal-append.queue_time_us":162794}]]}
I20260709 12:25:29.395406  7375 raft_consensus.cc:493] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.396106  7375 raft_consensus.cc:515] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.400524  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:29.402387  7030 leader_election.cc:343] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.409636  7111 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.410167  7111 ts_tablet_manager.cc:1403] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.010s
I20260709 12:25:29.439273  7375 leader_election.cc:290] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:29.445744  7111 raft_consensus.cc:359] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.446748  7111 raft_consensus.cc:385] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.447088  7111 raft_consensus.cc:740] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.452384  7111 consensus_queue.cc:260] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.454427  7112 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:29.455109  7112 ts_tablet_manager.cc:1403] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.000s
I20260709 12:25:29.454509  7111 ts_tablet_manager.cc:1434] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:25:29.457710  7112 raft_consensus.cc:359] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.458351  7112 raft_consensus.cc:385] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.458662  7382 raft_consensus.cc:493] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.458616  7111 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:29.459403  7382 raft_consensus.cc:515] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.462522  7382 leader_election.cc:290] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.458626  7112 raft_consensus.cc:740] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.464069  7112 consensus_queue.cc:260] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.468561  7112 ts_tablet_manager.cc:1434] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:29.469852  7112 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:29.470598  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.473865  7111 tablet_bootstrap.cc:654] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.477636  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:29.477934  7112 tablet_bootstrap.cc:654] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.483062  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:29.486466  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a46d9ac5bf4436ebd73557d3bf268d3" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.503153  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.503535  6737 catalog_manager.cc:5697] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:29.507588  6805 leader_election.cc:343] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.507822  7030 leader_election.cc:304] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:29.509318  7378 raft_consensus.cc:2749] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.509506  7111 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.510277  7111 ts_tablet_manager.cc:1403] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.052s	user 0.001s	sys 0.015s
I20260709 12:25:29.517645  7358 raft_consensus.cc:493] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.515353  7111 raft_consensus.cc:359] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.518173  7358 raft_consensus.cc:515] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.518890  7111 raft_consensus.cc:385] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.519608  7111 raft_consensus.cc:740] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.520412  7358 leader_election.cc:290] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.521243  7111 consensus_queue.cc:260] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.522042  7382 raft_consensus.cc:493] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.522897  7382 raft_consensus.cc:515] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.524195  7392 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.524796  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.526963  7064 raft_consensus.cc:2468] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:29.527977  6739 catalog_manager.cc:5697] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.527889  7392 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.535386  6882 leader_election.cc:304] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.536487  7139 raft_consensus.cc:2804] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.536885  7139 raft_consensus.cc:493] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.537266  7139 raft_consensus.cc:3060] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.538025  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:29.538885  7064 raft_consensus.cc:2393] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:29.541152  7392 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:29.542619  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.544791  7113 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:29.547261  7113 ts_tablet_manager.cc:1403] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.555s	user 0.007s	sys 0.023s
I20260709 12:25:29.548731  7117 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
W20260709 12:25:29.528956  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 282321us
I20260709 12:25:29.549340  7117 ts_tablet_manager.cc:1403] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.215s	user 0.034s	sys 0.031s
I20260709 12:25:29.550658  7111 ts_tablet_manager.cc:1434] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:25:29.551666  7111 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:29.555611  6915 raft_consensus.cc:2393] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:29.556516  7139 raft_consensus.cc:515] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.557289  6807 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:29.557931  7111 tablet_bootstrap.cc:654] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.558775  7392 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.558791  7139 leader_election.cc:290] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.563314  7321 raft_consensus.cc:493] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.564041  7321 raft_consensus.cc:515] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.568864  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:29.569458  7065 raft_consensus.cc:3060] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.574079  7113 raft_consensus.cc:359] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.574795  7113 raft_consensus.cc:385] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.575057  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:29.577864  6807 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.579768  7382 leader_election.cc:290] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.582224  7321 leader_election.cc:290] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.588462  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a234f4a74e149dba651295b231774a6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.575062  7113 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
W20260709 12:25:29.601676  6955 leader_election.cc:343] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:29.603101  6955 leader_election.cc:343] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:29.605109  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 53541.8us
W20260709 12:25:29.605842  7030 leader_election.cc:343] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.609691  7139 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:29.610442  7139 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.613178  7139 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.617980  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.624992  7117 raft_consensus.cc:359] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.625804  7117 raft_consensus.cc:385] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.626027  7112 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:29.626127  7117 raft_consensus.cc:740] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.626585  7112 ts_tablet_manager.cc:1403] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.016s
I20260709 12:25:29.629410  7112 raft_consensus.cc:359] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.630077  7112 raft_consensus.cc:385] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.630352  7112 raft_consensus.cc:740] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.630410  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.631186  6840 raft_consensus.cc:2468] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:29.631748  7392 raft_consensus.cc:2749] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.631430  7112 consensus_queue.cc:260] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.633778  7065 raft_consensus.cc:2468] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:29.636940  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.637274  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
W20260709 12:25:29.639919  6805 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.640107  7113 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.647747  6882 leader_election.cc:304] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.649181  7112 ts_tablet_manager.cc:1434] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:29.651414  7117 consensus_queue.cc:260] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.661609  7117 ts_tablet_manager.cc:1434] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.112s	user 0.003s	sys 0.003s
W20260709 12:25:29.662014  7032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 90838.1us
I20260709 12:25:29.663360  7117 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:29.666112  7032 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:29.667354  7378 raft_consensus.cc:2804] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.674276  7113 ts_tablet_manager.cc:1434] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.127s	user 0.006s	sys 0.001s
I20260709 12:25:29.675508  7113 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:29.651863  6840 raft_consensus.cc:3060] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.650763  6805 leader_election.cc:304] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:29.679436  7030 leader_election.cc:343] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.682742  7113 tablet_bootstrap.cc:654] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.687918  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.688658  6917 raft_consensus.cc:2468] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 0.
I20260709 12:25:29.667838  7139 raft_consensus.cc:2804] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.689414  7139 raft_consensus.cc:697] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:29.690094  7117 tablet_bootstrap.cc:654] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.689695  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.690623  7139 consensus_queue.cc:237] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.650697  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed2255b163114a85a8a2aa5394891f9e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.693212  7378 raft_consensus.cc:697] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
W20260709 12:25:29.694248  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 54362.7us
I20260709 12:25:29.695448  7392 raft_consensus.cc:2749] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.699668  7378 consensus_queue.cc:237] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.720573  7032 leader_election.cc:304] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:29.724941  7112 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:29.707154  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.728078  6837 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 2.
I20260709 12:25:29.731297  7414 raft_consensus.cc:2804] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.731777  7414 raft_consensus.cc:493] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.732175  7414 raft_consensus.cc:3060] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.735500  7413 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.735983  7413 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.738204  7413 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:29.717387  6840 raft_consensus.cc:2468] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:29.740569  7111 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:29.741137  7111 ts_tablet_manager.cc:1403] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.190s	user 0.030s	sys 0.024s
I20260709 12:25:29.749859  7111 raft_consensus.cc:359] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.750370  7111 raft_consensus.cc:385] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.750612  7111 raft_consensus.cc:740] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.751818  7111 consensus_queue.cc:260] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.758162  7112 tablet_bootstrap.cc:654] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.755468  6881 leader_election.cc:304] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:29.760929  7394 raft_consensus.cc:2749] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:29.763088  7032 leader_election.cc:343] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:29.763523  7032 leader_election.cc:304] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:29.765501  7111 ts_tablet_manager.cc:1434] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:25:29.764781  7374 raft_consensus.cc:2749] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:29.769865  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.770689  6989 raft_consensus.cc:2393] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:29.775543  7362 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.775988  7362 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.777889  7362 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.780068  7113 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:29.780572  7113 ts_tablet_manager.cc:1403] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.025s
I20260709 12:25:29.785251  7111 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:29.795758  7299 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.796501  7299 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
W20260709 12:25:29.799088  6805 consensus_peers.cc:597] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:29.856758  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 57837.4us
W20260709 12:25:29.828620  7088 debug-util.cc:398] Leaking SignalData structure 0x7b080022bc80 after lost signal to thread 30274
W20260709 12:25:29.854149  7419 log.cc:927] Time spent T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:29.858534  7386 consensus_queue.cc:1048] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:29.859705  7088 debug-util.cc:398] Leaking SignalData structure 0x7b080013f720 after lost signal to thread 6774
I20260709 12:25:29.860441  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:29.861199  7088 debug-util.cc:398] Leaking SignalData structure 0x7b0800258400 after lost signal to thread 6867
I20260709 12:25:29.861162  6915 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
W20260709 12:25:29.862504  6956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 87954.6us
I20260709 12:25:29.863057  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:29.868291  6957 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
W20260709 12:25:29.862637  7088 debug-util.cc:398] Leaking SignalData structure 0x7b080008db20 after lost signal to thread 6942
W20260709 12:25:29.872251  7088 debug-util.cc:398] Leaking SignalData structure 0x7b0800121720 after lost signal to thread 7017
W20260709 12:25:29.875264  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 165270us
I20260709 12:25:29.875232  7414 raft_consensus.cc:515] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.877516  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.864156  6739 catalog_manager.cc:5697] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.880463  7117 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:29.880903  7414 leader_election.cc:290] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.881585  6881 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:29.882927  7112 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:29.883463  7112 ts_tablet_manager.cc:1403] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.159s	user 0.011s	sys 0.001s
I20260709 12:25:29.881021  7117 ts_tablet_manager.cc:1403] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.003s
I20260709 12:25:29.854148  7299 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:29.888571  7416 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:29.888176  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8120 after lost signal to thread 7091
I20260709 12:25:29.896010  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.896533  7111 tablet_bootstrap.cc:654] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.896803  6837 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:29.897131  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:29.901173  6736 catalog_manager.cc:5697] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:29.903095  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:29.904992  6839 raft_consensus.cc:3060] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.905646  7113 raft_consensus.cc:359] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.906426  7113 raft_consensus.cc:385] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.906754  7113 raft_consensus.cc:740] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.907624  7113 consensus_queue.cc:260] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.925823  7383 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.927004  7299 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:29.931156  7299 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.931572  7299 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:29.935376  7113 ts_tablet_manager.cc:1434] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.154s	user 0.014s	sys 0.009s
I20260709 12:25:29.892630  7416 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:29.948829  7416 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:29.938719  7117 raft_consensus.cc:359] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.951792  7112 raft_consensus.cc:359] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.964246  7117 raft_consensus.cc:385] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.959501  7412 consensus_queue.cc:1048] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:29.960335  6989 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.926415  7383 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:29.939076  7113 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:29.955931  7414 raft_consensus.cc:493] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.964603  7112 raft_consensus.cc:385] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.968163  7112 raft_consensus.cc:740] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.964653  7117 raft_consensus.cc:740] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.969102  7117 consensus_queue.cc:260] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.970774  7112 consensus_queue.cc:260] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:29.971990  7117 ts_tablet_manager.cc:1434] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.001s
I20260709 12:25:29.973722  7117 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:29.978534  7383 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:29.971179  7414 raft_consensus.cc:515] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:29.981509  7414 leader_election.cc:290] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:29.987082  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:29.992240  7112 ts_tablet_manager.cc:1434] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:25:29.994346  7112 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:29.999670  7117 tablet_bootstrap.cc:654] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.004472  7111 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:30.004994  7111 ts_tablet_manager.cc:1403] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.239s	user 0.029s	sys 0.021s
I20260709 12:25:30.012293  7176 consensus_queue.cc:1048] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.010083  7416 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
W20260709 12:25:30.016336  7030 leader_election.cc:343] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:30.025480  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:30.036546  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:30.037251  6918 raft_consensus.cc:3060] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:30.037317  7030 leader_election.cc:343] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:30.038064  7030 leader_election.cc:343] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:30.038710  7030 leader_election.cc:343] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.038946  7113 tablet_bootstrap.cc:654] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.039124  7030 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:30.040315  7139 raft_consensus.cc:493] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.041671  7383 raft_consensus.cc:2749] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.040974  7139 raft_consensus.cc:515] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:29.994185  7032 leader_election.cc:304] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:30.043291  7032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 60992us
I20260709 12:25:30.043999  7378 raft_consensus.cc:2749] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.043993  7139 leader_election.cc:290] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.045768  7111 raft_consensus.cc:359] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.046474  7111 raft_consensus.cc:385] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.046187  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.046818  7111 raft_consensus.cc:740] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.048195  7111 consensus_queue.cc:260] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:30.049289  7032 leader_election.cc:343] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.049729  7032 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.051131  7420 raft_consensus.cc:2749] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:30.051573  7422 log.cc:927] Time spent T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:30.048527  7030 leader_election.cc:343] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.059407  7386 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.060088  7416 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.051498  7111 ts_tablet_manager.cc:1434] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:25:30.064143  7111 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:30.064921  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:30.065141  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:30.067406  7176 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.068097  7176 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.072662  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:30.075232  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.075699  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:30.076149  6840 raft_consensus.cc:2468] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:30.078649  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:30.079217  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:30.075066  7299 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.091528  7176 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:30.093567  7030 leader_election.cc:343] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:30.094300  7030 leader_election.cc:343] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.094731  7030 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:30.095139  7355 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.099547  7378 raft_consensus.cc:2749] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.103616  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.103870  6918 raft_consensus.cc:2468] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:30.104326  7065 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:30.106058  6991 raft_consensus.cc:2368] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d for earlier term 2. Current term is 3.
I20260709 12:25:30.107093  7299 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:30.112767  7032 leader_election.cc:343] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.113379  7032 leader_election.cc:304] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.115738  6956 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:30.116487  6837 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 2.
I20260709 12:25:30.119093  7032 leader_election.cc:304] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.119215  7378 raft_consensus.cc:2749] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.121129  7420 raft_consensus.cc:2804] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.121642  7420 raft_consensus.cc:697] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:30.122465  7420 consensus_queue.cc:237] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:30.131928  6881 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.132792  6881 leader_election.cc:400] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Vote denied by peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793) with higher term. Message: Invalid argument: T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d for earlier term 2. Current term is 3.
I20260709 12:25:30.133095  6881 leader_election.cc:403] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.133635  7416 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.136112  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.138657  7321 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.139195  7321 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.141278  7321 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:30.141924  7112 tablet_bootstrap.cc:654] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.131306  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:30.146327  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:30.148150  6807 leader_election.cc:343] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.148032  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.148962  7064 raft_consensus.cc:2468] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:30.150136  6806 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.151279  7416 raft_consensus.cc:2749] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793) with higher term. Message: Invalid argument: T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d for earlier term 2. Current term is 3.
I20260709 12:25:30.152071  7386 raft_consensus.cc:2804] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.152594  7386 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.153023  7386 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.154222  7117 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:30.154758  7117 ts_tablet_manager.cc:1403] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.009s
I20260709 12:25:30.155496  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:30.179527  7113 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:30.180148  7113 ts_tablet_manager.cc:1403] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.241s	user 0.017s	sys 0.009s
I20260709 12:25:30.182318  7412 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:30.185649  7412 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:30.186074  7412 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:30.186885  7414 raft_consensus.cc:493] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.187382  7414 raft_consensus.cc:515] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.191491  7113 raft_consensus.cc:359] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.197201  7113 raft_consensus.cc:385] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.197628  7113 raft_consensus.cc:740] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.198359  7113 consensus_queue.cc:260] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.200644  7113 ts_tablet_manager.cc:1434] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:30.195840  7117 raft_consensus.cc:359] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.201359  7117 raft_consensus.cc:385] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.201644  7117 raft_consensus.cc:740] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.196700  6918 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 3.
I20260709 12:25:30.207379  7113 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:30.181666  6837 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.209264  7117 consensus_queue.cc:260] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.209836  7112 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:30.211975  7112 ts_tablet_manager.cc:1403] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.219s	user 0.010s	sys 0.005s
I20260709 12:25:30.232748  7414 leader_election.cc:290] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:30.235088  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:30.237375  7030 leader_election.cc:343] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.240679  7112 raft_consensus.cc:359] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.243181  7112 raft_consensus.cc:385] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.245076  7112 raft_consensus.cc:740] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.242331  7117 ts_tablet_manager.cc:1434] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:25:30.246948  7117 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:30.247233  7416 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.247752  7416 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.249823  7416 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:30.249984  7394 consensus_queue.cc:1048] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.252905  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.253923  7066 raft_consensus.cc:2468] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:30.256461  7420 consensus_queue.cc:1048] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.257159  6882 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:30.258596  7394 raft_consensus.cc:2804] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.259177  7394 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.259657  7394 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.247882  7112 consensus_queue.cc:260] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.261124  7111 tablet_bootstrap.cc:654] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.267652  6735 catalog_manager.cc:5697] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 0 to 1, leader changed from <none> to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 1 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:30.275259  7112 ts_tablet_manager.cc:1434] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 12:25:30.276046  7112 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:30.279032  7368 raft_consensus.cc:493] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.265000  6881 leader_election.cc:304] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.303817  7139 raft_consensus.cc:2804] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.315636  7139 raft_consensus.cc:493] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.316174  7139 raft_consensus.cc:3060] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.299615  7368 raft_consensus.cc:515] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.330592  7113 tablet_bootstrap.cc:654] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.341890  7065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.342586  7065 raft_consensus.cc:2468] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:30.343803  6956 leader_election.cc:304] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:30.345605  7299 raft_consensus.cc:2804] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.346014  7299 raft_consensus.cc:493] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.346381  7299 raft_consensus.cc:3060] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.346757  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:30.334242  7112 tablet_bootstrap.cc:654] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.349879  7386 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.332072  7368 leader_election.cc:290] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
W20260709 12:25:30.373400  7430 log.cc:927] Time spent T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:25:30.381034  6993 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.384027  7412 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:30.336673  7425 log.cc:927] Time spent T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.054s	user 0.002s	sys 0.002s
I20260709 12:25:30.399304  6991 raft_consensus.cc:1240] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Rejecting Update request from peer 91e8bb7cfca34631a0d9c45d8b139301 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:30.384711  7299 raft_consensus.cc:515] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.392513  6837 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 3.
I20260709 12:25:30.346290  6957 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:30.411158  7299 leader_election.cc:290] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:30.394160  7117 tablet_bootstrap.cc:654] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:30.394418  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 132311us
I20260709 12:25:30.395347  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.398576  7386 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:30.424458  7436 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.424973  7436 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.426934  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
W20260709 12:25:30.415673  6957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 68018.2us
I20260709 12:25:30.431365  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.431594  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.432165  6837 raft_consensus.cc:2393] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
W20260709 12:25:30.432252  6957 leader_election.cc:343] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.432430  7063 raft_consensus.cc:3060] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.421829  7064 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.436921  7386 consensus_queue.cc:1059] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.437758  7386 raft_consensus.cc:3055] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:30.438055  7386 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:30.438885  7386 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.440140  7386 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:30.441155  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.420483  7368 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:30.446727  7368 raft_consensus.cc:697] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:30.447569  7368 consensus_queue.cc:237] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.449493  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:30.413969  7412 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:30.457592  6956 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:30.397959  7139 raft_consensus.cc:515] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.463838  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:30.466075  6957 leader_election.cc:343] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.474210  7112 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:30.418349  7394 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.472913  7369 raft_consensus.cc:2749] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:30.478734  7112 ts_tablet_manager.cc:1403] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.004s
I20260709 12:25:30.482867  7139 leader_election.cc:290] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.483771  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.485343  7394 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:30.486835  7436 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:30.482052  7112 raft_consensus.cc:359] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.487404  7112 raft_consensus.cc:385] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.487735  7112 raft_consensus.cc:740] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.488471  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.488543  7112 consensus_queue.cc:260] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.489252  7062 raft_consensus.cc:2468] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:30.490411  7112 ts_tablet_manager.cc:1434] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:25:30.490561  6806 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:30.492652  7436 raft_consensus.cc:2804] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.493100  7436 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.495178  7436 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.498145  7112 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:30.496626  7111 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:30.498831  7111 ts_tablet_manager.cc:1403] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.435s	user 0.016s	sys 0.000s
I20260709 12:25:30.499293  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:30.501639  6805 leader_election.cc:343] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.507856  7063 raft_consensus.cc:2468] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:30.509223  6956 leader_election.cc:304] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.521335  7111 raft_consensus.cc:359] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.521981  7111 raft_consensus.cc:385] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.511687  7299 raft_consensus.cc:2804] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.522207  7111 raft_consensus.cc:740] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.523507  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:30.524298  6918 raft_consensus.cc:2393] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:30.523938  7111 consensus_queue.cc:260] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.528676  7299 raft_consensus.cc:697] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:30.530048  7111 ts_tablet_manager.cc:1434] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:25:30.529594  7299 consensus_queue.cc:237] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.537305  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:30.538230  6840 raft_consensus.cc:3060] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:30.538813  7030 consensus_peers.cc:597] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:30.543424  7111 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:30.544970  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:30.548753  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:30.549695  6837 raft_consensus.cc:2393] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
W20260709 12:25:30.551016  7032 leader_election.cc:343] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.551046  7113 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:30.551517  7032 leader_election.cc:304] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.551792  7113 ts_tablet_manager.cc:1403] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.349s	user 0.025s	sys 0.016s
I20260709 12:25:30.552819  7383 raft_consensus.cc:2749] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.553633  7064 raft_consensus.cc:2468] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:30.554528  7383 consensus_queue.cc:1048] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.555006  7113 raft_consensus.cc:359] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.555783  7113 raft_consensus.cc:385] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.556116  7113 raft_consensus.cc:740] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.556871  7113 consensus_queue.cc:260] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.557436  6806 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.558619  7321 raft_consensus.cc:2804] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.559146  7321 raft_consensus.cc:697] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
W20260709 12:25:30.559954  6881 leader_election.cc:343] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.559981  7321 consensus_queue.cc:237] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.575276  7436 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.525789  7386 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.531361  7112 tablet_bootstrap.cc:654] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.579002  7386 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.567045  7113 ts_tablet_manager.cc:1434] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:25:30.578408  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:30.582544  7113 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:30.587749  7117 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:30.588222  7117 ts_tablet_manager.cc:1403] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.341s	user 0.015s	sys 0.005s
I20260709 12:25:30.588579  6840 raft_consensus.cc:2468] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:30.589079  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.589701  7066 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
W20260709 12:25:30.591552  6805 leader_election.cc:343] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.592363  7439 consensus_queue.cc:1048] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:30.593519  6881 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:30.595629  7386 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:30.596679  6881 leader_election.cc:304] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.596966  6806 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:30.598201  7439 raft_consensus.cc:2749] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.598981  7439 raft_consensus.cc:2804] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.599453  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:30.600767  6807 leader_election.cc:343] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.605329  7113 tablet_bootstrap.cc:654] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.599464  7439 raft_consensus.cc:697] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:30.614856  7436 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:30.612560  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.614252  7355 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:30.615531  7355 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.616080  7355 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.615696  7439 consensus_queue.cc:237] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.616824  7111 tablet_bootstrap.cc:654] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.592401  7117 raft_consensus.cc:359] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.619897  7117 raft_consensus.cc:385] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.620178  7117 raft_consensus.cc:740] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.623389  7117 consensus_queue.cc:260] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.626859  6737 catalog_manager.cc:5697] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 3, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:30.628502  7117 ts_tablet_manager.cc:1434] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:25:30.630071  7117 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:30.629097  6737 catalog_manager.cc:5697] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.625007  7064 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.626533  7139 raft_consensus.cc:493] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.645360  7112 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:30.645874  7112 ts_tablet_manager.cc:1403] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.006s
I20260709 12:25:30.648648  7112 raft_consensus.cc:359] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.649297  7112 raft_consensus.cc:385] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.649564  7112 raft_consensus.cc:740] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.650239  7112 consensus_queue.cc:260] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.653113  7112 ts_tablet_manager.cc:1434] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:30.639500  7139 raft_consensus.cc:515] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.660597  7139 leader_election.cc:290] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.661783  7112 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:30.666131  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9e2b4d7b24e86bb0226e3c0c8a6f6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:30.666018  7420 raft_consensus.cc:493] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.667115  7420 raft_consensus.cc:515] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:30.668337  6881 leader_election.cc:343] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.671061  7420 leader_election.cc:290] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.671078  7112 tablet_bootstrap.cc:654] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.672792  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:30.675014  7030 leader_election.cc:343] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.685604  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:30.683466  7378 consensus_queue.cc:1048] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:25:30.686913  7032 leader_election.cc:343] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.687328  7032 leader_election.cc:304] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.688681  7420 raft_consensus.cc:2749] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.693763  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9e2b4d7b24e86bb0226e3c0c8a6f6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.696511  7355 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.695647  6840 raft_consensus.cc:2468] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:30.692528  7064 raft_consensus.cc:2468] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:30.702620  7355 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:30.703624  6806 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.705587  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:30.706318  6737 catalog_manager.cc:5697] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.716795  7117 tablet_bootstrap.cc:654] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.714815  7355 raft_consensus.cc:2804] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.718250  7111 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:30.719003  7111 ts_tablet_manager.cc:1403] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.011s
I20260709 12:25:30.715399  7064 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.723877  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:30.727319  6807 leader_election.cc:343] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.727196  7111 raft_consensus.cc:359] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.728030  7111 raft_consensus.cc:385] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.728312  7111 raft_consensus.cc:740] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.728974  7355 raft_consensus.cc:697] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:30.728998  7111 consensus_queue.cc:260] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.730068  7355 consensus_queue.cc:237] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.730564  6735 catalog_manager.cc:5697] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.735091  7111 ts_tablet_manager.cc:1434] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:30.736110  7111 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:30.737879  7064 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:30.741951  7111 tablet_bootstrap.cc:654] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.752923  6806 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:30.753837  7321 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.754357  7321 raft_consensus.cc:697] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:30.755199  7321 consensus_queue.cc:237] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.746575  6881 leader_election.cc:304] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.765487  7439 raft_consensus.cc:2804] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:30.765558  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 45109.3us
I20260709 12:25:30.766100  7439 raft_consensus.cc:493] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.766551  7439 raft_consensus.cc:3060] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.770529  7112 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:30.771065  7112 ts_tablet_manager.cc:1403] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.003s
I20260709 12:25:30.787205  7112 raft_consensus.cc:359] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.787919  7112 raft_consensus.cc:385] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.788190  7112 raft_consensus.cc:740] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.788837  7112 consensus_queue.cc:260] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.791493  7112 ts_tablet_manager.cc:1434] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:30.792484  7112 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:30.794852  7113 tablet_bootstrap.cc:492] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:30.795379  7113 ts_tablet_manager.cc:1403] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.010s
I20260709 12:25:30.798152  7113 raft_consensus.cc:359] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.798825  7113 raft_consensus.cc:385] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.799118  7113 raft_consensus.cc:740] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.799765  7113 consensus_queue.cc:260] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.801951  7113 ts_tablet_manager.cc:1434] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:30.803459  7113 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:30.807277  7439 raft_consensus.cc:515] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.811715  7112 tablet_bootstrap.cc:654] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.823840  7117 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:30.824509  7117 ts_tablet_manager.cc:1403] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.195s	user 0.026s	sys 0.001s
I20260709 12:25:30.827486  7117 raft_consensus.cc:359] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.828366  7117 raft_consensus.cc:385] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.828684  7117 raft_consensus.cc:740] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.829548  7117 consensus_queue.cc:260] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.830497  6737 catalog_manager.cc:5697] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.833153  6737 catalog_manager.cc:5697] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:30.840212  7117 ts_tablet_manager.cc:1434] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:30.841288  7117 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:30.839753  7139 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.842407  7139 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.846112  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:30.847455  7064 raft_consensus.cc:2393] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
I20260709 12:25:30.854377  7117 tablet_bootstrap.cc:654] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.868717  7111 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:30.869269  7111 ts_tablet_manager.cc:1403] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.005s
I20260709 12:25:30.872440  7111 raft_consensus.cc:359] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.873129  7111 raft_consensus.cc:385] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.873400  7111 raft_consensus.cc:740] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.874050  7111 consensus_queue.cc:260] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:30.879920  7111 ts_tablet_manager.cc:1434] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:30.881181  7111 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:30.882421  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9e2b4d7b24e86bb0226e3c0c8a6f6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:30.883080  6837 raft_consensus.cc:3060] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.886292  7139 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:30.889730  7111 tablet_bootstrap.cc:654] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.889930  7439 leader_election.cc:290] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:30.895431  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9e2b4d7b24e86bb0226e3c0c8a6f6" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:30.895423  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:30.897899  6881 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
W20260709 12:25:30.899008  6881 leader_election.cc:343] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:30.899611  7416 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.906808  7112 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:30.907343  7112 ts_tablet_manager.cc:1403] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.003s
I20260709 12:25:30.909287  7113 tablet_bootstrap.cc:654] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.910105  6837 raft_consensus.cc:2468] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:30.910318  7112 raft_consensus.cc:359] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.911388  7112 raft_consensus.cc:385] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.911747  7112 raft_consensus.cc:740] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.912529  6881 leader_election.cc:304] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:30.914079  7139 raft_consensus.cc:2804] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.914551  7139 raft_consensus.cc:697] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:30.914628  7112 consensus_queue.cc:260] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.915410  7139 consensus_queue.cc:237] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:30.916291  6917 raft_consensus.cc:1275] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:30.916831  7416 raft_consensus.cc:2749] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:30.918180  7445 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:30.918810  7355 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.920619  7112 ts_tablet_manager.cc:1434] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:25:30.920562  7355 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:30.922809  7112 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:30.927942  7355 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:30.933099  7111 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:30.935796  7112 tablet_bootstrap.cc:654] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.933753  7111 ts_tablet_manager.cc:1403] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.001s
I20260709 12:25:30.941778  7111 raft_consensus.cc:359] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.942418  7111 raft_consensus.cc:385] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.942732  7111 raft_consensus.cc:740] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.943406  7111 consensus_queue.cc:260] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:30.945515  7111 ts_tablet_manager.cc:1434] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:30.946537  7111 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:30.951615  7117 tablet_bootstrap.cc:492] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:30.952211  7117 ts_tablet_manager.cc:1403] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.006s
I20260709 12:25:31.005254  7111 tablet_bootstrap.cc:654] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.013576  7176 raft_consensus.cc:493] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.015722  7176 raft_consensus.cc:515] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:31.019433  7117 raft_consensus.cc:359] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.020490  7176 leader_election.cc:290] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:31.020269  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.015259  6735 catalog_manager.cc:5697] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.027469  7414 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.020520  7117 raft_consensus.cc:385] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.029145  7117 raft_consensus.cc:740] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.033229  7414 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.034874  7378 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.035730  7378 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.037111  7064 raft_consensus.cc:2468] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:31.039023  6989 raft_consensus.cc:3060] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.041404  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.041903  7369 raft_consensus.cc:493] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.042733  7369 raft_consensus.cc:515] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.045919  7369 leader_election.cc:290] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.061375  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef29f51530fd4a5e872b7df967e9aa9a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.072127  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.072127  6839 raft_consensus.cc:2393] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:31.075755  7113 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:31.076717  7113 ts_tablet_manager.cc:1403] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.274s	user 0.009s	sys 0.006s
I20260709 12:25:31.066033  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.092749  6837 raft_consensus.cc:1275] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:31.095005  7378 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:31.104859  7414 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:31.105851  6806 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:31.108520  7392 raft_consensus.cc:2804] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.108981  6955 leader_election.cc:304] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:31.109313  7392 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.108482  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8fb6a484de42a9b96c3cc5d38ca2d7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.109786  7392 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.112334  7412 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:31.112349  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.115931  7355 raft_consensus.cc:493] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.116575  7355 raft_consensus.cc:515] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:31.117180  7416 consensus_queue.cc:1048] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.131335  6993 raft_consensus.cc:3060] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.134493  7392 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.137697  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.139225  7392 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.141851  7355 leader_election.cc:290] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:31.139586  6957 leader_election.cc:304] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:31.148223  6957 consensus_peers.cc:597] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.122212  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.151543  7112 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:31.152407  7112 ts_tablet_manager.cc:1403] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.230s	user 0.007s	sys 0.005s
I20260709 12:25:31.157323  7112 raft_consensus.cc:359] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.158285  7112 raft_consensus.cc:385] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.159863  7321 consensus_queue.cc:1048] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:31.162091  6805 leader_election.cc:343] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.162462  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:31.164258  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.167244  7113 raft_consensus.cc:359] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.168241  7113 raft_consensus.cc:385] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.168571  7113 raft_consensus.cc:740] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.169370  7113 consensus_queue.cc:260] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.100471  7117 consensus_queue.cc:260] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.197376  7394 raft_consensus.cc:493] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.197458  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.197916  7394 raft_consensus.cc:515] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.198820  7113 ts_tablet_manager.cc:1434] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.000s
I20260709 12:25:31.200634  7113 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:31.203197  7394 leader_election.cc:290] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.205047  7117 ts_tablet_manager.cc:1434] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.252s	user 0.003s	sys 0.008s
I20260709 12:25:31.206583  7117 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:31.209033  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:31.209836  7066 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.210368  7111 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:31.211175  7111 ts_tablet_manager.cc:1403] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.265s	user 0.013s	sys 0.044s
I20260709 12:25:31.158604  7112 raft_consensus.cc:740] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.212111  7112 consensus_queue.cc:260] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.213935  7112 ts_tablet_manager.cc:1434] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.001s
I20260709 12:25:31.217226  7112 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:31.217605  7030 leader_election.cc:343] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.195672  6805 leader_election.cc:343] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.221884  7030 leader_election.cc:343] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.221591  7420 raft_consensus.cc:493] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.252177  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.254190  7420 raft_consensus.cc:515] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.255683  7321 consensus_queue.cc:1048] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:31.242341  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.257072  7062 raft_consensus.cc:2393] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:31.256736  7420 leader_election.cc:290] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
W20260709 12:25:31.222322  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 51495.1us
I20260709 12:25:31.271085  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad9396234554969a1f5fc355e659c5a" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.279700  6881 leader_election.cc:304] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:31.281430  7416 raft_consensus.cc:3060] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:31.286126  7030 leader_election.cc:343] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.288609  6807 leader_election.cc:343] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.290748  6807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 71642.9us
I20260709 12:25:31.288167  7030 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
W20260709 12:25:31.297761  7032 leader_election.cc:343] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.298342  7032 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:31.305137  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.306391  7473 raft_consensus.cc:2749] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.307720  7299 raft_consensus.cc:2749] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.308635  7066 raft_consensus.cc:2468] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
W20260709 12:25:31.318432  7032 leader_election.cc:343] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.336913  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.337211  7383 raft_consensus.cc:2749] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:31.354624  7030 leader_election.cc:343] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.355337  7030 leader_election.cc:304] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:31.351395  6805 leader_election.cc:343] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.310446  6806 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:31.365847  7473 raft_consensus.cc:2749] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.390969  7139 consensus_queue.cc:1048] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:25:31.382241  7412 raft_consensus.cc:2749] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.401517  7117 tablet_bootstrap.cc:654] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.402583  7368 consensus_queue.cc:1048] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.404876  7113 tablet_bootstrap.cc:654] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.373791  7111 raft_consensus.cc:359] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.405762  7111 raft_consensus.cc:385] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.406069  7111 raft_consensus.cc:740] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.375504  6805 leader_election.cc:304] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:31.411952  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 76370.2us
W20260709 12:25:31.412770  6805 consensus_peers.cc:597] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.418002  7112 tablet_bootstrap.cc:654] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.380343  7436 raft_consensus.cc:2804] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.423794  7355 raft_consensus.cc:2749] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:31.383388  6806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 73144.9us
I20260709 12:25:31.424350  7111 consensus_queue.cc:260] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.473277  7436 raft_consensus.cc:697] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:31.474177  7111 ts_tablet_manager.cc:1434] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.263s	user 0.003s	sys 0.006s
I20260709 12:25:31.482051  7436 consensus_queue.cc:237] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.492579  7386 consensus_queue.cc:1048] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:31.527207  7445 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.528120  7445 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.531910  7445 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:31.536020  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.544860  7392 consensus_queue.cc:1048] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:31.547713  7111 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
W20260709 12:25:31.587639  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:31.598904  6735 catalog_manager.cc:5697] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:31.634358  7117 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:31.634946  7117 ts_tablet_manager.cc:1403] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.429s	user 0.013s	sys 0.013s
I20260709 12:25:31.637923  7117 raft_consensus.cc:359] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.638598  7117 raft_consensus.cc:385] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.638965  7117 raft_consensus.cc:740] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.639681  7117 consensus_queue.cc:260] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.642746  7117 ts_tablet_manager.cc:1434] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:31.643878  7117 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:31.648010  7439 raft_consensus.cc:493] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.648525  7439 raft_consensus.cc:515] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.656405  7416 raft_consensus.cc:2749] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.700055  7321 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.694284  7414 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.709200  6881 consensus_peers.cc:597] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:31.702471  7439 leader_election.cc:290] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.724293  7112 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:31.724841  7112 ts_tablet_manager.cc:1403] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.508s	user 0.031s	sys 0.056s
I20260709 12:25:31.732906  7112 raft_consensus.cc:359] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.733716  7112 raft_consensus.cc:385] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.733963  7112 raft_consensus.cc:740] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.734947  7473 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:31.735837  7117 tablet_bootstrap.cc:654] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.735553  7473 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.709930  7321 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.737799  7473 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:31.734664  7112 consensus_queue.cc:260] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.708487  7436 consensus_queue.cc:1048] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:25:31.764358  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.772150  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.772914  7063 raft_consensus.cc:2468] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:31.773715  7478 raft_consensus.cc:493] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.774199  7478 raft_consensus.cc:515] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.712447  7414 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.781533  7111 tablet_bootstrap.cc:654] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.768369  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.783671  6837 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:31.797123  6882 leader_election.cc:304] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:31.798375  7416 raft_consensus.cc:2804] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.798774  7416 raft_consensus.cc:493] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.799219  7416 raft_consensus.cc:3060] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.799460  6992 raft_consensus.cc:2393] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:31.783983  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.801656  7066 raft_consensus.cc:2393] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
I20260709 12:25:31.802526  7321 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.813625  7030 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:31.816666  7461 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:31.817154  7461 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:31.817593  7461 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:31.823278  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.825996  7478 leader_election.cc:290] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
W20260709 12:25:31.827410  7496 log.cc:927] Time spent T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:31.799511  7113 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:31.828748  7113 ts_tablet_manager.cc:1403] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.629s	user 0.062s	sys 0.037s
I20260709 12:25:31.831679  7113 raft_consensus.cc:359] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.827677  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:31.834056  7414 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:31.834710  6805 leader_election.cc:343] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.832357  7113 raft_consensus.cc:385] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.845696  7113 raft_consensus.cc:740] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.843262  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.844316  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.845182  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:31.851044  7113 consensus_queue.cc:260] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:31.854825  7030 leader_election.cc:343] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.855995  7030 leader_election.cc:343] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.856520  7030 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
W20260709 12:25:31.857895  7030 leader_election.cc:343] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.865406  7414 raft_consensus.cc:2749] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.866585  7113 ts_tablet_manager.cc:1434] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:25:31.868021  7113 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:31.868896  7112 ts_tablet_manager.cc:1434] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.011s
I20260709 12:25:31.870009  7112 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:31.889456  7112 tablet_bootstrap.cc:654] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.880179  7416 raft_consensus.cc:515] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:31.901568  6912 raft_consensus.cc:2393] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
W20260709 12:25:31.908213  6806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 141383us
I20260709 12:25:31.926069  7032 leader_election.cc:304] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:31.926874  7414 raft_consensus.cc:3060] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.936264  7117 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:31.936825  7117 ts_tablet_manager.cc:1403] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.293s	user 0.006s	sys 0.012s
I20260709 12:25:31.937402  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:31.942276  7117 raft_consensus.cc:359] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.943042  7117 raft_consensus.cc:385] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.943320  7117 raft_consensus.cc:740] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.944024  7117 consensus_queue.cc:260] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.946925  7117 ts_tablet_manager.cc:1434] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:31.948235  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:31.948962  7066 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:31.952823  7461 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:31.955485  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:31.938926  7414 raft_consensus.cc:2749] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.960567  6956 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:31.965191  7113 tablet_bootstrap.cc:654] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.967849  7111 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:31.968457  7111 ts_tablet_manager.cc:1403] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.421s	user 0.020s	sys 0.008s
I20260709 12:25:31.971155  7445 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.952189  7416 leader_election.cc:290] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:31.978755  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e465e32dc8914014a33a2237e61a82d5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:31.981060  6881 leader_election.cc:343] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.984256  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:31.985695  6991 raft_consensus.cc:2393] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:31.985707  7483 raft_consensus.cc:493] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.986454  7483 raft_consensus.cc:515] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:31.985924  7461 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:31.986976  6881 leader_election.cc:343] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.996413  7117 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:32.018411  6806 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.021282  7500 raft_consensus.cc:2804] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.021677  7500 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.022014  7500 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.025972  7117 tablet_bootstrap.cc:654] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.028971  7111 raft_consensus.cc:359] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.029959  7111 raft_consensus.cc:385] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.019153  7483 leader_election.cc:290] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:32.031469  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:32.032356  7066 raft_consensus.cc:2468] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:32.036299  6882 leader_election.cc:304] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:32.037081  7445 raft_consensus.cc:2749] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.016644  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:32.038242  7483 raft_consensus.cc:2804] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.038767  7483 raft_consensus.cc:493] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.039505  7483 raft_consensus.cc:3060] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.030313  7111 raft_consensus.cc:740] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.048456  7483 raft_consensus.cc:515] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.050946  7483 leader_election.cc:290] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:32.052172  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:32.054206  7061 raft_consensus.cc:3060] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.059005  7486 consensus_queue.cc:1048] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.057694  7111 consensus_queue.cc:260] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.063807  7499 consensus_queue.cc:1048] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.064143  7500 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.066433  7061 raft_consensus.cc:2468] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:32.066854  7112 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:32.067374  7112 ts_tablet_manager.cc:1403] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.198s	user 0.007s	sys 0.030s
I20260709 12:25:32.067982  6882 leader_election.cc:304] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:32.068794  6837 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:32.070111  7416 raft_consensus.cc:2804] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.070068  7030 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.070767  7416 raft_consensus.cc:697] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:32.071663  7416 consensus_queue.cc:237] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.072693  7414 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:32.073746  7414 raft_consensus.cc:697] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:32.079722  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:32.063702  7064 raft_consensus.cc:2468] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
W20260709 12:25:32.081346  6805 leader_election.cc:343] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.080217  7414 consensus_queue.cc:237] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.089425  7112 raft_consensus.cc:359] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.090152  7112 raft_consensus.cc:385] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.083899  7500 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:32.090327  7112 raft_consensus.cc:740] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.099421  7111 ts_tablet_manager.cc:1434] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.002s
I20260709 12:25:32.099272  6882 leader_election.cc:304] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.112406  7486 raft_consensus.cc:2804] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.112263  7112 consensus_queue.cc:260] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.100164  6736 catalog_manager.cc:5697] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.110278  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:32.113716  6838 raft_consensus.cc:2468] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:32.112944  7486 raft_consensus.cc:697] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:32.118997  7112 ts_tablet_manager.cc:1434] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:25:32.119410  7117 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:32.119936  7117 ts_tablet_manager.cc:1403] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.004s
I20260709 12:25:32.117408  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e330099c2e664276a6db9bfa41dd79e4" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:32.126999  7501 consensus_queue.cc:1048] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.127509  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:32.128191  7063 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.130751  7112 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:32.131011  7111 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:32.140734  7486 consensus_queue.cc:237] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.145268  7063 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:32.149494  7445 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.135165  6837 raft_consensus.cc:3060] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.169000  7113 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:32.185133  7112 tablet_bootstrap.cc:654] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.185695  7113 ts_tablet_manager.cc:1403] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.318s	user 0.015s	sys 0.008s
I20260709 12:25:32.171146  7111 tablet_bootstrap.cc:654] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.172278  7117 raft_consensus.cc:359] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.186713  7117 raft_consensus.cc:385] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.187127  7117 raft_consensus.cc:740] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.188921  7117 consensus_queue.cc:260] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.188632  7445 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.221055  7113 raft_consensus.cc:359] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.222034  7113 raft_consensus.cc:385] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.222394  7113 raft_consensus.cc:740] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.223784  7113 consensus_queue.cc:260] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.226696  7117 ts_tablet_manager.cc:1434] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.000s
I20260709 12:25:32.228205  7117 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:32.250416  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:32.263110  7445 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:32.264209  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:32.268944  6806 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.270421  7386 raft_consensus.cc:2804] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.271078  7386 raft_consensus.cc:697] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:32.272215  7386 consensus_queue.cc:237] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.280918  6956 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:32.283485  7176 raft_consensus.cc:2749] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.272344  7117 tablet_bootstrap.cc:654] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.303331  6737 catalog_manager.cc:5697] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.309381  7113 ts_tablet_manager.cc:1434] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.123s	user 0.002s	sys 0.007s
I20260709 12:25:32.310936  7113 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:32.369051  7461 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.380395  7112 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:32.381108  7112 ts_tablet_manager.cc:1403] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.256s	user 0.021s	sys 0.059s
I20260709 12:25:32.382125  7117 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:32.382612  7117 ts_tablet_manager.cc:1403] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.001s
I20260709 12:25:32.398995  7112 raft_consensus.cc:359] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.389285  7176 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.400929  7112 raft_consensus.cc:385] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.401300  7112 raft_consensus.cc:740] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.403134  7113 tablet_bootstrap.cc:654] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.407034  7112 consensus_queue.cc:260] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.408938  6993 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.409600  7112 ts_tablet_manager.cc:1434] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:25:32.392794  7461 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.424706  7112 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:32.415051  6837 raft_consensus.cc:2468] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:32.429991  7117 raft_consensus.cc:359] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.431115  7117 raft_consensus.cc:385] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.431483  7117 raft_consensus.cc:740] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.440232  7117 consensus_queue.cc:260] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:32.450227  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 86062.8us
I20260709 12:25:32.479637  7111 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:32.480322  7111 ts_tablet_manager.cc:1403] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.359s	user 0.040s	sys 0.046s
I20260709 12:25:32.448421  7176 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.484200  7112 tablet_bootstrap.cc:654] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.485190  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:32.487576  7176 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:32.513756  7461 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:32.519205  7117 ts_tablet_manager.cc:1434] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.136s	user 0.010s	sys 0.000s
I20260709 12:25:32.520712  6992 raft_consensus.cc:3060] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.519249  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:32.547077  7506 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.547622  7506 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.550009  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:32.550757  6842 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:32.553814  7506 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:32.559239  7529 raft_consensus.cc:493] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.559983  6955 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:32.559805  7529 raft_consensus.cc:515] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.561605  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:32.562042  7529 leader_election.cc:290] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:32.562619  7529 consensus_queue.cc:1048] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:32.563019  6805 leader_election.cc:343] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.564311  7176 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:32.564709  7176 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.565179  7176 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:32.565903  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:32.575313  7063 raft_consensus.cc:2468] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:32.576156  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:32.576493  7498 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.576967  7498 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.579169  7498 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:32.580133  6807 leader_election.cc:343] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.580575  6807 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:32.582378  6882 leader_election.cc:304] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:32.583541  7529 raft_consensus.cc:2804] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.583896  7529 raft_consensus.cc:493] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.584209  7529 raft_consensus.cc:3060] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.587138  7498 raft_consensus.cc:2749] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.591144  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
W20260709 12:25:32.592475  6807 leader_election.cc:343] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.594012  7117 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:32.600240  7139 consensus_queue.cc:1048] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.601323  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:32.602350  7067 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:32.608049  7529 raft_consensus.cc:515] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.609422  6806 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:32.610540  7498 raft_consensus.cc:2804] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.610989  7498 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.611353  7498 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.591944  6739 catalog_manager.cc:5697] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.620661  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:32.610164  7111 raft_consensus.cc:359] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.623071  7111 raft_consensus.cc:385] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.623385  7111 raft_consensus.cc:740] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.623951  6988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:32.626446  7113 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:32.627009  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14f3d8aa30470eba2fcf88fba00745" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:32.627667  7063 raft_consensus.cc:3060] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.624028  7111 consensus_queue.cc:260] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.626953  7113 ts_tablet_manager.cc:1403] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.317s	user 0.011s	sys 0.014s
W20260709 12:25:32.632503  7032 leader_election.cc:343] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.625306  6737 catalog_manager.cc:5697] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:32.640884  6881 leader_election.cc:343] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:32.650995  6881 leader_election.cc:343] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.635054  7529 leader_election.cc:290] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:32.575557  7176 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.685002  7111 ts_tablet_manager.cc:1434] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.204s	user 0.004s	sys 0.004s
I20260709 12:25:32.637046  7139 consensus_queue.cc:1048] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:25:32.689774  7117 tablet_bootstrap.cc:654] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.664920  7537 raft_consensus.cc:493] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.658604  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:32.684613  7113 raft_consensus.cc:359] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.697302  6993 raft_consensus.cc:1240] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Rejecting Update request from peer 735ce7f4a3244c7d877ce5feb5fb4ffc for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:32.697961  7113 raft_consensus.cc:385] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.698309  7113 raft_consensus.cc:740] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.701475  7113 consensus_queue.cc:260] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:32.702270  6881 consensus_peers.cc:597] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.710175  7530 raft_consensus.cc:493] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.710747  7530 raft_consensus.cc:515] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.712277  7176 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:32.717319  7063 raft_consensus.cc:2468] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
W20260709 12:25:32.723706  7030 leader_election.cc:343] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.724156  7030 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:32.728030  6882 leader_election.cc:304] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.707617  7537 raft_consensus.cc:515] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.729614  7486 raft_consensus.cc:2804] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.730114  7486 raft_consensus.cc:697] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
W20260709 12:25:32.723387  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:32.730434  6843 raft_consensus.cc:1275] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:32.730998  7486 consensus_queue.cc:237] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.738430  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:32.739503  7530 leader_election.cc:290] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:32.741098  7113 ts_tablet_manager.cc:1434] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.000s
I20260709 12:25:32.744395  7112 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:32.744879  7112 ts_tablet_manager.cc:1403] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.334s	user 0.045s	sys 0.053s
I20260709 12:25:32.746541  7113 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:32.752575  7112 raft_consensus.cc:359] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.753364  7112 raft_consensus.cc:385] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.753629  7112 raft_consensus.cc:740] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.756111  7541 consensus_queue.cc:1059] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.756984  7541 raft_consensus.cc:2749] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.757656  7541 raft_consensus.cc:3055] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:32.758046  7541 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
W20260709 12:25:32.761972  7032 leader_election.cc:343] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.763747  7541 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.730448  7537 leader_election.cc:290] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:32.766366  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:32.779383  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:32.754195  7112 consensus_queue.cc:260] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:32.798861  6881 leader_election.cc:343] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.802881  6839 raft_consensus.cc:2468] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:32.805269  7112 ts_tablet_manager.cc:1434] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:25:32.806808  6881 leader_election.cc:304] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.765146  7541 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:32.808087  7539 raft_consensus.cc:2804] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.827277  7117 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:32.833725  7117 ts_tablet_manager.cc:1403] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.240s	user 0.039s	sys 0.015s
I20260709 12:25:32.829655  7112 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:32.836303  7111 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:32.738543  7498 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.841593  7498 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:32.842813  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:32.846323  7113 tablet_bootstrap.cc:654] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.838927  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:32.834896  7539 raft_consensus.cc:493] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.848464  7539 raft_consensus.cc:3060] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.853462  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:32.854139  7064 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:32.855000  7030 leader_election.cc:343] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.855454  7030 leader_election.cc:304] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:32.862759  7502 raft_consensus.cc:2749] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:32.873278  6807 leader_election.cc:343] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.884666  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:32.885385  6839 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:32.890138  7117 raft_consensus.cc:359] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.891106  7117 raft_consensus.cc:385] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.891459  7117 raft_consensus.cc:740] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.896420  7112 tablet_bootstrap.cc:654] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.908711  7111 tablet_bootstrap.cc:654] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.914362  7117 consensus_queue.cc:260] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.917604  7117 ts_tablet_manager.cc:1434] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260709 12:25:32.918690  7539 raft_consensus.cc:515] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:32.920575  6839 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 3.
I20260709 12:25:32.923157  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:32.924036  6843 raft_consensus.cc:3060] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.923108  6955 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:32.928494  7176 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:32.929013  7176 raft_consensus.cc:697] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:32.929862  7176 consensus_queue.cc:237] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:32.931463  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:32.932392  7063 raft_consensus.cc:2410] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:25:32.938337  6992 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.938659  7064 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:32.938004  7547 consensus_queue.cc:1048] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.946609  6806 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:32.955914  7547 raft_consensus.cc:2804] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.956902  6739 catalog_manager.cc:5697] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.974189  7113 tablet_bootstrap.cc:492] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:32.956719  7547 raft_consensus.cc:697] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:32.975018  7113 ts_tablet_manager.cc:1403] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.233s	user 0.047s	sys 0.024s
I20260709 12:25:32.975744  7547 consensus_queue.cc:237] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:32.962103  7539 leader_election.cc:290] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:32.919384  7117 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:32.963651  7111 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:32.977885  7111 ts_tablet_manager.cc:1403] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.002s
I20260709 12:25:32.978726  7113 raft_consensus.cc:359] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.979513  7113 raft_consensus.cc:385] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.979780  7113 raft_consensus.cc:740] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.963514  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:32.968850  7506 consensus_queue.cc:1048] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.982234  7541 raft_consensus.cc:493] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.982760  7541 raft_consensus.cc:515] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.981945  7113 consensus_queue.cc:260] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:32.984473  7117 tablet_bootstrap.cc:654] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.984858  7541 leader_election.cc:290] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:32.985481  7113 ts_tablet_manager.cc:1434] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:32.961442  6843 raft_consensus.cc:2468] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:32.986567  7113 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:32.986917  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:32.993965  7113 tablet_bootstrap.cc:654] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:32.996891  6881 leader_election.cc:343] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.997807  6881 leader_election.cc:304] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:32.999447  7539 raft_consensus.cc:2804] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.999920  7539 raft_consensus.cc:697] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:33.000698  7539 consensus_queue.cc:237] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
W20260709 12:25:33.001586  7032 leader_election.cc:343] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.005219  7112 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:33.005741  7112 ts_tablet_manager.cc:1403] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.002s
I20260709 12:25:33.008056  7498 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.008581  7498 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.009763  7112 raft_consensus.cc:359] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.010419  7112 raft_consensus.cc:385] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.010617  7498 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:33.012771  7111 raft_consensus.cc:359] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.013506  7111 raft_consensus.cc:385] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.013767  7111 raft_consensus.cc:740] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.010689  7112 raft_consensus.cc:740] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.014506  7111 consensus_queue.cc:260] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.014966  7112 consensus_queue.cc:260] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.016765  7112 ts_tablet_manager.cc:1434] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:25:33.017869  7112 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:33.020102  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.023134  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:33.023977  7064 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:33.024858  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.025182  6806 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:33.026049  7501 raft_consensus.cc:2804] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.026422  7501 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.026767  7501 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.031656  7539 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.032439  6805 leader_election.cc:343] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:33.032802  7030 leader_election.cc:343] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.033365  7030 leader_election.cc:304] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:33.034281  7539 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.034574  7501 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.037544  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:33.038321  7067 raft_consensus.cc:2393] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
I20260709 12:25:33.044162  7112 tablet_bootstrap.cc:654] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.034556  7541 raft_consensus.cc:2749] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.046254  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:33.047685  7539 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:33.048015  6805 leader_election.cc:343] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.048717  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.049927  7111 ts_tablet_manager.cc:1434] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:25:33.050449  6881 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:33.051513  7539 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.055967  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:33.056867  7063 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.061117  7111 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:33.062227  7113 tablet_bootstrap.cc:492] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:33.062774  7113 ts_tablet_manager.cc:1403] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.024s
I20260709 12:25:33.063606  6739 catalog_manager.cc:5697] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.066020  7113 raft_consensus.cc:359] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.066740  7113 raft_consensus.cc:385] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.067000  7113 raft_consensus.cc:740] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.067602  7113 consensus_queue.cc:260] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.070179  7113 ts_tablet_manager.cc:1434] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:33.071211  7113 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:33.061172  7501 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:33.091873  7111 tablet_bootstrap.cc:654] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.096138  7539 raft_consensus.cc:2749] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.099085  7117 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:33.099632  7117 ts_tablet_manager.cc:1403] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.000s
I20260709 12:25:33.099804  7063 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:33.100023  7113 tablet_bootstrap.cc:654] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.101257  6806 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:33.102569  7498 raft_consensus.cc:2804] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.102489  7117 raft_consensus.cc:359] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.103317  7498 raft_consensus.cc:697] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:33.103606  7117 raft_consensus.cc:385] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.104004  7117 raft_consensus.cc:740] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.104254  7498 consensus_queue.cc:237] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.104830  7117 consensus_queue.cc:260] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.107496  7117 ts_tablet_manager.cc:1434] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:33.112810  7113 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:33.113328  7113 ts_tablet_manager.cc:1403] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 12:25:33.116297  7113 raft_consensus.cc:359] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.116931  7113 raft_consensus.cc:385] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.117195  7113 raft_consensus.cc:740] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.117935  6737 catalog_manager.cc:5697] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.119799  7117 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:33.125674  7113 consensus_queue.cc:260] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.127918  7113 ts_tablet_manager.cc:1434] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:25:33.127322  6739 catalog_manager.cc:5697] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 2 to 3, leader changed from 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.131098  7113 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:33.134629  7117 tablet_bootstrap.cc:654] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.150406  6993 raft_consensus.cc:3060] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.151161  7113 tablet_bootstrap.cc:654] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.153239  6990 raft_consensus.cc:3060] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.164409  7111 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:33.164961  7111 ts_tablet_manager.cc:1403] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.014s
I20260709 12:25:33.185209  7112 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:33.185734  7112 ts_tablet_manager.cc:1403] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.009s
I20260709 12:25:33.188119  7486 consensus_queue.cc:1048] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.188557  7112 raft_consensus.cc:359] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.189282  7112 raft_consensus.cc:385] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.189556  7112 raft_consensus.cc:740] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.188604  7111 raft_consensus.cc:359] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.195022  7112 consensus_queue.cc:260] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.197619  7112 ts_tablet_manager.cc:1434] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:33.193883  7111 raft_consensus.cc:385] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.199976  7111 raft_consensus.cc:740] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.200884  7111 consensus_queue.cc:260] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.205926  7111 ts_tablet_manager.cc:1434] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:25:33.207036  7111 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Bootstrap starting.
I20260709 12:25:33.209235  7117 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:33.209781  7117 ts_tablet_manager.cc:1403] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.008s
I20260709 12:25:33.211620  7112 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:33.213027  7117 raft_consensus.cc:359] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.214332  7117 raft_consensus.cc:385] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.214594  7117 raft_consensus.cc:740] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.215456  7117 consensus_queue.cc:260] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.217854  7117 ts_tablet_manager.cc:1434] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:33.218719  7113 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:33.219380  7113 ts_tablet_manager.cc:1403] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.001s
I20260709 12:25:33.220000  7176 raft_consensus.cc:493] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.221686  7176 raft_consensus.cc:515] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.225163  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.225617  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "939129fdb05c4c798051c85011070991" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.227059  7176 leader_election.cc:290] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.225163  7111 tablet_bootstrap.cc:654] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.229007  7113 raft_consensus.cc:359] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.229733  7113 raft_consensus.cc:385] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.229974  7113 raft_consensus.cc:740] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.230834  7113 consensus_queue.cc:260] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.233954  7117 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:33.234947  6839 raft_consensus.cc:2393] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:33.237190  6955 leader_election.cc:304] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:33.239215  7536 consensus_queue.cc:1048] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.258438  7176 raft_consensus.cc:3060] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.255131  7386 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.269713  7113 ts_tablet_manager.cc:1434] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.003s
I20260709 12:25:33.271271  7112 tablet_bootstrap.cc:654] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.268455  7386 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.274612  7386 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.275164  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:33.275831  7063 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:33.277486  7113 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:33.277765  6806 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:33.280196  7386 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.288128  6739 catalog_manager.cc:5697] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.288399  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.298136  7386 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.309957  7117 tablet_bootstrap.cc:654] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.317893  7506 raft_consensus.cc:493] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.318495  7506 raft_consensus.cc:515] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.320783  7506 leader_election.cc:290] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
W20260709 12:25:33.335537  6807 leader_election.cc:343] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.340727  7111 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: No bootstrap required, opened a new log
I20260709 12:25:33.322523  7386 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.341457  7111 ts_tablet_manager.cc:1403] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.019s
I20260709 12:25:33.368446  7113 tablet_bootstrap.cc:654] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.362305  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.380128  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.380709  7117 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:33.381212  7117 ts_tablet_manager.cc:1403] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.013s
I20260709 12:25:33.381882  7111 raft_consensus.cc:359] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.384732  7112 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:33.385187  7112 ts_tablet_manager.cc:1403] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.027s
I20260709 12:25:33.382622  7111 raft_consensus.cc:385] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.388552  7112 raft_consensus.cc:359] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.389210  7112 raft_consensus.cc:385] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.389539  7112 raft_consensus.cc:740] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.389286  7117 raft_consensus.cc:359] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.389935  7117 raft_consensus.cc:385] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.390226  7117 raft_consensus.cc:740] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.390653  7112 consensus_queue.cc:260] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.390878  7117 consensus_queue.cc:260] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.394443  7112 ts_tablet_manager.cc:1434] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:33.395828  7112 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:33.388329  7111 raft_consensus.cc:740] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Initialized, Role: FOLLOWER
W20260709 12:25:33.409564  6807 leader_election.cc:343] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:33.411521  6805 leader_election.cc:343] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.412003  6805 leader_election.cc:304] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:33.413335  7498 raft_consensus.cc:2749] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.416055  7506 consensus_queue.cc:1048] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.419873  6837 raft_consensus.cc:1275] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:33.421293  7112 tablet_bootstrap.cc:654] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.425117  7064 raft_consensus.cc:1275] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:25:33.425522  7064 pending_rounds.cc:85] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Aborting all ops after (but not including) 1
I20260709 12:25:33.425886  7064 pending_rounds.cc:107] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:25:33.426208  7064 raft_consensus.cc:2889] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.426587  7176 raft_consensus.cc:2749] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.428519  7369 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.428814  7412 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.429322  7412 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.432906  7111 consensus_queue.cc:260] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.449258  7117 ts_tablet_manager.cc:1434] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.068s	user 0.014s	sys 0.011s
I20260709 12:25:33.452502  7117 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:33.454936  7541 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.455469  7541 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.459146  7117 tablet_bootstrap.cc:654] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.436290  7534 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:25:33.459657  7541 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.431406  7412 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.462033  7111 ts_tablet_manager.cc:1434] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 12:25:33.462865  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.465338  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.466540  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.467262  6837 raft_consensus.cc:2468] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:33.468451  7386 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:33.469571  7030 leader_election.cc:343] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:33.470299  7032 leader_election.cc:343] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.470613  7386 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.470726  7032 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:33.471553  7545 raft_consensus.cc:2749] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.488543  7498 consensus_queue.cc:1048] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.489439  7532 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.490039  7532 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.492977  7532 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:33.494966  6837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
W20260709 12:25:33.496722  7030 leader_election.cc:343] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.497594  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:33.506036  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:33.506929  7066 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.513192  6913 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.513777  7386 raft_consensus.cc:493] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.514592  7386 raft_consensus.cc:515] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.517951  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.518174  7386 leader_election.cc:290] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:33.518839  7066 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
W20260709 12:25:33.519479  6807 leader_election.cc:343] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.523054  6806 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:33.524452  7506 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.524957  7506 raft_consensus.cc:697] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:33.525300  7545 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.525012  6913 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:33.525930  7506 consensus_queue.cc:237] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.532006  6955 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:33.561486  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.552836  7412 raft_consensus.cc:2804] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.525949  7545 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.581557  7545 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:33.571291  7412 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.602319  7113 tablet_bootstrap.cc:492] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:33.603025  7113 ts_tablet_manager.cc:1403] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.326s	user 0.017s	sys 0.012s
I20260709 12:25:33.590829  7412 raft_consensus.cc:3060] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.624644  7117 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:33.625237  7117 ts_tablet_manager.cc:1403] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.174s	user 0.018s	sys 0.009s
I20260709 12:25:33.625294  7112 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:33.626035  7112 ts_tablet_manager.cc:1403] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.231s	user 0.029s	sys 0.045s
I20260709 12:25:33.629026  7112 raft_consensus.cc:359] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.629711  7112 raft_consensus.cc:385] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.629967  7112 raft_consensus.cc:740] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.630887  7112 consensus_queue.cc:260] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.601374  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.634497  7112 ts_tablet_manager.cc:1434] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:33.635561  7112 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:33.637924  7030 leader_election.cc:343] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.638584  7386 consensus_queue.cc:1048] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.639133  7539 consensus_queue.cc:1048] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.642140  7117 raft_consensus.cc:359] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.642891  7117 raft_consensus.cc:385] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.643167  7117 raft_consensus.cc:740] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.644490  7117 consensus_queue.cc:260] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.645260  7112 tablet_bootstrap.cc:654] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.646759  7117 ts_tablet_manager.cc:1434] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:25:33.648558  7117 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:33.685637  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.690693  7117 tablet_bootstrap.cc:654] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:33.699446  7030 leader_election.cc:343] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.702204  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.704401  7030 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:33.700328  7113 raft_consensus.cc:359] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.706168  7113 raft_consensus.cc:385] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.706981  7113 raft_consensus.cc:740] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.694703  7577 raft_consensus.cc:493] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.709978  7113 consensus_queue.cc:260] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:33.697477  7486 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.711118  7532 raft_consensus.cc:2749] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:33.727607  6805 consensus_peers.cc:597] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:33.753073  7030 leader_election.cc:343] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.753680  7030 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:33.724598  7486 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.757648  7486 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:33.719838  7577 raft_consensus.cc:515] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
W20260709 12:25:33.752498  6805 leader_election.cc:343] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:33.778398  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.779389  6993 raft_consensus.cc:2468] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:33.789013  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:33.789727  6839 raft_consensus.cc:2468] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:33.764777  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.785410  6881 leader_election.cc:304] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:33.794996  7113 ts_tablet_manager.cc:1434] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.192s	user 0.009s	sys 0.000s
I20260709 12:25:33.762046  7577 leader_election.cc:290] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:33.800490  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:33.800555  6912 raft_consensus.cc:2468] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 0.
I20260709 12:25:33.791651  7532 raft_consensus.cc:2749] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.761428  6805 leader_election.cc:304] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:33.803609  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 51158.6us
I20260709 12:25:33.804328  7498 raft_consensus.cc:2749] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:33.806278  7112 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:33.806782  7112 ts_tablet_manager.cc:1403] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.171s	user 0.003s	sys 0.017s
I20260709 12:25:33.760967  7412 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.810600  7113 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:33.799937  7582 raft_consensus.cc:2804] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.807973  7579 consensus_queue.cc:1048] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:25:33.825258  7112 raft_consensus.cc:359] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.825999  7112 raft_consensus.cc:385] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.826248  7112 raft_consensus.cc:740] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.832114  7112 consensus_queue.cc:260] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:33.835912  6992 raft_consensus.cc:2393] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:33.846733  7112 ts_tablet_manager.cc:1434] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 12:25:33.849586  7412 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.821753  7582 raft_consensus.cc:493] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.853852  7112 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:33.833487  6881 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:33.853926  7582 raft_consensus.cc:3060] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.863191  7386 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.862454  7578 raft_consensus.cc:2804] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:33.870968  7578 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.871317  7578 raft_consensus.cc:3060] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.872766  7117 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:33.873274  7117 ts_tablet_manager.cc:1403] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.002s
I20260709 12:25:33.881063  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:33.884549  6843 raft_consensus.cc:3060] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:33.892735  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:33.893498  7066 raft_consensus.cc:2468] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:33.901177  6737 catalog_manager.cc:5697] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.903767  6843 raft_consensus.cc:2468] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:33.906787  7113 tablet_bootstrap.cc:654] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.868021  7386 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:33.913350  7386 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:33.916975  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:33.918038  7112 tablet_bootstrap.cc:654] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:33.917726  7117 raft_consensus.cc:359] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.918489  7117 raft_consensus.cc:385] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:33.922150  7117 raft_consensus.cc:740] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:33.921582  6955 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:33.928841  7176 raft_consensus.cc:2804] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:33.929383  7176 raft_consensus.cc:697] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:33.932060  7117 consensus_queue.cc:260] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.930405  7176 consensus_queue.cc:237] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:33.938608  7117 ts_tablet_manager.cc:1434] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:25:33.939713  7117 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:33.943163  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:33.943883  7064 raft_consensus.cc:2468] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
W20260709 12:25:33.936236  6807 leader_election.cc:343] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:33.928345  6805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 69915.8us
I20260709 12:25:33.987751  7117 tablet_bootstrap.cc:654] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.008105  7113 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.008725  7113 ts_tablet_manager.cc:1403] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.012s
I20260709 12:25:34.012055  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:34.006933  7582 raft_consensus.cc:515] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.029877  7112 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: No bootstrap required, opened a new log
I20260709 12:25:34.030432  7112 ts_tablet_manager.cc:1403] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.009s
I20260709 12:25:34.033270  7112 raft_consensus.cc:359] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.033951  7112 raft_consensus.cc:385] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.034214  7112 raft_consensus.cc:740] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.037075  7112 consensus_queue.cc:260] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.037185  7578 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.040431  7582 leader_election.cc:290] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.043308  7578 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:34.038900  7112 ts_tablet_manager.cc:1434] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:25:34.041425  6914 raft_consensus.cc:2393] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:34.040395  6806 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
W20260709 12:25:34.046895  6806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 100115us
I20260709 12:25:34.048523  7117 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:34.048784  7500 raft_consensus.cc:2804] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.049180  7117 ts_tablet_manager.cc:1403] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.009s
I20260709 12:25:34.049225  7500 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.049760  7500 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.052580  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:34.054103  6787 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:34.056874  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:34.057469  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:34.058248  6843 raft_consensus.cc:2393] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 1: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:34.060739  6881 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:34.064927  7113 raft_consensus.cc:359] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.066248  7113 raft_consensus.cc:385] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.066515  7113 raft_consensus.cc:740] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.067268  7113 consensus_queue.cc:260] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.067611  7117 raft_consensus.cc:359] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.068302  7117 raft_consensus.cc:385] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.068576  7117 raft_consensus.cc:740] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.069237  7117 consensus_queue.cc:260] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.069670  7113 ts_tablet_manager.cc:1434] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 12:25:34.070719  7113 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:34.071442  7117 ts_tablet_manager.cc:1434] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:25:34.057497  6992 raft_consensus.cc:3060] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.107079  7117 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: Bootstrap starting.
I20260709 12:25:34.098326  7595 raft_consensus.cc:2749] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.093961  7506 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.119683  7500 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:34.119897  7506 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.122568  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:34.123165  7064 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.136848  6992 raft_consensus.cc:2468] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:34.139871  6881 leader_election.cc:304] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:34.138290  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.145355  7066 raft_consensus.cc:2468] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:34.144064  7578 raft_consensus.cc:2804] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.148280  7578 raft_consensus.cc:697] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:34.149138  7578 consensus_queue.cc:237] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.161278  7606 raft_consensus.cc:493] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.161813  7606 raft_consensus.cc:515] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.163908  7606 leader_election.cc:290] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:34.163956  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8f7290a19046fba7ff4bf9acad43b2" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:34.164652  7061 raft_consensus.cc:3060] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.164904  7595 raft_consensus.cc:493] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.165458  7595 raft_consensus.cc:515] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.173007  7113 tablet_bootstrap.cc:654] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.175611  6806 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:34.176649  7602 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.177157  7602 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.177515  7601 consensus_queue.cc:1048] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.178715  7061 raft_consensus.cc:2468] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:34.179368  7602 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.184073  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:34.184837  7597 raft_consensus.cc:2804] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.185389  7597 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.185846  7597 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:34.187937  6881 leader_election.cc:343] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.135295  7506 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.197063  6991 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.197178  7582 raft_consensus.cc:493] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.197854  7582 raft_consensus.cc:515] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.179962  7602 consensus_queue.cc:1048] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:34.202986  7582 leader_election.cc:290] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.204083  6987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:34.205327  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.206000  7067 raft_consensus.cc:2468] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:34.207501  6882 leader_election.cc:304] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:34.208369  7582 raft_consensus.cc:2804] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.209089  7582 raft_consensus.cc:493] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.209435  7582 raft_consensus.cc:3060] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.209579  6987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:34.210213  6805 leader_election.cc:343] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.212740  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:34.208369  7595 leader_election.cc:290] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:34.216287  7117 tablet_bootstrap.cc:654] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:34.216696  6881 leader_election.cc:343] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.217033  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:34.218237  6881 leader_election.cc:343] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.229753  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:34.230813  6838 raft_consensus.cc:2468] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:34.233444  7064 raft_consensus.cc:2468] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:34.234983  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.235808  7067 raft_consensus.cc:2468] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 0.
I20260709 12:25:34.230926  6842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:34.240352  6842 raft_consensus.cc:2468] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 0.
I20260709 12:25:34.253631  7597 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.254313  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:34.255771  6807 leader_election.cc:343] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:34.259774  6805 leader_election.cc:343] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.260810  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:34.261199  7597 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
W20260709 12:25:34.266047  6805 leader_election.cc:343] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.227525  7500 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:34.273567  7582 raft_consensus.cc:515] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.281880  6881 leader_election.cc:304] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.283843  7595 raft_consensus.cc:2804] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.284253  7595 raft_consensus.cc:493] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.284628  7595 raft_consensus.cc:3060] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.290937  6881 leader_election.cc:304] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.292779  7579 raft_consensus.cc:2804] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.293179  7579 raft_consensus.cc:493] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.293524  7579 raft_consensus.cc:3060] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.296478  7595 raft_consensus.cc:515] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.305300  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:34.307317  6881 leader_election.cc:343] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.309021  7582 leader_election.cc:290] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.310128  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:34.321228  6806 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:34.323557  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:34.323616  6839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:34.324327  7066 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.324563  6839 raft_consensus.cc:3060] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.329070  7601 raft_consensus.cc:2804] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.329763  7601 raft_consensus.cc:697] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:34.331008  7601 consensus_queue.cc:237] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:34.332638  7066 raft_consensus.cc:2468] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:34.333534  6806 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.334826  7602 raft_consensus.cc:2804] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:34.335182  7602 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.335529  7602 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.327488  7061 raft_consensus.cc:3060] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.342945  6806 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.348114  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6a6075ba174637ba0ca8a688bcaafe" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:34.347919  6736 catalog_manager.cc:5697] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:34.349331  6881 leader_election.cc:343] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.348351  7595 leader_election.cc:290] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:34.351727  7602 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.345043  7597 raft_consensus.cc:2804] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.355338  7597 raft_consensus.cc:697] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:34.355509  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:34.355784  7602 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.356199  7597 consensus_queue.cc:237] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:34.357028  6805 leader_election.cc:343] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.359735  7061 raft_consensus.cc:2468] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:34.360965  7117 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: No bootstrap required, opened a new log
I20260709 12:25:34.357576  7579 raft_consensus.cc:515] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.361442  7117 ts_tablet_manager.cc:1403] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: Time spent bootstrapping tablet: real 0.255s	user 0.037s	sys 0.021s
I20260709 12:25:34.365614  6882 leader_election.cc:304] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.366757  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
I20260709 12:25:34.367343  6843 raft_consensus.cc:3060] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.368404  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:34.369108  7066 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.370034  7606 raft_consensus.cc:2804] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.372135  6839 raft_consensus.cc:2468] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:34.373903  7117 raft_consensus.cc:359] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:34.374660  7117 raft_consensus.cc:385] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.374984  7117 raft_consensus.cc:740] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.375705  7117 consensus_queue.cc:260] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:34.372151  7606 raft_consensus.cc:697] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:34.377269  7606 consensus_queue.cc:237] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.378326  7600 consensus_queue.cc:1048] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.381398  6881 leader_election.cc:304] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.388087  6843 raft_consensus.cc:2468] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:34.388193  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:34.389763  6881 leader_election.cc:343] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:34.390544  6881 leader_election.cc:304] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.395771  7596 raft_consensus.cc:2804] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.396309  7596 raft_consensus.cc:697] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:34.396503  7117 ts_tablet_manager.cc:1434] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:25:34.397163  7596 consensus_queue.cc:237] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.390667  7604 raft_consensus.cc:2804] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.389317  7579 leader_election.cc:290] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:34.399817  7604 raft_consensus.cc:697] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:34.400722  7604 consensus_queue.cc:237] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.406899  7113 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.407454  7113 ts_tablet_manager.cc:1403] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.337s	user 0.020s	sys 0.001s
I20260709 12:25:34.422107  7113 raft_consensus.cc:359] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.425078  7113 raft_consensus.cc:385] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.425458  7113 raft_consensus.cc:740] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.426173  7113 consensus_queue.cc:260] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.436945  6738 catalog_manager.cc:5697] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.446992  7113 ts_tablet_manager.cc:1434] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:25:34.448189  7113 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:34.493567  7066 raft_consensus.cc:2468] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 1.
I20260709 12:25:34.499257  7535 consensus_queue.cc:1048] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.507377  6806 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8
I20260709 12:25:34.509059  7602 raft_consensus.cc:2804] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:34.509780  7602 raft_consensus.cc:697] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:34.511385  7602 consensus_queue.cc:237] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.537130  7113 tablet_bootstrap.cc:654] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.536661  6736 catalog_manager.cc:5697] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.538383  6736 catalog_manager.cc:5697] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.561369  6735 catalog_manager.cc:5697] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.564661  6735 catalog_manager.cc:5697] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.567608  7113 tablet_bootstrap.cc:492] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.568190  7113 ts_tablet_manager.cc:1403] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.120s	user 0.009s	sys 0.013s
I20260709 12:25:34.571137  7113 raft_consensus.cc:359] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.571826  7113 raft_consensus.cc:385] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.572099  7113 raft_consensus.cc:740] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.572788  7113 consensus_queue.cc:260] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.575700  7113 ts_tablet_manager.cc:1434] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:25:34.576747  7113 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:34.582928  7113 tablet_bootstrap.cc:654] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.597129  6735 catalog_manager.cc:5697] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 1 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.611191  7113 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.611738  7113 ts_tablet_manager.cc:1403] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 12:25:34.610968  6736 catalog_manager.cc:5697] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.614238  7113 raft_consensus.cc:359] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.616237  7113 raft_consensus.cc:385] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.616503  7113 raft_consensus.cc:740] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.617233  7113 consensus_queue.cc:260] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.619750  7113 ts_tablet_manager.cc:1434] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:34.622452  7113 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:34.628826  7113 tablet_bootstrap.cc:654] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.634601  7113 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.635063  7113 ts_tablet_manager.cc:1403] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:25:34.637606  7113 raft_consensus.cc:359] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.638244  7113 raft_consensus.cc:385] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.638505  7113 raft_consensus.cc:740] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.639189  7113 consensus_queue.cc:260] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.641153  7113 ts_tablet_manager.cc:1434] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:34.642038  7113 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: Bootstrap starting.
I20260709 12:25:34.653674  7113 tablet_bootstrap.cc:654] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:34.660915  7113 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: No bootstrap required, opened a new log
I20260709 12:25:34.661422  7113 ts_tablet_manager.cc:1403] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 12:25:34.665983  7113 raft_consensus.cc:359] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.666721  7113 raft_consensus.cc:385] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:34.667163  7113 raft_consensus.cc:740] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Initialized, Role: FOLLOWER
I20260709 12:25:34.667835  7113 consensus_queue.cc:260] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.670092  7113 ts_tablet_manager.cc:1434] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:25:34.722128  7596 consensus_queue.cc:1048] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.728840  7598 raft_consensus.cc:493] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.729418  7598 raft_consensus.cc:515] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } }
I20260709 12:25:34.735476  7598 leader_election.cc:290] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:34.739464  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:34.741359  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9697377f5245aea57a49232473283e" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.742050  7064 raft_consensus.cc:2393] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:34.747310  6956 leader_election.cc:304] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:34.747432  7601 consensus_queue.cc:1048] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.750531  7535 raft_consensus.cc:3060] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.755719  7549 consensus_queue.cc:1048] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:34.796926  6992 raft_consensus.cc:3060] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.822012  7600 raft_consensus.cc:493] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.822628  7600 raft_consensus.cc:515] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:34.824883  7600 leader_election.cc:290] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:34.827881  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:34.830433  6838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43ba15ae68f4e60954a666740ae7ec7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:34.831727  6838 raft_consensus.cc:2393] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:34.834118  6955 leader_election.cc:304] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:34.766642  7535 raft_consensus.cc:2749] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.840032  6991 raft_consensus.cc:3060] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.858628  7596 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.859251  7596 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:34.854112  7549 consensus_queue.cc:1048] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:25:34.874840  6993 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.897560  7641 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.898296  7641 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:34.900722  7641 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:34.902899  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:34.905504  7596 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:34.905949  6843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301" is_pre_election: true
I20260709 12:25:34.912933  7597 consensus_queue.cc:1048] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.930836  7549 consensus_queue.cc:1048] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.933328  7579 consensus_queue.cc:1048] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.935519  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.936911  7602 consensus_queue.cc:1048] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:34.937701  7535 raft_consensus.cc:2749] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:34.938650  7064 raft_consensus.cc:2393] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 1: Already voted for candidate 91e8bb7cfca34631a0d9c45d8b139301 in this term.
W20260709 12:25:34.942200  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 63857.3us
I20260709 12:25:34.943979  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:34.946360  6956 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:34.948170  7535 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.951762  6913 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:34.974408  6882 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:35.001288  7535 raft_consensus.cc:2749] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.003557  7595 consensus_queue.cc:1048] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.019919  7596 consensus_queue.cc:1048] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:35.023862  7606 consensus_queue.cc:1048] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.041471  7597 consensus_queue.cc:1048] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.071345  7579 raft_consensus.cc:2749] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:35.073771  7601 consensus_queue.cc:1048] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:35.077994  7601 consensus_queue.cc:1048] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:36.073477 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
W20260709 12:25:36.080291  6955 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 329 similar messages]
W20260709 12:25:36.097828  6955 consensus_peers.cc:597] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.130378  6881 consensus_peers.cc:597] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.131165  6881 consensus_peers.cc:597] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.144297  6955 consensus_peers.cc:597] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.155643  7030 consensus_peers.cc:597] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.156302  7030 consensus_peers.cc:597] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.158465  6955 consensus_peers.cc:597] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.161553 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:36.162467 30271 tablet_replica.cc:333] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.163311 30271 raft_consensus.cc:2243] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.164115 30271 raft_consensus.cc:2272] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.166568 30271 tablet_replica.cc:333] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.167414 30271 raft_consensus.cc:2243] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.168341 30271 raft_consensus.cc:2272] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.170877 30271 tablet_replica.cc:333] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.171737 30271 raft_consensus.cc:2243] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.172652 30271 raft_consensus.cc:2272] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.175098 30271 tablet_replica.cc:333] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.175684 30271 raft_consensus.cc:2243] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.176206 30271 raft_consensus.cc:2272] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.178324 30271 tablet_replica.cc:333] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.179165 30271 raft_consensus.cc:2243] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.179651 30271 raft_consensus.cc:2272] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.181859 30271 tablet_replica.cc:333] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
W20260709 12:25:36.182415  6955 consensus_peers.cc:597] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.182672 30271 raft_consensus.cc:2243] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.183252 30271 raft_consensus.cc:2272] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.185158 30271 tablet_replica.cc:333] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.185767 30271 raft_consensus.cc:2243] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.186511 30271 raft_consensus.cc:2272] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.188496 30271 tablet_replica.cc:333] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.189069 30271 raft_consensus.cc:2243] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.189790 30271 raft_consensus.cc:2272] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.192057 30271 tablet_replica.cc:333] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.192880 30271 raft_consensus.cc:2243] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.193781 30271 raft_consensus.cc:2272] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.196135 30271 tablet_replica.cc:333] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.196836 30271 raft_consensus.cc:2243] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.197274 30271 raft_consensus.cc:2272] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.199406 30271 tablet_replica.cc:333] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.200095 30271 raft_consensus.cc:2243] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.200553 30271 raft_consensus.cc:2272] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.203068 30271 tablet_replica.cc:333] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.203785 30271 raft_consensus.cc:2243] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.204283 30271 raft_consensus.cc:2272] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.206660 30271 tablet_replica.cc:333] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.207298 30271 raft_consensus.cc:2243] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.208027 30271 raft_consensus.cc:2272] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.209894 30271 tablet_replica.cc:333] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.210657 30271 raft_consensus.cc:2243] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.211155 30271 raft_consensus.cc:2272] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.213366 30271 tablet_replica.cc:333] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.214107 30271 raft_consensus.cc:2243] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.214634 30271 raft_consensus.cc:2272] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.217154 30271 tablet_replica.cc:333] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.217897 30271 raft_consensus.cc:2243] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.218478 30271 raft_consensus.cc:2272] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.221004 30271 tablet_replica.cc:333] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
W20260709 12:25:36.221388  6955 consensus_peers.cc:597] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.221762 30271 raft_consensus.cc:2243] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.222308 30271 raft_consensus.cc:2272] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.224644 30271 tablet_replica.cc:333] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.225461 30271 raft_consensus.cc:2243] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.225973 30271 raft_consensus.cc:2272] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.228617 30271 tablet_replica.cc:333] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.229360 30271 raft_consensus.cc:2243] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.230278 30271 raft_consensus.cc:2272] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.232585 30271 tablet_replica.cc:333] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
W20260709 12:25:36.233175  6881 consensus_peers.cc:597] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.233335 30271 raft_consensus.cc:2243] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.233995 30271 raft_consensus.cc:2272] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.236634 30271 tablet_replica.cc:333] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.237406 30271 raft_consensus.cc:2243] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.237937 30271 raft_consensus.cc:2272] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.240624 30271 tablet_replica.cc:333] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.241392 30271 raft_consensus.cc:2243] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.242466 30271 raft_consensus.cc:2272] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.245726 30271 tablet_replica.cc:333] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
W20260709 12:25:36.246030  6881 consensus_peers.cc:597] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.246490 30271 raft_consensus.cc:2243] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.247100 30271 raft_consensus.cc:2272] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.249416 30271 tablet_replica.cc:333] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.250166 30271 raft_consensus.cc:2243] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.250643 30271 raft_consensus.cc:2272] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.253230 30271 tablet_replica.cc:333] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.253945 30271 raft_consensus.cc:2243] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.254881 30271 raft_consensus.cc:2272] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.257341 30271 tablet_replica.cc:333] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.258064 30271 raft_consensus.cc:2243] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.258548 30271 raft_consensus.cc:2272] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.261152 30271 tablet_replica.cc:333] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
W20260709 12:25:36.261860  7030 consensus_peers.cc:597] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.261880 30271 raft_consensus.cc:2243] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.262734 30271 raft_consensus.cc:2272] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.265386 30271 tablet_replica.cc:333] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.266173 30271 raft_consensus.cc:2243] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.266649 30271 raft_consensus.cc:2272] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.269236 30271 tablet_replica.cc:333] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.269941 30271 raft_consensus.cc:2243] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.270476 30271 raft_consensus.cc:2272] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.273102 30271 tablet_replica.cc:333] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.273787 30271 raft_consensus.cc:2243] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.274317 30271 raft_consensus.cc:2272] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.276942 30271 tablet_replica.cc:333] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.277707 30271 raft_consensus.cc:2243] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.278251 30271 raft_consensus.cc:2272] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.276777  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.281071 30271 tablet_replica.cc:333] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.281821 30271 raft_consensus.cc:2243] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.282331 30271 raft_consensus.cc:2272] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.284991 30271 tablet_replica.cc:333] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.285737 30271 raft_consensus.cc:2243] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.286727 30271 raft_consensus.cc:2272] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.289527 30271 tablet_replica.cc:333] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.290275 30271 raft_consensus.cc:2243] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.290751 30271 raft_consensus.cc:2272] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.293267 30271 tablet_replica.cc:333] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.293999 30271 raft_consensus.cc:2243] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.294489 30271 raft_consensus.cc:2272] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.296983 30271 tablet_replica.cc:333] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.297685 30271 raft_consensus.cc:2243] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.298709 30271 raft_consensus.cc:2272] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.301363 30271 tablet_replica.cc:333] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.302191 30271 raft_consensus.cc:2243] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.302716 30271 raft_consensus.cc:2272] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.305320 30271 tablet_replica.cc:333] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.305940 30271 raft_consensus.cc:2243] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.306474 30271 raft_consensus.cc:2272] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.309140 30271 tablet_replica.cc:333] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.309794 30271 raft_consensus.cc:2243] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.310590 30271 raft_consensus.cc:2272] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.312670 30271 tablet_replica.cc:333] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.313210 30271 raft_consensus.cc:2243] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.314009 30271 raft_consensus.cc:2272] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.316577 30271 tablet_replica.cc:333] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.317255 30271 raft_consensus.cc:2243] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.318310 30271 raft_consensus.cc:2272] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.321133 30271 tablet_replica.cc:333] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.321811 30271 raft_consensus.cc:2243] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.322752 30271 raft_consensus.cc:2272] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.325498 30271 tablet_replica.cc:333] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.326138 30271 raft_consensus.cc:2243] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.327138 30271 raft_consensus.cc:2272] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.329672 30271 tablet_replica.cc:333] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.330325 30271 raft_consensus.cc:2243] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:36.330835 30271 raft_consensus.cc:2272] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:36.332897 30271 tablet_replica.cc:333] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: stopping tablet replica
I20260709 12:25:36.333380 30271 raft_consensus.cc:2243] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:36.334173 30271 raft_consensus.cc:2272] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:36.370149  6881 consensus_peers.cc:597] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.396824  6955 consensus_peers.cc:597] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.404500  6881 consensus_peers.cc:597] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.412642 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
W20260709 12:25:36.430061  6881 consensus_peers.cc:597] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.430708  6881 consensus_peers.cc:597] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.433876  6881 consensus_peers.cc:597] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.456974  6955 consensus_peers.cc:597] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.461879  6881 consensus_peers.cc:597] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.476213  7030 consensus_peers.cc:597] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.502112 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:36.509500  6955 consensus_peers.cc:597] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:36.509694  7666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:36.511547  7667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:36.514551  7669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:36.516876 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:36.521656 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:36.521981 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:36.522217 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599936522200 us; error 0 us; skew 500 ppm
I20260709 12:25:36.523085 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:36.526798 30271 webserver.cc:533] Webserver started at http://127.29.143.193:46015/ using document root <none> and password file <none>
I20260709 12:25:36.527478 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:36.527724 30271 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:25:36.532941 30271 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:36.542937  7674 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 12:25:36.545449  6955 consensus_peers.cc:597] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.546033 30271 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:25:36.546335 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "91e8bb7cfca34631a0d9c45d8b139301"
format_stamp: "Formatted at 2026-07-09 12:25:22 on dist-test-slave-9k85"
I20260709 12:25:36.546851 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:25:36.570006  6955 consensus_peers.cc:597] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.570982 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:36.572682 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:36.575595 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:25:36.599118  6955 consensus_peers.cc:597] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.606769  7682 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:25:36.727859  6881 consensus_peers.cc:597] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:36.956552 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:25:36.956976 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.373s	user 0.022s	sys 0.006s
I20260709 12:25:36.957329 30271 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:25:36.963547  7682 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:36.979715  7682 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:36.980664  7682 tablet_bootstrap.cc:492] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:36.981282  7682 ts_tablet_manager.cc:1403] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:25:36.983829  7682 raft_consensus.cc:359] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:36.984508  7682 raft_consensus.cc:740] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.985208  7682 consensus_queue.cc:260] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.004236  7682 ts_tablet_manager.cc:1434] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.015s
I20260709 12:25:37.005062  7682 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.043213  7682 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.044162  7682 tablet_bootstrap.cc:492] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.044781  7682 ts_tablet_manager.cc:1403] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.008s
I20260709 12:25:37.047166  7682 raft_consensus.cc:359] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.047842  7682 raft_consensus.cc:740] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.048719  7682 consensus_queue.cc:260] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.050700  7682 ts_tablet_manager.cc:1434] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:37.051426  7682 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.113230  7641 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.113929  7641 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.126298  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.130556  7641 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:37.150554  6955 leader_election.cc:336] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.151190  6955 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.152459  7641 raft_consensus.cc:2749] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.157763  7682 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.158728  7682 tablet_bootstrap.cc:492] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.159358  7682 ts_tablet_manager.cc:1403] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.108s	user 0.056s	sys 0.051s
I20260709 12:25:37.161790  7682 raft_consensus.cc:359] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.162469  7682 raft_consensus.cc:740] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.163259  7682 consensus_queue.cc:260] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.165266  7682 ts_tablet_manager.cc:1434] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:37.166039  7682 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.186446  7682 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.187472  7682 tablet_bootstrap.cc:492] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.188090  7682 ts_tablet_manager.cc:1403] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:25:37.190600  7682 raft_consensus.cc:359] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.191308  7682 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.192018  7682 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.193727  7682 ts_tablet_manager.cc:1434] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:37.194514  7682 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.211715  7682 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.212749  7682 tablet_bootstrap.cc:492] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.213461  7682 ts_tablet_manager.cc:1403] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:25:37.216084  7682 raft_consensus.cc:359] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.216830  7682 raft_consensus.cc:740] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.217729  7682 consensus_queue.cc:260] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.220191  7682 ts_tablet_manager.cc:1434] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:37.221037  7682 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.241802  7641 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.242442  7641 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.244619  7641 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.247416  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
W20260709 12:25:37.255664  6955 leader_election.cc:336] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.256120  6955 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.257268  7641 raft_consensus.cc:2749] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.257370  7682 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.258572  7682 tablet_bootstrap.cc:492] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.259359  7682 ts_tablet_manager.cc:1403] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.012s
I20260709 12:25:37.262068  7682 raft_consensus.cc:359] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.262861  7682 raft_consensus.cc:740] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.263612  7682 consensus_queue.cc:260] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.265954  7682 ts_tablet_manager.cc:1434] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:37.267442  7682 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.265841  7684 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.268083  7684 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.270139  7684 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.272145  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.276286  7596 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.276819  7596 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.289723  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.291719  7644 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.292295  7644 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.294322  7644 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.295477  7682 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.296479  7682 tablet_bootstrap.cc:492] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.297144  7682 ts_tablet_manager.cc:1403] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 12:25:37.299896  7682 raft_consensus.cc:359] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.300599  7682 raft_consensus.cc:740] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.301425  7682 consensus_queue.cc:260] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.303436  7596 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.303813  7682 ts_tablet_manager.cc:1434] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:37.304805  7682 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:37.314810  7030 leader_election.cc:336] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.317356  6881 leader_election.cc:336] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.317950  6881 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.319653  7684 raft_consensus.cc:2749] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.325845  7682 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.326925  7682 tablet_bootstrap.cc:492] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.327538  7682 ts_tablet_manager.cc:1403] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
W20260709 12:25:37.328481  6881 leader_election.cc:336] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.330124  7682 raft_consensus.cc:359] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.331259  7682 raft_consensus.cc:740] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.332727  6881 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.332525  7682 consensus_queue.cc:260] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.333658  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.334635  7684 raft_consensus.cc:2749] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.334986  6992 raft_consensus.cc:2468] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.336320  7030 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.337335  7682 ts_tablet_manager.cc:1434] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:37.338151  7682 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.339336  7644 raft_consensus.cc:2804] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.339818  7644 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.340219  7644 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.347935 30271 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:25:37.348296 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.391s	user 0.297s	sys 0.005s
I20260709 12:25:37.348548  7681 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.349022  7681 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.351713  7681 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:37.359720  7030 leader_election.cc:336] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.366247  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.367235  6992 raft_consensus.cc:2468] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.371002  7030 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.376009  7682 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.377147  7682 tablet_bootstrap.cc:492] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.377908  7682 ts_tablet_manager.cc:1403] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.023s
I20260709 12:25:37.380810  7682 raft_consensus.cc:359] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.381628  7682 raft_consensus.cc:740] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.382516  7682 consensus_queue.cc:260] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.384799  7682 ts_tablet_manager.cc:1434] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:37.385564  7682 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.391574  7681 raft_consensus.cc:2804] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.392222  7681 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.392887  7681 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.407644  7682 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.408043  7684 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.408947  7682 tablet_bootstrap.cc:492] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.408838  7684 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.409888  7682 ts_tablet_manager.cc:1403] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 12:25:37.412616  7682 raft_consensus.cc:359] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.413340  7684 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.413335  7682 raft_consensus.cc:740] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.414863  7682 consensus_queue.cc:260] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.415205  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.417224  7682 ts_tablet_manager.cc:1434] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:37.418083  7682 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.420686  7658 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.421427  7658 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.426254  7658 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.426965  7658 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.427551  7658 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.439281  7658 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.444617  7660 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.449239  7660 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.453883  7682 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.454483  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.461284  7682 tablet_bootstrap.cc:492] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.462023  7682 ts_tablet_manager.cc:1403] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.005s
I20260709 12:25:37.455111  7660 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.465011  7682 raft_consensus.cc:359] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.465866  7682 raft_consensus.cc:740] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.466804  7682 consensus_queue.cc:260] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.470079  7682 ts_tablet_manager.cc:1434] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:25:37.471386  7682 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.474836  7684 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.475622  7684 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.477952  7684 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.493489  7682 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.494223  7683 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.494768  7682 tablet_bootstrap.cc:492] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.497599  7682 ts_tablet_manager.cc:1403] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 12:25:37.495343  7684 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.499022  7684 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.501154  7682 raft_consensus.cc:359] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.502076  7682 raft_consensus.cc:740] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.503110  7682 consensus_queue.cc:260] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.505734  7682 ts_tablet_manager.cc:1434] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:37.506580  7682 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.507864  7535 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.508399  7535 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.510669  7535 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.514065  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.514895  6917 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.516767  7596 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.517501  7596 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.520314  7596 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:37.522312  6957 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.523453  7535 raft_consensus.cc:2804] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.523945  7535 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.524423  7535 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.535815  7682 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.537745  7682 tablet_bootstrap.cc:492] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.539130  7682 ts_tablet_manager.cc:1403] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.033s	user 0.031s	sys 0.000s
I20260709 12:25:37.498966  7683 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.543058  7682 raft_consensus.cc:359] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.544106  7682 raft_consensus.cc:740] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.545125  7682 consensus_queue.cc:260] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.547992  7682 ts_tablet_manager.cc:1434] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:37.549103  7682 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.503381  7684 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.544361  7683 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:37.563849  6955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 100255us
I20260709 12:25:37.574975  7682 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.576107  7682 tablet_bootstrap.cc:492] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.578385  7682 ts_tablet_manager.cc:1403] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 12:25:37.581005  7682 raft_consensus.cc:359] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.581681  7682 raft_consensus.cc:740] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.582406  7682 consensus_queue.cc:260] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.584882  7682 ts_tablet_manager.cc:1434] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:37.585688  7682 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.585721  7658 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.599906  7705 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.601640  7705 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.600844  7707 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
W20260709 12:25:37.613517  7030 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.616487  7030 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.617653  7709 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.605340  7711 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.619251  7711 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.621999  7717 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.622443  7711 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.622967  7717 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.618371  7709 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.626021  7717 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.620579  7715 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.605733  7714 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.607043  7660 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.628289  7660 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.631453  7714 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.627137  7709 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.604475  7644 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.609436  7641 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.633605  7641 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.632682  7660 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.635155  7644 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.636121  7641 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.627135  7715 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.574409  7684 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.640141  7684 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.643247  7596 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.643810  7596 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.644567  7684 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.645816  7596 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.647140  7714 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.637020  7707 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.651036  7644 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.652302  7644 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.653147  7707 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.654247  7644 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.586284  7658 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.656454  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.641245  7715 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.656996  7066 raft_consensus.cc:2468] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.660233  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.660777  7066 raft_consensus.cc:2468] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:37.661196  7682 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.649191  7713 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.657331  7717 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.664342  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.666239  7713 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.666435  7066 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:37.666357  7717 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.665684  7705 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.668123  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.668529  7681 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.668849  7717 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.668794  7066 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.670539  7681 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.670616  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.671386  7066 raft_consensus.cc:2468] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.676596  7713 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.672940  7658 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.680200  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
W20260709 12:25:37.682904  6955 leader_election.cc:336] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.683602  6955 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:37.687750  7660 raft_consensus.cc:2749] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.695421  7682 tablet_bootstrap.cc:492] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.696580  7682 ts_tablet_manager.cc:1403] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.111s	user 0.026s	sys 0.011s
I20260709 12:25:37.699153  7658 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.700058  7660 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.699990  7658 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.700888  7660 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.703660  7660 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.706014  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.706954  7066 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:37.725366  7682 raft_consensus.cc:359] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.730330  7682 raft_consensus.cc:740] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.730485  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.731359  7682 consensus_queue.cc:260] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.731197  7061 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:37.733922  7682 ts_tablet_manager.cc:1434] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 12:25:37.734982  7682 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.661829  7535 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.736402  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.737092  6917 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.739423  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:37.739984  6917 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.745160  6882 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.749421  7658 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.750607  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.751540  7066 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.752885  6882 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.754737  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.755384  7061 raft_consensus.cc:2468] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:37.757740  6956 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:37.756610  7720 raft_consensus.cc:2804] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.758811  7720 raft_consensus.cc:493] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.759110  7717 raft_consensus.cc:2804] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.759542  7717 raft_consensus.cc:493] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.750535  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.759840  6956 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:37.758741  7683 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.759521  7720 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.760567  7683 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.761178  7683 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.761332  6913 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
W20260709 12:25:37.755427  6955 leader_election.cc:336] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.762995  7660 raft_consensus.cc:2804] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.760000  7717 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.744508  7535 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.764761  7660 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.763559  6956 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:37.768930  6956 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:37.769589  6956 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:37.779517  6882 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.780746  6882 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.771080  7535 raft_consensus.cc:2804] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.770484  7660 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.791956  6917 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:37.793818  7723 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.794497  7723 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.795084  7723 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.805722  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.806413  6917 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.785346  7684 raft_consensus.cc:2804] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.791497  7535 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.811206  7721 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.811482  7535 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.811805  7721 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.812775  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.813679  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.814406  7032 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.814635  6913 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.814831  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.815650  6912 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.819604  7658 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.820201  7658 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.820633  7658 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.821441  7720 raft_consensus.cc:515] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.822671  6917 raft_consensus.cc:2393] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:37.827102  7032 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:37.809304  7684 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.828516  7705 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.828755  7684 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.828962  7705 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.829463  7705 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.830963  7722 raft_consensus.cc:2804] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.831528  7722 raft_consensus.cc:493] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.831622  7032 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.832052  7722 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.847762  7641 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.848417  7641 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.850840  7683 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.853787  7032 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.855296  7707 raft_consensus.cc:2804] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:37.855544  7030 leader_election.cc:336] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.855727  7707 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.856244  7707 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:37.856369  7030 leader_election.cc:336] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.856971  7030 leader_election.cc:336] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.857398  7030 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.850567  7641 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:37.857811  7030 leader_election.cc:336] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.814420  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.842533  7644 raft_consensus.cc:2804] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.859350  7644 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.859722  7644 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.863054  7032 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.863677  7658 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.857729  6988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.864028  7718 raft_consensus.cc:2804] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.864651  7718 raft_consensus.cc:493] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.863713  7717 raft_consensus.cc:515] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.865134  7718 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.867405  7717 leader_election.cc:290] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.868685  7660 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.870988  6988 raft_consensus.cc:2393] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:37.874366  7535 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.875880  7660 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:37.858762  7030 leader_election.cc:336] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.877647  7030 leader_election.cc:336] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.878144  7030 leader_election.cc:336] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.878571  7030 leader_election.cc:336] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.879024  7030 leader_election.cc:336] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.878932  6882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 88050.6us
W20260709 12:25:37.879741  7030 leader_election.cc:336] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.880254  7032 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:37.881177  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:37.882022  6917 raft_consensus.cc:2468] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.882244  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:37.885663  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de46948cdeaa436392d55477ede3126c" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:37.886305  7709 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.887060  7535 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.887543  6988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
W20260709 12:25:37.887600  7030 leader_election.cc:336] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.808816  7727 raft_consensus.cc:2804] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.890434  7061 raft_consensus.cc:2393] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:37.846956  7721 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.892714  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.893198  7032 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.896652  6991 raft_consensus.cc:2393] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:37.876295  7683 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.902114  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.903765  6992 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 1.
I20260709 12:25:37.906430  6957 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:37.889568  7723 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.909369  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.909761  7658 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.910109  6992 raft_consensus.cc:2393] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:37.893478  7727 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.898367  6988 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.911876  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:37.900486  7681 raft_consensus.cc:2804] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:37.914830  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:37.917307  6991 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.919947  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.910590  7720 leader_election.cc:290] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.910143  7723 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.927640  6991 raft_consensus.cc:2468] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:37.918603  7681 raft_consensus.cc:493] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:37.916792  7727 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.910899  7535 raft_consensus.cc:2804] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.905881  7684 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.931041  7681 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.931654  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
W20260709 12:25:37.941457  7030 leader_election.cc:336] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.948845  6956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 145434us
I20260709 12:25:37.949941  6915 raft_consensus.cc:2393] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:37.951867  6988 raft_consensus.cc:2468] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:37.955848  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:37.966868  7684 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:37.966980  6991 raft_consensus.cc:2468] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 1.
I20260709 12:25:37.956262  7682 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:37.949676  7535 raft_consensus.cc:697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:37.968813  7682 tablet_bootstrap.cc:492] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:37.969477  7682 ts_tablet_manager.cc:1403] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.003s
I20260709 12:25:37.969339  7535 consensus_queue.cc:237] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.972787  7682 raft_consensus.cc:359] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.973618  7682 raft_consensus.cc:740] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.974576  7682 consensus_queue.cc:260] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:37.965586  6914 raft_consensus.cc:2393] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:37.950795  7707 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.978634  7707 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:37.980051  7705 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.980754  7682 ts_tablet_manager.cc:1434] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:37.991386  7061 raft_consensus.cc:2393] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d183b7afc3164213b30cb81edcc90c7d in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:37.991562  7682 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:37.989566  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e75070838e424ca6c903634ffb3bf7" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:37.992202  7066 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:37.992980  6955 leader_election.cc:336] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.993844  6955 leader_election.cc:336] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:37.994565  6955 leader_election.cc:336] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:37.990343  7709 raft_consensus.cc:2749] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:37.991312  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:37.987650  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:37.974107  7681 raft_consensus.cc:515] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:37.964680  7644 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:37.998662  6955 leader_election.cc:336] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.017403  6955 leader_election.cc:336] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.018198  6955 leader_election.cc:336] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.018070  7030 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.018661  6881 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.023075  7730 raft_consensus.cc:2804] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:38.023514  7730 raft_consensus.cc:493] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:38.023902  7730 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.018553  7644 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:38.008180  7718 raft_consensus.cc:515] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.031340  7718 leader_election.cc:290] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:38.004292  7727 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:37.999604  7032 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:38.001734  7066 raft_consensus.cc:2468] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:37.995638  7061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:38.035282  7061 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.011210  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:38.039219  6915 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.039783  7709 raft_consensus.cc:2749] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.040724  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac83c19fd794ce0b286a09a261b6406" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:38.041514  6914 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.019938  7722 raft_consensus.cc:515] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.012691  7067 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 1.
I20260709 12:25:38.008780  7063 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.014997  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:38.044029  7062 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.044131  7681 leader_election.cc:290] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:38.045490  7730 raft_consensus.cc:515] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:38.046940  7722 leader_election.cc:290] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:38.047513  7730 leader_election.cc:290] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:38.047923  6992 raft_consensus.cc:2393] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:38.050622  7727 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:38.051195  6916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:38.051939  6916 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.054626  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9623b1b1de04219ac9d959598fc006c" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:38.055409  6917 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.058995  7030 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.063445  7705 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:38.064477  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:38.065229  6918 raft_consensus.cc:2393] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:38.066766  7030 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.067888  7064 raft_consensus.cc:2468] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 2.
I20260709 12:25:38.071892  6917 raft_consensus.cc:2468] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:38.070523  6956 leader_election.cc:304] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:38.073340  7032 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.073951  6956 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:38.074946  7061 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 2.
I20260709 12:25:38.075915  7030 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.076083  6882 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.078286  6882 leader_election.cc:304] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.079955  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "986ed6daa4ed4fdb805d9d5eef38b40b" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:38.080613  7066 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.088413  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:38.077487  7705 raft_consensus.cc:2804] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.089133  7064 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.089296  7705 raft_consensus.cc:697] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:38.077476  7644 raft_consensus.cc:2749] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.097100  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87bd67d607704cc6a801ef7ecc2fa2b3" candidate_uuid: "d183b7afc3164213b30cb81edcc90c7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:38.097744  6991 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.098930  7062 raft_consensus.cc:2468] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:38.100890  7030 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.102048  7715 raft_consensus.cc:2804] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.102509  7715 raft_consensus.cc:697] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:38.081991  7722 raft_consensus.cc:2804] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.103163  7722 raft_consensus.cc:697] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:38.103338  7715 consensus_queue.cc:237] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.104025  7722 consensus_queue.cc:237] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.091519  7723 raft_consensus.cc:2804] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.106662  7723 raft_consensus.cc:697] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:38.106802  7718 raft_consensus.cc:2749] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.107645  7723 consensus_queue.cc:237] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.090553  6914 raft_consensus.cc:2468] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:38.091476  7727 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:38.110916  7727 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:38.111346  7727 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.111742  7030 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.114627  6956 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:38.090281  7705 consensus_queue.cc:237] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.116551  7660 raft_consensus.cc:2804] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.117122  7660 raft_consensus.cc:697] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:38.081179  7681 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:38.117908  7681 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:38.118155  7644 raft_consensus.cc:2804] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.091315  7730 raft_consensus.cc:2804] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.119057  7644 raft_consensus.cc:697] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:38.119401  7730 raft_consensus.cc:697] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:38.120327  7032 leader_election.cc:304] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.120402  7644 consensus_queue.cc:237] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.121635  7721 raft_consensus.cc:2804] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:25:38.121762  6955 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.122226  7721 raft_consensus.cc:697] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
W20260709 12:25:38.122632  6955 leader_election.cc:336] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.123459  6955 leader_election.cc:336] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.123204  7721 consensus_queue.cc:237] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:38.124017  6955 leader_election.cc:336] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.124645  7063 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:38.126091  7709 raft_consensus.cc:2749] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.118371  7681 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.135998  6736 catalog_manager.cc:5697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.129892  7064 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:38.130641  6991 raft_consensus.cc:2468] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d183b7afc3164213b30cb81edcc90c7d in term 2.
I20260709 12:25:38.130882  7066 raft_consensus.cc:2468] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:38.130923  7030 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.118036  7660 consensus_queue.cc:237] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.137426  6956 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.141275  6916 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:38.145015  7707 raft_consensus.cc:2749] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:38.149959  7030 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.147565  6956 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:38.143985  6881 leader_election.cc:304] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.150801  7030 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:38.152197  6956 leader_election.cc:304] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 
I20260709 12:25:38.152486  7032 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.153425  7707 raft_consensus.cc:2749] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.154196  7707 raft_consensus.cc:2804] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.154318  6915 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:38.154788  7707 raft_consensus.cc:697] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:38.155929  7032 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:38.155807  7707 consensus_queue.cc:237] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.156849  7715 raft_consensus.cc:2804] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.157655  7715 raft_consensus.cc:697] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
W20260709 12:25:38.170897  7030 leader_election.cc:336] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.174844  7682 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:38.176739  7682 tablet_bootstrap.cc:492] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:38.177634  7682 ts_tablet_manager.cc:1403] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.024s
I20260709 12:25:38.159121  7715 consensus_queue.cc:237] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.150557  7722 raft_consensus.cc:2804] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.162668  7596 raft_consensus.cc:2804] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.189774  7724 raft_consensus.cc:2804] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.120455  7730 consensus_queue.cc:237] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.194238  7682 raft_consensus.cc:359] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.194970  7682 raft_consensus.cc:740] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.195709  7682 consensus_queue.cc:260] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.189803  7726 raft_consensus.cc:2804] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.200956  7682 ts_tablet_manager.cc:1434] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:25:38.202085  7682 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:38.190774  7722 raft_consensus.cc:697] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:38.196931  7724 raft_consensus.cc:697] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:38.196671  7596 raft_consensus.cc:697] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Becoming Leader. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:38.209192  7724 consensus_queue.cc:237] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.210467  7596 consensus_queue.cc:237] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
W20260709 12:25:38.217217  7030 leader_election.cc:336] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.219411  7030 leader_election.cc:336] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.220228  7030 leader_election.cc:336] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.220960  7030 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.221302  7030 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:38.222394  7644 raft_consensus.cc:2749] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.206907  7726 raft_consensus.cc:697] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
W20260709 12:25:38.223162  6955 leader_election.cc:336] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:38.224555  6955 leader_election.cc:336] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.238996  7726 consensus_queue.cc:237] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.231331  7722 consensus_queue.cc:237] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.249312  7681 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:38.290262  6955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 64978.2us
I20260709 12:25:38.298098  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:38.293310  7727 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:38.301038  7744 log.cc:927] Time spent T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:25:38.319170  6991 raft_consensus.cc:2393] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:38.301819  7681 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:38.325837  7682 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:38.329072  7727 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:38.330103  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:38.330892  7066 raft_consensus.cc:2393] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5eb7ff7a37ff47f4a040d570caed46d8 in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
W20260709 12:25:38.334250  7030 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.334491  7682 tablet_bootstrap.cc:492] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:38.339401  7682 ts_tablet_manager.cc:1403] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.007s
I20260709 12:25:38.342135  7682 raft_consensus.cc:359] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:38.344317  7682 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.345546  7682 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:38.348083  7030 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.349987  7682 ts_tablet_manager.cc:1434] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:25:38.351226  7713 raft_consensus.cc:2749] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.355098  7682 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:38.388237  6915 raft_consensus.cc:1275] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.379206  7687 raft_consensus.cc:493] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.390202  7727 consensus_queue.cc:1048] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:38.394567  6955 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:38.399055  6955 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:38.402436  7722 raft_consensus.cc:2749] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:38.390115  7687 raft_consensus.cc:515] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:38.420811  7687 leader_election.cc:290] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:38.421340  7687 raft_consensus.cc:493] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.430353  6738 catalog_manager.cc:5697] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.432533  6738 catalog_manager.cc:5697] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.433620  6738 catalog_manager.cc:5697] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.438112  6738 catalog_manager.cc:5697] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.421759  7687 raft_consensus.cc:515] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:38.439584  6738 catalog_manager.cc:5697] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.442521  6738 catalog_manager.cc:5697] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 2 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:38.465764  7687 leader_election.cc:290] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:38.518461  7682 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:38.526484  7682 tablet_bootstrap.cc:492] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:38.532320  7063 raft_consensus.cc:1275] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer d183b7afc3164213b30cb81edcc90c7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.534036  7596 consensus_queue.cc:1048] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:38.535214  6955 consensus_peers.cc:597] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:38.527272  7682 ts_tablet_manager.cc:1403] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.011s
I20260709 12:25:38.544423  7682 raft_consensus.cc:359] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.545369  7682 raft_consensus.cc:740] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.553071  7682 consensus_queue.cc:260] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.556466  7682 ts_tablet_manager.cc:1434] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:38.559221  7687 raft_consensus.cc:493] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.566998  7687 raft_consensus.cc:515] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.578351  7687 leader_election.cc:290] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
W20260709 12:25:38.583757  7030 consensus_peers.cc:597] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.583029  7682 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:38.593963  6991 raft_consensus.cc:1275] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.615324  6991 raft_consensus.cc:1275] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.617494  7707 consensus_queue.cc:1048] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:38.619118  7707 consensus_queue.cc:1048] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:38.631718  7030 consensus_peers.cc:597] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.633293  6955 consensus_peers.cc:597] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.633725  7030 consensus_peers.cc:597] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.641319  7066 raft_consensus.cc:1275] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.642853  7535 consensus_queue.cc:1048] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:25:38.649055  7066 raft_consensus.cc:1275] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.651144  7724 consensus_queue.cc:1048] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:38.653708  6737 catalog_manager.cc:5697] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 2 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.655740  6737 catalog_manager.cc:5697] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 2 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.664135  7065 raft_consensus.cc:1275] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.658146  6737 catalog_manager.cc:5697] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to d183b7afc3164213b30cb81edcc90c7d (127.29.143.194). New cstate: current_term: 2 leader_uuid: "d183b7afc3164213b30cb81edcc90c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:38.728622  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 51651.8us
W20260709 12:25:38.735684  6955 consensus_peers.cc:597] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:38.736244  6955 consensus_peers.cc:597] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.729903  7687 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.737933  7687 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:38.687810  7727 consensus_queue.cc:1048] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 12:25:38.746076  6955 consensus_peers.cc:597] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.749536  6955 consensus_peers.cc:597] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.750017  6955 consensus_peers.cc:597] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.728039  6957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 50293.2us
W20260709 12:25:38.773509  7030 consensus_peers.cc:597] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.795573  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 215546us
I20260709 12:25:38.787235  7761 raft_consensus.cc:493] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.858912  7030 consensus_peers.cc:597] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:38.859512  7030 consensus_peers.cc:597] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:38.868883  6991 raft_consensus.cc:1275] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer d183b7afc3164213b30cb81edcc90c7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:38.998624  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 137940us
I20260709 12:25:38.904263  7065 raft_consensus.cc:1275] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.000140  7063 raft_consensus.cc:1275] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer d183b7afc3164213b30cb81edcc90c7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.883195  7761 raft_consensus.cc:515] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:39.023128  7791 raft_consensus.cc:493] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.111173  7743 log.cc:927] Time spent T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:25:39.145838  7794 raft_consensus.cc:493] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.158859  7784 log.cc:927] Time spent T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:25:39.159358  7687 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.160022  7687 raft_consensus.cc:493] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.160280  7786 log.cc:927] Time spent T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:25:39.160573  7687 raft_consensus.cc:515] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:39.145013  7791 raft_consensus.cc:515] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:39.171886  7791 leader_election.cc:290] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.171948  7687 leader_election.cc:290] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:39.172413  7791 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.172683  7687 raft_consensus.cc:493] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.172945  7791 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.173309  7687 raft_consensus.cc:515] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:39.174762  7761 leader_election.cc:290] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.175043  7794 raft_consensus.cc:515] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:39.177232  7794 leader_election.cc:290] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
W20260709 12:25:39.179190  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.216347  7682 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:39.226590  7682 tablet_bootstrap.cc:492] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:39.227268  7682 ts_tablet_manager.cc:1403] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.644s	user 0.028s	sys 0.063s
I20260709 12:25:39.239910  6917 raft_consensus.cc:1275] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:39.242990  7787 log.cc:927] Time spent T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:25:39.243355  6913 raft_consensus.cc:1275] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:39.244553  7030 consensus_peers.cc:597] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.245050  7030 consensus_peers.cc:597] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.245517  7030 consensus_peers.cc:597] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.245729  6955 consensus_peers.cc:597] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.234267  7791 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:39.245990  7030 consensus_peers.cc:597] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.280180  7535 consensus_queue.cc:1048] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:39.333190  7064 raft_consensus.cc:1275] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.309629  7687 leader_election.cc:290] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.346336  7800 consensus_queue.cc:1048] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:39.348811  6911 raft_consensus.cc:1275] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:25:39.363979  6881 leader_election.cc:336] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.364903  6881 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.365698  6881 leader_election.cc:336] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.366199  6881 leader_election.cc:336] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.366458  6881 leader_election.cc:304] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:39.372189  7535 consensus_queue.cc:1048] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:39.393038  6881 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.393962  6881 leader_election.cc:336] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.398020  7731 raft_consensus.cc:2749] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.411777  7682 raft_consensus.cc:359] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:39.412801  7682 raft_consensus.cc:740] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.413595  7682 consensus_queue.cc:260] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:39.407115  7804 raft_consensus.cc:493] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.420358  7682 ts_tablet_manager.cc:1434] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.193s	user 0.006s	sys 0.002s
I20260709 12:25:39.414043  7807 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.435189  7807 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.436987  7807 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:39.424918  7804 raft_consensus.cc:515] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:39.466302  7804 leader_election.cc:290] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.458643  7807 raft_consensus.cc:493] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.472728  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.483769  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.486294  7064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.485371  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.475026  7807 raft_consensus.cc:515] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.500722  7059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.511911  7059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.514297  7682 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:39.510375  7807 leader_election.cc:290] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:39.527995  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 133344us
W20260709 12:25:39.529093  6881 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.529604  6881 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:39.530622  7812 raft_consensus.cc:2749] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:25:39.532836  6955 consensus_peers.cc:597] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.533515  6955 consensus_peers.cc:597] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.542151  7804 raft_consensus.cc:493] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.542974  7804 raft_consensus.cc:515] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:39.547673  6881 leader_election.cc:336] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.548705  6881 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.549172  6881 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:39.562562  7810 raft_consensus.cc:2749] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:25:39.564378  6881 leader_election.cc:336] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
W20260709 12:25:39.565290  6881 leader_election.cc:336] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.570641  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.552567  7807 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.574532  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ec6be90d254ce1874ea9379f54f53a" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.584851  6993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.586771  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b534ea90b954a8aaa26488b181a5cd7" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.589433  6992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.590600  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.591562  7060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.592154  7063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.591595  7796 consensus_queue.cc:1048] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:25:39.598839  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae235a7a1ddc48aaa37f8297a848f365" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:39.599587  6955 consensus_peers.cc:597] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.601402  6955 consensus_peers.cc:597] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.601848  6955 consensus_peers.cc:597] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.602573  6955 consensus_peers.cc:597] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.605706  6986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93f31c1947a442ab8d8329061c6f3d4" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.578524  7807 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.608995  7675 leader_election.cc:304] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.592984  7792 consensus_queue.cc:1048] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:25:39.610829  7687 raft_consensus.cc:2749] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.611037  6988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.617935  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c85168e3fee4b5682576a9098aebf37" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.610325  7675 leader_election.cc:304] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.635308  6917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5ab4fca4284754b2922f9348679d77" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.618235  6918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.647910  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.592950  7058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.628280  7804 leader_election.cc:290] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.646781  7687 raft_consensus.cc:2749] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.647786  6911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea4f98636ae4352bed12ff04f780dc5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.672557  6910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.673683  6910 raft_consensus.cc:2393] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:39.674118  7058 raft_consensus.cc:2393] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:39.643396  7731 consensus_queue.cc:1048] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:25:39.685263  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a2750742f4f4dceab13f4552a75ff9f" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:39.655055  7675 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 44824.8us
W20260709 12:25:39.692274  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 45495.9us
I20260709 12:25:39.686820  7675 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.701148  7792 consensus_queue.cc:1048] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.686856  6916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa2b22be3870440ea4db26e751648dbb" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.705442  6914 raft_consensus.cc:1275] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.706039  7675 leader_election.cc:304] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.706207  7687 raft_consensus.cc:2749] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:39.730223  7675 leader_election.cc:304] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.740415  7675 leader_election.cc:304] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.743301  7807 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:39.746529  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da57db9ef59345a2a1467f6952f3364d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.747406  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.731040  7804 raft_consensus.cc:2749] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.756481  7806 raft_consensus.cc:2749] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.757262  7806 raft_consensus.cc:2749] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.760414  7058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.761287  7058 raft_consensus.cc:2393] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
W20260709 12:25:39.762849  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 47694.6us
W20260709 12:25:39.763588  6881 leader_election.cc:336] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:39.763983  6881 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d183b7afc3164213b30cb81edcc90c7d; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:39.767277  7843 raft_consensus.cc:2749] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.774467  7687 raft_consensus.cc:493] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.775226  7677 leader_election.cc:304] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.775063  7687 raft_consensus.cc:515] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:39.776290  7804 raft_consensus.cc:2749] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.778522  7687 leader_election.cc:290] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:39.781805  7677 leader_election.cc:304] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.783723  7677 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.785755  7804 raft_consensus.cc:2749] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.786413  7804 raft_consensus.cc:2749] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.787727  7677 leader_election.cc:304] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.788552  7804 raft_consensus.cc:2749] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.789740  7677 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.791126  7804 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.791914  6736 catalog_manager.cc:5697] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.794167  6736 catalog_manager.cc:5697] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.798130  6736 catalog_manager.cc:5697] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.796715  6738 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42178 (request call id 99) took 1053 ms. Trace:
I20260709 12:25:39.799728  6738 rpcz_store.cc:276] 0709 12:25:38.743010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.743158 (+   148us) service_pool.cc:224] Handling call
0709 12:25:39.796638 (+1053480us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83628,"reported_tablets":1}
I20260709 12:25:39.802053  7675 leader_election.cc:304] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.802145  6736 catalog_manager.cc:5697] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.803817  7687 raft_consensus.cc:2749] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.790318  6737 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42162 (request call id 114) took 1306 ms. Trace:
I20260709 12:25:39.805326  6736 catalog_manager.cc:5697] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 2, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.821635  7644 consensus_queue.cc:1048] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:39.825348  7677 leader_election.cc:304] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.812357  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.826200  7687 raft_consensus.cc:2749] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:39.828650  6881 consensus_peers.cc:597] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.806586  6737 rpcz_store.cc:276] 0709 12:25:38.484062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.484254 (+   192us) service_pool.cc:224] Handling call
0709 12:25:38.615533 (+131279us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b5400936cd4. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc1196cd090 00007fc11976bf3a 00007fc11f521e9c 00007fc11f62004e 00007fc11dae12a4 00007fc11dae1232 00007fc11dae1161 00007fc11dae10dc 00007fc11dae0392 00007fc117a9e48c 00007fc117a9d8c6
0709 12:25:39.790232 (+1174699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:38.768243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:38.768762 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:38.770268 (+  1506us) write_op.cc:435] Acquired schema lock
0709 12:25:38.770290 (+    22us) tablet.cc:662] Decoding operations
0709 12:25:38.886749 (+116459us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:38.893747 (+  6998us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:38.904009 (+ 10262us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:25:39.131993 (+227984us) tablet.cc:701] Row locks acquired
0709 12:25:39.132016 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:25:39.143018 (+ 11002us) write_op.cc:270] Start()
0709 12:25:39.146933 (+  3915us) write_op.cc:276] Timestamp: P: 1783599939140418 usec, L: 0
0709 12:25:39.146967 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:25:39.167276 (+ 20309us) log.cc:844] Serialized 1325 byte log entry
0709 12:25:39.398967 (+231691us) op_driver.cc:464] REPLICATION: finished
0709 12:25:39.499955 (+100988us) write_op.cc:301] APPLY: starting
0709 12:25:39.503404 (+  3449us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:39.556633 (+ 53229us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:39.571449 (+ 14816us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:39.638269 (+ 66820us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:39.652371 (+ 14102us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:25:39.654971 (+  2600us) write_op.cc:312] APPLY: finished
0709 12:25:39.679212 (+ 24241us) log.cc:844] Serialized 34 byte log entry
0709 12:25:39.693332 (+ 14120us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:39.697212 (+  3880us) write_op.cc:454] Released schema lock
0709 12:25:39.698212 (+  1000us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:39.700265 (+  2053us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:39.700296 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":227960064,"child_traces":[["op",{"apply.queue_time_us":87227,"apply.run_cpu_time_us":3086,"apply.run_wall_time_us":207928,"num_ops":3,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":4359,"prepare.run_wall_time_us":399314,"replication_time_us":226515,"thread_start_us":38855,"threads_started":1}]]}
W20260709 12:25:39.831377  6881 consensus_peers.cc:597] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:39.831868  6881 consensus_peers.cc:597] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:39.835424  7677 leader_election.cc:304] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.836480  7687 raft_consensus.cc:2749] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.857910  7804 raft_consensus.cc:2749] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.859316  7682 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:39.868016  7682 tablet_bootstrap.cc:492] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:39.869107  7682 ts_tablet_manager.cc:1403] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.355s	user 0.019s	sys 0.008s
I20260709 12:25:39.899312  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.900255  6914 raft_consensus.cc:2393] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate d183b7afc3164213b30cb81edcc90c7d in this term.
I20260709 12:25:39.877876  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:39.927472  7682 raft_consensus.cc:359] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.928501  7682 raft_consensus.cc:740] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.930011  7682 consensus_queue.cc:260] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:39.932610  7677 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.933779  7687 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.934063  7682 ts_tablet_manager.cc:1434] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
W20260709 12:25:39.931463  6955 consensus_peers.cc:597] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:39.936326  6955 consensus_peers.cc:597] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:39.942366  7804 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.943954  7804 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:39.946031  7804 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:39.946924  7677 leader_election.cc:304] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:39.947602  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:39.948397  7062 raft_consensus.cc:2393] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in this term.
I20260709 12:25:39.949536  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:39.940092  7682 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:39.951153  6989 raft_consensus.cc:2393] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91e8bb7cfca34631a0d9c45d8b139301 in current term 2: Already voted for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in this term.
I20260709 12:25:39.954007  7675 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:39.955260  7807 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.973786  6736 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42170 (request call id 103) took 1187 ms. Trace:
I20260709 12:25:39.953389  7804 raft_consensus.cc:2749] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:39.974275  6736 rpcz_store.cc:276] 0709 12:25:38.786053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.786184 (+   131us) service_pool.cc:224] Handling call
0709 12:25:39.973711 (+1187527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:39.922725 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:39.923253 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:39.923282 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:25:39.923298 (+    16us) tablet.cc:662] Decoding operations
0709 12:25:39.923943 (+   645us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:39.924016 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:39.924042 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:25:39.924512 (+   470us) tablet.cc:701] Row locks acquired
0709 12:25:39.924529 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:39.924653 (+   124us) write_op.cc:270] Start()
0709 12:25:39.924745 (+    92us) write_op.cc:276] Timestamp: P: 1783599939924611 usec, L: 0
0709 12:25:39.924764 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:39.925359 (+   595us) log.cc:844] Serialized 2104 byte log entry
0709 12:25:39.953700 (+ 28341us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18003fbc80. stack: 00007fc116644343 00007fc116644240 00007fc115fd31d4 00007fc11fd11304 00007fc11fd11299 00007fc11f53eab1 00007fc11f54b281 00007fc11d19a41d 00007fc11d19c71a 00007fc11d19c6a8 00007fc11d19c628 00007fc11d19c5e3 00007fc11d19b7fc 00007fc11f5ce2f6 00007fc11f5c8aa8 00007fc11976f310
0709 12:25:39.953755 (+    55us) op_driver.cc:464] REPLICATION: finished
0709 12:25:39.956261 (+  2506us) write_op.cc:301] APPLY: starting
0709 12:25:39.956381 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:39.956604 (+   223us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:39.956636 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:39.957230 (+   594us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:39.957495 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:25:39.957561 (+    66us) write_op.cc:312] APPLY: finished
0709 12:25:39.957859 (+   298us) log.cc:844] Serialized 46 byte log entry
0709 12:25:39.958058 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:39.958202 (+   144us) write_op.cc:454] Released schema lock
0709 12:25:39.958258 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:39.958632 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:39.958656 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5052,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2268,"apply.run_cpu_time_us":2342,"apply.run_wall_time_us":2342,"num_ops":5,"prepare.queue_time_us":73483,"prepare.run_cpu_time_us":3024,"prepare.run_wall_time_us":18068,"replication_time_us":4654,"spinlock_wait_cycles":8464768,"thread_start_us":20839,"threads_started":1}]]}
I20260709 12:25:40.009039  7722 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.009702  7722 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:40.015013  6955 consensus_peers.cc:597] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.018471  7687 raft_consensus.cc:2749] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:40.021379  7804 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.022365  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:40.023559  7722 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
W20260709 12:25:40.035909  6955 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.040980  7062 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 2.
I20260709 12:25:40.040859  7804 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.042408  6956 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.043540  7724 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:40.054417  7724 raft_consensus.cc:493] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.055042  7724 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.057415  7807 raft_consensus.cc:2749] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:40.057518  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
I20260709 12:25:40.058197  7807 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.058719  7807 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.060765  7807 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:40.061909  7804 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:40.063767  6910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:40.064716  6989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" is_pre_election: true
W20260709 12:25:40.073539  7032 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 92955.4us
W20260709 12:25:40.084465  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 103880us
I20260709 12:25:40.086839  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" is_pre_election: true
I20260709 12:25:40.093250  7676 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc
I20260709 12:25:40.094136  7804 raft_consensus.cc:2749] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:40.101666  7677 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, d183b7afc3164213b30cb81edcc90c7d
I20260709 12:25:40.102983  7804 raft_consensus.cc:2749] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:40.089131  7792 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.127439  7792 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:40.134200  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 45792.1us
I20260709 12:25:40.168905  7792 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:40.172220  7724 raft_consensus.cc:515] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:40.178843  7030 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.183020  7682 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.184162  7682 tablet_bootstrap.cc:492] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.184927  7682 ts_tablet_manager.cc:1403] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.245s	user 0.019s	sys 0.006s
I20260709 12:25:40.191422  7062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "957994df5dd14b04a9ac6f7b24bd13dd" candidate_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:40.192112  7062 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:40.204444  6955 leader_election.cc:336] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.214504  7062 raft_consensus.cc:2468] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb7ff7a37ff47f4a040d570caed46d8 in term 3.
I20260709 12:25:40.216869  7724 leader_election.cc:290] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:40.217561  6956 leader_election.cc:304] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.221730  6910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:40.225709  7722 raft_consensus.cc:2804] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:40.228127  7722 raft_consensus.cc:697] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Becoming Leader. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
W20260709 12:25:40.230103  6881 consensus_peers.cc:597] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.230813  7722 consensus_queue.cc:237] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.222491  6910 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:40.241775  7682 raft_consensus.cc:359] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.245621  7032 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.248831  7796 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:40.249404  7796 raft_consensus.cc:493] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.249802  7796 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.259186  6738 catalog_manager.cc:5697] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 reported cstate change: term changed from 1 to 3, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.287884  7796 raft_consensus.cc:515] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.289840  7682 raft_consensus.cc:740] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.308877  7682 consensus_queue.cc:260] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.311661  7682 ts_tablet_manager.cc:1434] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.000s
I20260709 12:25:40.312521  7682 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:40.320150  7030 leader_election.cc:336] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.323089  7796 leader_election.cc:290] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:40.331023  6881 consensus_peers.cc:597] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.331964  7796 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.339129  7796 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.341418  7796 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:40.351209  7030 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.360399  6910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c924f3222be749da91d981faff44dc5e" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:40.361045  6910 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.365475  7682 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.366470  7682 tablet_bootstrap.cc:492] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.367070  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d" is_pre_election: true
I20260709 12:25:40.367765  6912 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 2.
I20260709 12:25:40.373816  6910 raft_consensus.cc:2468] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 3.
I20260709 12:25:40.367106  7682 ts_tablet_manager.cc:1403] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.004s
I20260709 12:25:40.378247  7682 raft_consensus.cc:359] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.378986  7682 raft_consensus.cc:740] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.381474  7682 consensus_queue.cc:260] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.383809  7682 ts_tablet_manager.cc:1434] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:40.384627  7682 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:40.386696  6881 consensus_peers.cc:597] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:40.389047  6881 consensus_peers.cc:597] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.390102  7032 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.391239  7796 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:40.391614  7796 raft_consensus.cc:493] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.391952  7796 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.400950  7032 leader_election.cc:304] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.402580  7681 raft_consensus.cc:2804] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:40.403100  7681 raft_consensus.cc:697] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:40.403940  7681 consensus_queue.cc:237] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
W20260709 12:25:40.414074  6881 consensus_peers.cc:597] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:40.414870  6881 consensus_peers.cc:597] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:40.415488  6881 consensus_peers.cc:597] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.412920  7796 raft_consensus.cc:515] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.419848  7796 leader_election.cc:290] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: Requested vote from peers 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
W20260709 12:25:40.425143  7030 leader_election.cc:336] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:40.437412  6910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2250baee2f594167a763ebb190c6ef85" candidate_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:40.438230  6910 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.443358  7682 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.444406  7682 tablet_bootstrap.cc:492] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.453563  6910 raft_consensus.cc:2468] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735ce7f4a3244c7d877ce5feb5fb4ffc in term 3.
I20260709 12:25:40.455101  7682 ts_tablet_manager.cc:1403] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.000s
I20260709 12:25:40.455847  7032 leader_election.cc:304] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, d183b7afc3164213b30cb81edcc90c7d; no voters: 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:40.457566  7681 raft_consensus.cc:2804] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:40.458055  7681 raft_consensus.cc:697] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 LEADER]: Becoming Leader. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:40.458845  7681 consensus_queue.cc:237] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.459316  7682 raft_consensus.cc:359] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.466017  7682 raft_consensus.cc:740] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.467226  6736 catalog_manager.cc:5697] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 3, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 3 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.475016  7682 consensus_queue.cc:260] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.481820  7682 ts_tablet_manager.cc:1434] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:25:40.482708  7682 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.502797  6736 catalog_manager.cc:5697] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc reported cstate change: term changed from 1 to 3, leader changed from 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193) to 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196). New cstate: current_term: 3 leader_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.520681 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:39751
I20260709 12:25:40.521073  7885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:39751 every 8 connection(s)
I20260709 12:25:40.524817  7682 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.525848  7682 tablet_bootstrap.cc:492] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.526496  7682 ts_tablet_manager.cc:1403] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.004s
I20260709 12:25:40.532255  7682 raft_consensus.cc:359] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.533015  7682 raft_consensus.cc:740] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.533871  7682 consensus_queue.cc:260] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.536221  7682 ts_tablet_manager.cc:1434] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:25:40.537155  7682 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.579751  7682 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.580818  7682 tablet_bootstrap.cc:492] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.581471  7682 ts_tablet_manager.cc:1403] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.004s
I20260709 12:25:40.584949  7682 raft_consensus.cc:359] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.585680  7682 raft_consensus.cc:740] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.586520  7682 consensus_queue.cc:260] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.591737  7682 ts_tablet_manager.cc:1434] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:25:40.592553  7682 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.596109  7887 heartbeater.cc:344] Connected to a master server at 127.29.143.254:44241
I20260709 12:25:40.596717  7887 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:40.598875  7887 heartbeater.cc:507] Master 127.29.143.254:44241 requested a full tablet report, sending...
I20260709 12:25:40.632426  7682 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.633426  7682 tablet_bootstrap.cc:492] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.634377  7682 ts_tablet_manager.cc:1403] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.018s
I20260709 12:25:40.637079  7819 raft_consensus.cc:3060] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.637171  7682 raft_consensus.cc:359] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.638015  7682 raft_consensus.cc:740] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.638810  7682 consensus_queue.cc:260] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.641026  7682 ts_tablet_manager.cc:1434] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:40.641947  7682 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.668635  6736 ts_manager.cc:194] Re-registered known tserver with Master: 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:40.670126  7682 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.671195  7682 tablet_bootstrap.cc:492] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.672094  7682 ts_tablet_manager.cc:1403] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.008s
I20260709 12:25:40.689540  7819 raft_consensus.cc:3060] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:40.703680  6881 consensus_peers.cc:597] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:40.705250  7682 raft_consensus.cc:359] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.707753  7682 raft_consensus.cc:740] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.709913  7682 consensus_queue.cc:260] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.716463  7682 ts_tablet_manager.cc:1434] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:25:40.717357  7682 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.737197  7825 raft_consensus.cc:3060] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.762984  7825 raft_consensus.cc:1275] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:40.765151  7535 consensus_queue.cc:1048] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.766206  7682 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.767218  7682 tablet_bootstrap.cc:492] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.768154  7682 ts_tablet_manager.cc:1403] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.009s
I20260709 12:25:40.770875  7682 raft_consensus.cc:359] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.771589  7682 raft_consensus.cc:740] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.772388  7682 consensus_queue.cc:260] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.774792  7682 ts_tablet_manager.cc:1434] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:40.775633  7682 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.788738  7820 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.800724  7682 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.801836  7682 tablet_bootstrap.cc:492] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.802466  7682 ts_tablet_manager.cc:1403] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.000s
I20260709 12:25:40.805244  7682 raft_consensus.cc:359] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.805979  7682 raft_consensus.cc:740] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.807125  7682 consensus_queue.cc:260] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.809791  7682 ts_tablet_manager.cc:1434] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:40.810727  7682 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.824831  7062 raft_consensus.cc:1275] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 5eb7ff7a37ff47f4a040d570caed46d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:40.829612  7724 consensus_queue.cc:1048] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.837272  6736 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48422
I20260709 12:25:40.836387  7825 raft_consensus.cc:3060] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.882321  7821 raft_consensus.cc:3060] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.887741  7682 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.894987  7682 tablet_bootstrap.cc:492] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.895745  7682 ts_tablet_manager.cc:1403] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.009s
I20260709 12:25:40.897262  7887 heartbeater.cc:499] Master 127.29.143.254:44241 was elected leader, sending a full tablet report...
I20260709 12:25:40.888525  7824 raft_consensus.cc:3060] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.899907  7821 raft_consensus.cc:1275] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:40.907766  7824 raft_consensus.cc:1275] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:40.909008  7682 raft_consensus.cc:359] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.909703  7682 raft_consensus.cc:740] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.910355  7682 consensus_queue.cc:260] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:40.911767  7796 consensus_queue.cc:1048] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.912624  7682 ts_tablet_manager.cc:1434] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:40.913149  7796 consensus_queue.cc:1048] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:40.915815  7682 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.948661  7682 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.949837  7682 tablet_bootstrap.cc:492] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.950865  7682 ts_tablet_manager.cc:1403] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.006s
I20260709 12:25:40.954608  7682 raft_consensus.cc:359] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.955367  7682 raft_consensus.cc:740] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.956178  7682 consensus_queue.cc:260] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:40.959251  7682 ts_tablet_manager.cc:1434] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:40.960383  7682 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:40.974167  6916 raft_consensus.cc:1275] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:40.976671  7681 consensus_queue.cc:1048] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.981669  7825 raft_consensus.cc:3060] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:40.982748  7682 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:40.983669  7682 tablet_bootstrap.cc:492] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:40.984333  7682 ts_tablet_manager.cc:1403] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:25:40.987318  7682 raft_consensus.cc:359] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.988353  7682 raft_consensus.cc:740] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.989189  7682 consensus_queue.cc:260] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:40.991552  7682 ts_tablet_manager.cc:1434] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:25:40.992367  7682 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.016919  6916 raft_consensus.cc:1275] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 735ce7f4a3244c7d877ce5feb5fb4ffc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:41.017077  7682 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.018491  7682 tablet_bootstrap.cc:492] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.019229  7682 ts_tablet_manager.cc:1403] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 12:25:41.022265  7682 raft_consensus.cc:359] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.022927  7682 raft_consensus.cc:740] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.023698  7682 consensus_queue.cc:260] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.025780  7682 ts_tablet_manager.cc:1434] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:41.026548  7682 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:41.030519  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 51416.6us
I20260709 12:25:41.059984  7918 consensus_queue.cc:1048] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.065485  7682 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.071802  7682 tablet_bootstrap.cc:492] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.072548  7682 ts_tablet_manager.cc:1403] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.011s
I20260709 12:25:41.075482  7682 raft_consensus.cc:359] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.076262  7682 raft_consensus.cc:740] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.077556  7682 consensus_queue.cc:260] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.080003  7682 ts_tablet_manager.cc:1434] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:41.080886  7682 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.153591  7820 raft_consensus.cc:3060] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.170352  7682 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.171538  7682 tablet_bootstrap.cc:492] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.172217  7682 ts_tablet_manager.cc:1403] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.000s
I20260709 12:25:41.175058  7682 raft_consensus.cc:359] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:41.175868  7682 raft_consensus.cc:740] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.176806  7682 consensus_queue.cc:260] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:41.179430  7682 ts_tablet_manager.cc:1434] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:41.180343  7682 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.202814  7682 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.203800  7682 tablet_bootstrap.cc:492] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.204664  7682 ts_tablet_manager.cc:1403] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 12:25:41.211444  7682 raft_consensus.cc:359] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.212214  7682 raft_consensus.cc:740] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.212262  7821 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.213111  7682 consensus_queue.cc:260] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.216765  7682 ts_tablet_manager.cc:1434] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:41.217762  7682 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.245961  7682 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.247107  7682 tablet_bootstrap.cc:492] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.247916  7682 ts_tablet_manager.cc:1403] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.007s
I20260709 12:25:41.330853  7682 raft_consensus.cc:359] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:41.332805  7682 raft_consensus.cc:740] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.354100  7682 consensus_queue.cc:260] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
W20260709 12:25:41.372201  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 103399us
W20260709 12:25:41.385644  6955 consensus_peers.cc:597] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:41.401993  7819 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.404546  7682 ts_tablet_manager.cc:1434] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.008s
I20260709 12:25:41.406618  7682 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
W20260709 12:25:41.458794  6881 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 100548us
I20260709 12:25:41.595803  7818 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.604764  7821 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:41.617167  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:41.654917  6955 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 127635us
I20260709 12:25:41.680613  7824 raft_consensus.cc:3060] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.762758  7789 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:41.790421  6881 consensus_peers.cc:597] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:41.803603  7682 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.812433  7682 tablet_bootstrap.cc:492] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.813201  7682 ts_tablet_manager.cc:1403] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.407s	user 0.018s	sys 0.022s
I20260709 12:25:41.839810  7682 raft_consensus.cc:359] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.840907  7682 raft_consensus.cc:740] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.853328  7682 consensus_queue.cc:260] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:41.856146  7682 ts_tablet_manager.cc:1434] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 12:25:41.857319  7682 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.899829  7682 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.905417  7682 tablet_bootstrap.cc:492] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.906132  7682 ts_tablet_manager.cc:1403] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.018s
I20260709 12:25:41.908807  7682 raft_consensus.cc:359] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:41.909708  7682 raft_consensus.cc:740] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.910405  7682 consensus_queue.cc:260] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:41.912503  7682 ts_tablet_manager.cc:1434] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:25:41.913331  7682 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:41.936532  7682 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:41.937525  7682 tablet_bootstrap.cc:492] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:41.938205  7682 ts_tablet_manager.cc:1403] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:25:41.940896  7682 raft_consensus.cc:359] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:41.941633  7682 raft_consensus.cc:740] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.942304  7682 consensus_queue.cc:260] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:41.944804  7682 ts_tablet_manager.cc:1434] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:25:41.946286  7682 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:42.042179  7682 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:42.043220  7682 tablet_bootstrap.cc:492] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:42.044531  7682 ts_tablet_manager.cc:1403] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.037s
I20260709 12:25:42.048377  7682 raft_consensus.cc:359] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.049230  7682 raft_consensus.cc:740] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.050060  7682 consensus_queue.cc:260] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.053481  7682 ts_tablet_manager.cc:1434] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:42.054659  7682 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:42.061177  7789 raft_consensus.cc:3060] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:42.092109  7682 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:42.093065  7682 tablet_bootstrap.cc:492] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:42.093713  7682 ts_tablet_manager.cc:1403] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.018s
I20260709 12:25:42.096311  7682 raft_consensus.cc:359] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.098711  7682 raft_consensus.cc:740] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.100521  7682 consensus_queue.cc:260] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.102854  7682 ts_tablet_manager.cc:1434] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:25:42.103725  7682 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:42.142542  7682 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:42.143610  7682 tablet_bootstrap.cc:492] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:42.144284  7682 ts_tablet_manager.cc:1403] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.008s
I20260709 12:25:42.147838  7682 raft_consensus.cc:359] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:42.148553  7682 raft_consensus.cc:740] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.149369  7682 consensus_queue.cc:260] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:42.151934  7682 ts_tablet_manager.cc:1434] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:42.152851  7682 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap starting.
I20260709 12:25:42.176550  7682 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:42.177531  7682 tablet_bootstrap.cc:492] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Bootstrap complete.
I20260709 12:25:42.178198  7682 ts_tablet_manager.cc:1403] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 12:25:42.181541  7682 raft_consensus.cc:359] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.182310  7682 raft_consensus.cc:740] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.183106  7682 consensus_queue.cc:260] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:42.185592  7682 ts_tablet_manager.cc:1434] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:25:42.209687  7818 raft_consensus.cc:3060] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:42.465091  7789 raft_consensus.cc:3060] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:44.387305  6956 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.196:39137, user_credentials={real_user=slave}} blocked reactor thread for 118119us
W20260709 12:25:44.398162  6957 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 190440us
W20260709 12:25:45.051805  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1ac0 after lost signal to thread 30274
W20260709 12:25:45.052970  7088 debug-util.cc:398] Leaking SignalData structure 0x7b0800255e00 after lost signal to thread 6774
W20260709 12:25:45.054183  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9920 after lost signal to thread 6942
W20260709 12:25:45.055277  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08002090c0 after lost signal to thread 7017
W20260709 12:25:45.056322  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08000946a0 after lost signal to thread 7091
W20260709 12:25:45.057557  7088 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3be0 after lost signal to thread 7885
W20260709 12:25:45.460332  7881 debug-util.cc:398] Leaking SignalData structure 0x7b0800342a00 after lost signal to thread 30274
W20260709 12:25:45.461324  7881 debug-util.cc:398] Leaking SignalData structure 0x7b08003504a0 after lost signal to thread 6774
W20260709 12:25:45.462374  7881 debug-util.cc:398] Leaking SignalData structure 0x7b08003882e0 after lost signal to thread 6942
W20260709 12:25:45.463289  7881 debug-util.cc:398] Leaking SignalData structure 0x7b0800281d20 after lost signal to thread 7017
W20260709 12:25:45.464188  7881 debug-util.cc:398] Leaking SignalData structure 0x7b0800384500 after lost signal to thread 7091
W20260709 12:25:45.465355  7881 debug-util.cc:398] Leaking SignalData structure 0x7b080004b2c0 after lost signal to thread 7885
I20260709 12:25:50.801251 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.861109  6990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:50.861804  6990 raft_consensus.cc:606] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.864313  6991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:50.864856  6991 raft_consensus.cc:606] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.867597  6991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c661acabb704e839938f81b5474853d"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:50.868093  6991 raft_consensus.cc:606] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.870594  6991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:50.871016  6991 raft_consensus.cc:606] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.873015  6991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "712a0e1312454258ae9e75b931463c73"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:50.873502  6991 raft_consensus.cc:606] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.885975  7067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b"
dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:49050
I20260709 12:25:50.886642  7067 raft_consensus.cc:606] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.902673  6915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453"
dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:25:50.903256  6915 raft_consensus.cc:606] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:50.904410 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:25:50.905879 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:50.906642 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.007244  7981 raft_consensus.cc:993] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.007853  7993 raft_consensus.cc:1081] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.009243  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c661acabb704e839938f81b5474853d"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:51.009779  7821 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.010188  7821 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.016403  7821 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.019302  7821 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:51.019893  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:51.019830  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c661acabb704e839938f81b5474853d" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.020650  7067 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.021044  6990 raft_consensus.cc:3055] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:51.021396  6990 raft_consensus.cc:740] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:51.022192  6990 consensus_queue.cc:260] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.023151  6990 raft_consensus.cc:3060] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.025924  7067 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.027196  7676 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:51.028713  6990 raft_consensus.cc:2468] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.029158  8005 raft_consensus.cc:2804] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:51.030469  8005 raft_consensus.cc:697] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.031433  8005 consensus_queue.cc:237] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.044368  6735 catalog_manager.cc:5697] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.075345  7993 raft_consensus.cc:993] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.075816  7993 raft_consensus.cc:1081] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.077276  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "712a0e1312454258ae9e75b931463c73"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:51.077976  7821 raft_consensus.cc:493] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.078619  7821 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:51.085846  7821 raft_consensus.cc:515] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.087857  7821 leader_election.cc:290] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:51.089473  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.089570  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712a0e1312454258ae9e75b931463c73" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:51.090042  6990 raft_consensus.cc:3055] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:51.090087  6915 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:51.090457  6990 raft_consensus.cc:740] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:51.091295  6990 consensus_queue.cc:260] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.092478  6990 raft_consensus.cc:3060] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:51.097507  6915 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 4.
I20260709 12:25:51.098975  7677 leader_election.cc:304] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:51.099133  6990 raft_consensus.cc:2468] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 4.
I20260709 12:25:51.100059  8005 raft_consensus.cc:2804] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:51.100471  8005 raft_consensus.cc:697] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.101177  8005 consensus_queue.cc:237] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.112061  6735 catalog_manager.cc:5697] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 3 to 4, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.119244  7995 raft_consensus.cc:993] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.121600  7995 raft_consensus.cc:1081] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.123337  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57198
I20260709 12:25:51.124219  7821 raft_consensus.cc:493] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.124647  7821 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.131336  7821 raft_consensus.cc:515] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.132922  7821 leader_election.cc:290] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:51.133536  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:51.133875  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1d3eff0cf142feb6edf343c482e453" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.134183  6915 raft_consensus.cc:3055] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.134480  6990 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.134521  6915 raft_consensus.cc:740] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:51.135434  6915 consensus_queue.cc:260] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.136396  6915 raft_consensus.cc:3060] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.139480  6990 raft_consensus.cc:2468] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.140641  7675 leader_election.cc:304] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:51.140802  6915 raft_consensus.cc:2468] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.141279  8005 raft_consensus.cc:2804] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.141765  8005 raft_consensus.cc:697] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.142611  8005 consensus_queue.cc:237] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.152467  6735 catalog_manager.cc:5697] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from d183b7afc3164213b30cb81edcc90c7d (127.29.143.194) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.211814  7993 raft_consensus.cc:993] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.212340  7993 raft_consensus.cc:1081] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.213773  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:51.214365  7821 raft_consensus.cc:493] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.214736  7821 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.219718  7821 raft_consensus.cc:515] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.221412  7821 leader_election.cc:290] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:51.222292  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:51.222712  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6dcc5bfa4141c08fdff7d85ee1bea5" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.222883  6915 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.223345  6990 raft_consensus.cc:3055] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:51.223709  6990 raft_consensus.cc:740] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:51.224607  6990 consensus_queue.cc:260] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.225899  6990 raft_consensus.cc:3060] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.227909  7991 raft_consensus.cc:993] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.228561  8000 raft_consensus.cc:1081] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.229312  6915 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.230343  7677 leader_election.cc:304] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:51.230372  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:25:51.231043  7821 raft_consensus.cc:493] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.231163  8005 raft_consensus.cc:2804] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:51.231455  7821 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.231740  8005 raft_consensus.cc:697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.232625  8005 consensus_queue.cc:237] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.234597  6990 raft_consensus.cc:2468] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.238226  7821 raft_consensus.cc:515] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:51.240278  7821 leader_election.cc:290] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:51.241138  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:51.241684  7067 raft_consensus.cc:3055] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.241946  7067 raft_consensus.cc:740] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:51.242738  7067 consensus_queue.cc:260] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:51.244237  7067 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.246634  7993 raft_consensus.cc:993] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.249624  6915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bbe8b6f63694ab0af9a366a0096ef0b" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:51.250214  6915 raft_consensus.cc:3060] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.252060  6735 catalog_manager.cc:5697] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.253540  7981 raft_consensus.cc:1081] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.255270  7067 raft_consensus.cc:2468] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.256295  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:51.256560  7676 leader_election.cc:304] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:51.256843  7821 raft_consensus.cc:493] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.257158  6915 raft_consensus.cc:2468] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.257477  8005 raft_consensus.cc:2804] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.257191  7821 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.258307  8005 raft_consensus.cc:697] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.260028  8005 consensus_queue.cc:237] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:51.265712  7821 raft_consensus.cc:515] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.268652  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.268784  6912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1e963d9d640e3b4179db45fd20492" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:51.269205  6990 raft_consensus.cc:3055] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:51.269316  6912 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.269547  6990 raft_consensus.cc:740] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:51.270426  6990 consensus_queue.cc:260] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.271543  6990 raft_consensus.cc:3060] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:51.274787  7821 leader_election.cc:290] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:51.274127  6735 catalog_manager.cc:5697] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.276746  6990 raft_consensus.cc:2468] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.277297  6912 raft_consensus.cc:2468] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:51.279870  7675 leader_election.cc:304] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:51.280711  8005 raft_consensus.cc:2804] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:51.281260  8005 raft_consensus.cc:697] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.282176  8005 consensus_queue.cc:237] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:51.295389  6735 catalog_manager.cc:5697] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.347635  8016 raft_consensus.cc:993] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.348286  8016 raft_consensus.cc:1081] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:51.349982  7820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:51.350562  7820 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.350914  7820 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.358460  7820 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.360486  7820 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:51.362877  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:51.363572  7066 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.364744  6990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae7f3dde5214382bea50b9b700d4ced" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:51.365341  6990 raft_consensus.cc:3055] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:51.365644  6990 raft_consensus.cc:740] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:51.366364  6990 consensus_queue.cc:260] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.367468  6990 raft_consensus.cc:3060] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:51.371264  7066 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.372548  7676 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:51.373427  8005 raft_consensus.cc:2804] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:51.374116  8005 raft_consensus.cc:697] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:51.375049  8005 consensus_queue.cc:237] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:51.377116  6990 raft_consensus.cc:2468] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:51.421572  6735 catalog_manager.cc:5697] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:51.447680  6990 raft_consensus.cc:1275] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.451496  8005 consensus_queue.cc:1048] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.540297  6912 raft_consensus.cc:1275] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 4 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:51.541908  8005 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.548332  6991 raft_consensus.cc:1275] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.550354  8006 consensus_queue.cc:1048] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.636579  6991 raft_consensus.cc:1275] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:51.638912  7066 raft_consensus.cc:1275] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.645295  8033 consensus_queue.cc:1048] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.647229  8034 consensus_queue.cc:1048] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:25:51.652717  7677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:39331, user_credentials={real_user=slave}} blocked reactor thread for 55146us
I20260709 12:25:51.657591  6991 raft_consensus.cc:1275] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.658197  6912 raft_consensus.cc:1275] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.659499  8030 consensus_queue.cc:1048] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.660379  8034 consensus_queue.cc:1048] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.681869  6990 raft_consensus.cc:1275] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.699513  8024 consensus_queue.cc:1048] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.744773  6912 raft_consensus.cc:1275] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.746512  8035 consensus_queue.cc:1048] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.752875  6915 raft_consensus.cc:1275] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.754539  8031 consensus_queue.cc:1048] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.799126  7059 raft_consensus.cc:1275] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.800758  8005 consensus_queue.cc:1048] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:51.856305  6987 raft_consensus.cc:1275] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.928911  6913 raft_consensus.cc:1275] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:51.929246  8036 consensus_queue.cc:1048] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:51.950309 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.956022  7059 raft_consensus.cc:1275] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:51.958020  8036 consensus_queue.cc:1048] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:51.982940  7030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:40793, user_credentials={real_user=slave}} blocked reactor thread for 45869.4us
I20260709 12:25:52.003500  8005 consensus_queue.cc:1048] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:52.081035  6987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821"
dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:25:52.081672  6987 raft_consensus.cc:606] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:52.085047  6911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4474482b286401ba6a66908093c0af1"
dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:25:52.085696  6911 raft_consensus.cc:606] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:52.091909  7059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49"
dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:49050
I20260709 12:25:52.092450  7059 raft_consensus.cc:606] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:52.095081  7059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd"
dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:49050
I20260709 12:25:52.095638  7059 raft_consensus.cc:606] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:52.098039  7059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353"
dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:49050
I20260709 12:25:52.098587  7059 raft_consensus.cc:606] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:52.099905 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:52.101310 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.101969 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.369963  7991 raft_consensus.cc:993] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.370455  8049 raft_consensus.cc:1081] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.372225  7814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:25:52.372792  7814 raft_consensus.cc:493] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.373118  7814 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:52.379524  7814 raft_consensus.cc:515] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.381238  7814 leader_election.cc:290] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:52.382153  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:52.382306  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee8d38cdcf420886d30dfc614d2dcd" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:52.382993  7067 raft_consensus.cc:3055] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:52.383085  6913 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:52.383270  7067 raft_consensus.cc:740] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:52.384119  7067 consensus_queue.cc:260] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.385078  7067 raft_consensus.cc:3060] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:52.389628  7991 raft_consensus.cc:993] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.389475  6913 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:52.390091  8052 raft_consensus.cc:1081] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.391251  7677 leader_election.cc:304] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e8bb7cfca34631a0d9c45d8b139301, d183b7afc3164213b30cb81edcc90c7d; no voters: 
I20260709 12:25:52.391791  7814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:25:52.392055  8005 raft_consensus.cc:2804] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:52.392349  7814 raft_consensus.cc:493] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.392630  8005 raft_consensus.cc:697] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:52.392807  7814 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.392849  7067 raft_consensus.cc:2468] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:52.394434  8005 consensus_queue.cc:237] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.400642  7814 raft_consensus.cc:515] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.402275  7814 leader_election.cc:290] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:52.403160  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:52.403647  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34b89b5da1b4f08a98b364573d20b49" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:52.403753  7067 raft_consensus.cc:3055] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:52.404155  6913 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.404129  7067 raft_consensus.cc:740] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:52.405229  7067 consensus_queue.cc:260] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.406351  7067 raft_consensus.cc:3060] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.408437  6736 catalog_manager.cc:5697] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.414925  7067 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.416713  7676 leader_election.cc:304] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:52.417019  7995 raft_consensus.cc:993] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.417594  7995 raft_consensus.cc:1081] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.417766  8005 raft_consensus.cc:2804] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:52.418339  8005 raft_consensus.cc:697] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:52.419389  7814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4474482b286401ba6a66908093c0af1"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57198
I20260709 12:25:52.420341  7814 raft_consensus.cc:493] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.419613  8005 consensus_queue.cc:237] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.419389  6913 raft_consensus.cc:2468] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.420876  7814 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.429849  7814 raft_consensus.cc:515] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.432374  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:52.432929  7067 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.435318  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4474482b286401ba6a66908093c0af1" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:52.435915  6913 raft_consensus.cc:3055] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:52.436203  6913 raft_consensus.cc:740] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:52.436990  6913 consensus_queue.cc:260] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.438060  6913 raft_consensus.cc:3060] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.439658  7067 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.440925  7676 leader_election.cc:304] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:52.441740  8005 raft_consensus.cc:2804] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:52.442198  8005 raft_consensus.cc:697] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:52.443092  8005 consensus_queue.cc:237] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.444134  7991 raft_consensus.cc:993] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.444257  7814 leader_election.cc:290] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:52.444681  7991 raft_consensus.cc:1081] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.444435  6736 catalog_manager.cc:5697] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.446377  7820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57188
I20260709 12:25:52.446918  7820 raft_consensus.cc:493] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.447276  7820 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.451859  6913 raft_consensus.cc:2468] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.464983  8023 raft_consensus.cc:993] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.465677  8023 raft_consensus.cc:1081] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:52.465337  7820 raft_consensus.cc:515] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.468415  7789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57194
I20260709 12:25:52.469045  7820 leader_election.cc:290] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:52.469056  7789 raft_consensus.cc:493] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:52.469647  7067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:52.469949  7789 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:52.470219  7067 raft_consensus.cc:3055] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:52.470569  7067 raft_consensus.cc:740] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 735ce7f4a3244c7d877ce5feb5fb4ffc, State: Running, Role: LEADER
I20260709 12:25:52.471359  7067 consensus_queue.cc:260] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.472522  7067 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.476397  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1944db928834f84aa29c6a0b169c353" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:52.477409  6913 raft_consensus.cc:3060] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:52.481094  7067 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.482529  7676 leader_election.cc:304] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:52.483950  8006 raft_consensus.cc:2804] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:52.484439  8006 raft_consensus.cc:697] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:52.485348  8006 consensus_queue.cc:237] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:52.492031  6736 catalog_manager.cc:5697] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from d183b7afc3164213b30cb81edcc90c7d (127.29.143.194) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.494817  7789 raft_consensus.cc:515] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:52.499833  7789 leader_election.cc:290] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 election: Requested vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137)
I20260709 12:25:52.500653  6987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:52.500981  7059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e59c66e8424098a23bcccb441ed821" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:52.503729  6987 raft_consensus.cc:3055] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:52.503785  7059 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:52.504279  6987 raft_consensus.cc:740] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5eb7ff7a37ff47f4a040d570caed46d8, State: Running, Role: LEADER
I20260709 12:25:52.505249  6987 consensus_queue.cc:260] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:52.505832  6913 raft_consensus.cc:2468] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 3.
I20260709 12:25:52.506719  6987 raft_consensus.cc:3060] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:52.513775  7059 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 4.
I20260709 12:25:52.514418  6987 raft_consensus.cc:2468] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 4.
I20260709 12:25:52.515206  7676 leader_election.cc:304] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:52.516644  8006 raft_consensus.cc:2804] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:52.517103  8006 raft_consensus.cc:697] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:52.518055  8006 consensus_queue.cc:237] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:52.518400  6736 catalog_manager.cc:5697] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 2 to 3, leader changed from 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 3 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.535348  6736 catalog_manager.cc:5697] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 3 to 4, leader changed from 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 4 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.864373  6913 raft_consensus.cc:1275] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.865577  8036 consensus_queue.cc:1048] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.868841  7067 raft_consensus.cc:1275] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.870635  8036 consensus_queue.cc:1048] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:52.888782  7067 raft_consensus.cc:1275] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.891112  8036 consensus_queue.cc:1048] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.893101  6913 raft_consensus.cc:1275] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.895592  8006 consensus_queue.cc:1048] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.916082  7066 raft_consensus.cc:1275] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.918470  8036 consensus_queue.cc:1048] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.931043  6913 raft_consensus.cc:1275] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:52.932507  8036 consensus_queue.cc:1048] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.938556  7066 raft_consensus.cc:1275] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:52.941808  8005 consensus_queue.cc:1048] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:52.959685  6913 raft_consensus.cc:1275] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:52.961575  8006 consensus_queue.cc:1048] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.110219  6991 raft_consensus.cc:1275] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:53.110847  7066 raft_consensus.cc:1275] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 4 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:53.111748  8005 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:53.112633  8036 consensus_queue.cc:1048] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:53.143448 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.200402  6913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33"
dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:25:53.200955  6913 raft_consensus.cc:606] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:53.203557  6913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545"
dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
mode: GRACEFUL
new_leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:25:53.204062  6913 raft_consensus.cc:606] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Received request to transfer leadership to TS 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:53.205153 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:53.206396 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:53.206967 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.338101  8080 raft_consensus.cc:993] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:53.338696  8013 raft_consensus.cc:1081] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:53.340396  7821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57198
I20260709 12:25:53.340916  7821 raft_consensus.cc:493] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.341148  7821 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.347647  7821 raft_consensus.cc:515] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:53.349892  7821 leader_election.cc:290] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers 735ce7f4a3244c7d877ce5feb5fb4ffc (127.29.143.196:39137), d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331)
I20260709 12:25:53.350167  7066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc"
I20260709 12:25:53.350939  7066 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.351388  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca85df8d7a44f0a828ea763c94db545" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:53.352015  6913 raft_consensus.cc:3055] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:53.352312  6913 raft_consensus.cc:740] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:53.352910  6913 consensus_queue.cc:260] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:53.353798  6913 raft_consensus.cc:3060] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.357475  7066 raft_consensus.cc:2468] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:53.358659  7676 leader_election.cc:304] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:53.359295  6913 raft_consensus.cc:2468] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:53.359545  8006 raft_consensus.cc:2804] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:53.360092  8006 raft_consensus.cc:697] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:53.360987  8006 consensus_queue.cc:237] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } }
I20260709 12:25:53.375095  6736 catalog_manager.cc:5697] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from d183b7afc3164213b30cb81edcc90c7d (127.29.143.194) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.769490  8013 raft_consensus.cc:993] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: : Instructing follower 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:53.770124  7995 raft_consensus.cc:1081] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Signalling peer 91e8bb7cfca34631a0d9c45d8b139301 to start an election
I20260709 12:25:53.772153  7789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33"
dest_uuid: "91e8bb7cfca34631a0d9c45d8b139301"
 from {username='slave'} at 127.0.0.1:57198
I20260709 12:25:53.772716  7789 raft_consensus.cc:493] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:53.773138  7789 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.778333  7789 raft_consensus.cc:515] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:53.780095  7789 leader_election.cc:290] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Requested vote from peers d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331), 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793)
I20260709 12:25:53.780848  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d183b7afc3164213b30cb81edcc90c7d"
I20260709 12:25:53.781001  6991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75510e59268a4275bd685ff5b496ce33" candidate_uuid: "91e8bb7cfca34631a0d9c45d8b139301" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5eb7ff7a37ff47f4a040d570caed46d8"
I20260709 12:25:53.781582  6913 raft_consensus.cc:3055] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:53.781663  6991 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.781947  6913 raft_consensus.cc:740] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d183b7afc3164213b30cb81edcc90c7d, State: Running, Role: LEADER
I20260709 12:25:53.782733  6913 consensus_queue.cc:260] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:53.783946  6913 raft_consensus.cc:3060] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:53.789774  6991 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:53.790617  6913 raft_consensus.cc:2468] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91e8bb7cfca34631a0d9c45d8b139301 in term 2.
I20260709 12:25:53.791141  7675 leader_election.cc:304] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301; no voters: 
I20260709 12:25:53.791916  8036 raft_consensus.cc:2804] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:53.792436  8036 raft_consensus.cc:697] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Becoming Leader. State: Replica: 91e8bb7cfca34631a0d9c45d8b139301, State: Running, Role: LEADER
I20260709 12:25:53.793278  8036 consensus_queue.cc:237] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } }
I20260709 12:25:53.811445  6736 catalog_manager.cc:5697] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 reported cstate change: term changed from 1 to 2, leader changed from d183b7afc3164213b30cb81edcc90c7d (127.29.143.194) to 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "91e8bb7cfca34631a0d9c45d8b139301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.820587  7059 raft_consensus.cc:1275] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.822378  8036 consensus_queue.cc:1048] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.846822  6913 raft_consensus.cc:1275] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:53.849318  8085 consensus_queue.cc:1048] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.242237 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.282162 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:54.283506 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.284111 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.320467 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.344817  6911 raft_consensus.cc:1275] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:54.346998  8086 consensus_queue.cc:1048] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d183b7afc3164213b30cb81edcc90c7d" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.366547  6991 raft_consensus.cc:1275] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Refusing update from remote peer 91e8bb7cfca34631a0d9c45d8b139301: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:54.368477  8005 consensus_queue.cc:1048] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.393288 30271 tablet_server.cc:179] TabletServer@127.29.143.193:39751 shutting down...
W20260709 12:25:54.424587  7030 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 303 similar messages]
W20260709 12:25:54.428236  7030 consensus_peers.cc:597] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.437885  6955 consensus_peers.cc:597] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.445730 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:54.446769 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.447678 30271 raft_consensus.cc:2243] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.448160 30271 raft_consensus.cc:2272] T 939129fdb05c4c798051c85011070991 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.451081 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.451813 30271 raft_consensus.cc:2243] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.452262 30271 raft_consensus.cc:2272] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.454831 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.455511 30271 raft_consensus.cc:2243] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.456033 30271 raft_consensus.cc:2272] T d085654055944f75b6657bc46c50ffad P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.456568  7030 consensus_peers.cc:597] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.458338 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.459080 30271 raft_consensus.cc:2243] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.459510 30271 raft_consensus.cc:2272] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.461870 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.462612 30271 raft_consensus.cc:2243] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.463198 30271 raft_consensus.cc:2272] T 986ed6daa4ed4fdb805d9d5eef38b40b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.464926  6955 consensus_peers.cc:597] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.465749 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.466439 30271 raft_consensus.cc:2243] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.467214 30271 raft_consensus.cc:2272] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.469218 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.469765 30271 raft_consensus.cc:2243] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.470449 30271 raft_consensus.cc:2272] T 9c1d3eff0cf142feb6edf343c482e453 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.472383 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.472972 30271 raft_consensus.cc:2243] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.473366 30271 raft_consensus.cc:2272] T cd5451dbc9a6416781d842e1c7709a45 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.475450 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.476059 30271 raft_consensus.cc:2243] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.476486 30271 raft_consensus.cc:2272] T de46948cdeaa436392d55477ede3126c P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.478430 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.479107 30271 raft_consensus.cc:2243] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.479624 30271 raft_consensus.cc:2272] T 1ac83c19fd794ce0b286a09a261b6406 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.482436 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.483258 30271 raft_consensus.cc:2243] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.483688 30271 raft_consensus.cc:2272] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.486780 30271 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:54.486716  6881 consensus_peers.cc:597] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.487569  6881 consensus_peers.cc:597] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.487994 30271 raft_consensus.cc:2243] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.488440 30271 raft_consensus.cc:2272] T e330099c2e664276a6db9bfa41dd79e4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.490465 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.491030 30271 raft_consensus.cc:2243] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.491374 30271 raft_consensus.cc:2272] T 9448e5bc5adc4a0383825437ec1a466b P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.493377 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.493952 30271 raft_consensus.cc:2243] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.494616 30271 raft_consensus.cc:2272] T fca85df8d7a44f0a828ea763c94db545 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.497222 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.497987 30271 raft_consensus.cc:2243] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.498914 30271 raft_consensus.cc:2272] T 5c661acabb704e839938f81b5474853d P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.501261 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.501953 30271 raft_consensus.cc:2243] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.502929 30271 raft_consensus.cc:2272] T 4ae7f3dde5214382bea50b9b700d4ced P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.505084 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.505789 30271 raft_consensus.cc:2243] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.506621 30271 raft_consensus.cc:2272] T 712a0e1312454258ae9e75b931463c73 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.508486  6955 consensus_peers.cc:597] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.509246 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.509927 30271 raft_consensus.cc:2243] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.510444 30271 raft_consensus.cc:2272] T c924f3222be749da91d981faff44dc5e P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.513214 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.513976 30271 raft_consensus.cc:2243] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.514966 30271 raft_consensus.cc:2272] T 6bf1e963d9d640e3b4179db45fd20492 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.514856  6955 consensus_peers.cc:597] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.517783 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.518666 30271 raft_consensus.cc:2243] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.519311 30271 raft_consensus.cc:2272] T da57db9ef59345a2a1467f6952f3364d P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.521821  6955 consensus_peers.cc:597] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.522565 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.523423 30271 raft_consensus.cc:2243] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.523947 30271 raft_consensus.cc:2272] T 8c85168e3fee4b5682576a9098aebf37 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.526939 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.527683 30271 raft_consensus.cc:2243] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.528170 30271 raft_consensus.cc:2272] T 3a2750742f4f4dceab13f4552a75ff9f P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.530167 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.530812 30271 raft_consensus.cc:2243] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.531561 30271 raft_consensus.cc:2272] T d34b89b5da1b4f08a98b364573d20b49 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.533703 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.534292 30271 raft_consensus.cc:2243] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.534832 30271 raft_consensus.cc:2272] T 1bd28e008e3f4cc6b3a052fee4d4688c P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.537622 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.538414 30271 raft_consensus.cc:2243] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.538975 30271 raft_consensus.cc:2272] T dea4f98636ae4352bed12ff04f780dc5 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.539711  6881 consensus_peers.cc:597] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.541309 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.542088 30271 raft_consensus.cc:2243] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.542999 30271 raft_consensus.cc:2272] T b4474482b286401ba6a66908093c0af1 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.545615 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.546201 30271 raft_consensus.cc:2243] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.546610 30271 raft_consensus.cc:2272] T ef29f51530fd4a5e872b7df967e9aa9a P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.548761 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.549489 30271 raft_consensus.cc:2243] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.550101 30271 raft_consensus.cc:2272] T b5e75070838e424ca6c903634ffb3bf7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.553193 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.553821 30271 raft_consensus.cc:2243] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.554271 30271 raft_consensus.cc:2272] T 78ec6be90d254ce1874ea9379f54f53a P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.556488 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.557092 30271 raft_consensus.cc:2243] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.557475 30271 raft_consensus.cc:2272] T f43ba15ae68f4e60954a666740ae7ec7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.559413 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.559930 30271 raft_consensus.cc:2243] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.560400 30271 raft_consensus.cc:2272] T ed2255b163114a85a8a2aa5394891f9e P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.562258 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.562765 30271 raft_consensus.cc:2243] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.563520 30271 raft_consensus.cc:2272] T 83e59c66e8424098a23bcccb441ed821 P 91e8bb7cfca34631a0d9c45d8b139301 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.565593 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.566170 30271 raft_consensus.cc:2243] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.566952 30271 raft_consensus.cc:2272] T dfee8d38cdcf420886d30dfc614d2dcd P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.568981 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.570765 30271 raft_consensus.cc:2243] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.571265 30271 raft_consensus.cc:2272] T 9b534ea90b954a8aaa26488b181a5cd7 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.574393 30271 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:54.574620  7030 consensus_peers.cc:597] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.575163 30271 raft_consensus.cc:2243] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.575738 30271 raft_consensus.cc:2272] T aa2b22be3870440ea4db26e751648dbb P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.577662  7030 consensus_peers.cc:597] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.578387 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.579002 30271 raft_consensus.cc:2243] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.579428 30271 raft_consensus.cc:2272] T a9623b1b1de04219ac9d959598fc006c P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.581315 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.581816 30271 raft_consensus.cc:2243] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.582465 30271 raft_consensus.cc:2272] T e1944db928834f84aa29c6a0b169c353 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.584537 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.585001 30271 raft_consensus.cc:2243] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.585361 30271 raft_consensus.cc:2272] T 957994df5dd14b04a9ac6f7b24bd13dd P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.587353 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.587905 30271 raft_consensus.cc:2243] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.588330 30271 raft_consensus.cc:2272] T 2250baee2f594167a763ebb190c6ef85 P 91e8bb7cfca34631a0d9c45d8b139301 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.591249 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.591929 30271 raft_consensus.cc:2243] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.592460 30271 raft_consensus.cc:2272] T de6a6075ba174637ba0ca8a688bcaafe P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.595360 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.596160 30271 raft_consensus.cc:2243] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.596671 30271 raft_consensus.cc:2272] T ae235a7a1ddc48aaa37f8297a848f365 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.599515 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.600211 30271 raft_consensus.cc:2243] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.600729 30271 raft_consensus.cc:2272] T df5ab4fca4284754b2922f9348679d77 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.603554 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.604313 30271 raft_consensus.cc:2243] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:25:54.604723  6955 consensus_peers.cc:597] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.605229 30271 raft_consensus.cc:2272] T 7bbe8b6f63694ab0af9a366a0096ef0b P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.606799  6955 consensus_peers.cc:597] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.607761 30271 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:54.608052  6955 consensus_peers.cc:597] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.608399 30271 raft_consensus.cc:2243] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.608907 30271 raft_consensus.cc:2272] T e93f31c1947a442ab8d8329061c6f3d4 P 91e8bb7cfca34631a0d9c45d8b139301 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.611009 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:54.611538 30271 raft_consensus.cc:2243] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.612296 30271 raft_consensus.cc:2272] T 75510e59268a4275bd685ff5b496ce33 P 91e8bb7cfca34631a0d9c45d8b139301 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.646191  7030 consensus_peers.cc:597] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.647590  6955 consensus_peers.cc:597] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.657990  6881 consensus_peers.cc:597] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.701793  7030 consensus_peers.cc:597] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.705159  7030 consensus_peers.cc:597] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.719821 30271 tablet_server.cc:196] TabletServer@127.29.143.193:39751 shutdown complete.
W20260709 12:25:54.737861  6881 consensus_peers.cc:597] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.751415  6881 consensus_peers.cc:597] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.764940  6955 consensus_peers.cc:597] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.765583  6955 consensus_peers.cc:597] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.769809  7030 consensus_peers.cc:597] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.799754  6881 consensus_peers.cc:597] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.805464 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
W20260709 12:25:54.814164  6957 consensus_peers.cc:597] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.817760  6881 consensus_peers.cc:597] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.824894  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.844702  6881 consensus_peers.cc:597] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.845225  6881 consensus_peers.cc:597] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.863301  7032 consensus_peers.cc:597] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.872169 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:54.873282 30271 tablet_replica.cc:333] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.874095 30271 raft_consensus.cc:2243] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.875036 30271 raft_consensus.cc:2272] T de6a6075ba174637ba0ca8a688bcaafe P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.877236 30271 tablet_replica.cc:333] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.877849 30271 raft_consensus.cc:2243] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.878304 30271 raft_consensus.cc:2272] T c924f3222be749da91d981faff44dc5e P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.880949 30271 tablet_replica.cc:333] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.881754 30271 raft_consensus.cc:2243] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.882833 30271 raft_consensus.cc:2272] T ad8f7290a19046fba7ff4bf9acad43b2 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.883155  6957 consensus_peers.cc:597] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.883839  6957 consensus_peers.cc:597] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.885393 30271 tablet_replica.cc:333] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.886129 30271 raft_consensus.cc:2243] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.886956 30271 raft_consensus.cc:2272] T 5a14f3d8aa30470eba2fcf88fba00745 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.888948 30271 tablet_replica.cc:333] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.889554 30271 raft_consensus.cc:2243] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.890306 30271 raft_consensus.cc:2272] T 939129fdb05c4c798051c85011070991 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.892521 30271 tablet_replica.cc:333] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.893369 30271 raft_consensus.cc:2243] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.894466 30271 raft_consensus.cc:2272] T e330099c2e664276a6db9bfa41dd79e4 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.897047 30271 tablet_replica.cc:333] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.897552 30271 raft_consensus.cc:2243] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.897927 30271 raft_consensus.cc:2272] T dea4f98636ae4352bed12ff04f780dc5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.900424 30271 tablet_replica.cc:333] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.900954 30271 raft_consensus.cc:2243] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.901799 30271 raft_consensus.cc:2272] T e465e32dc8914014a33a2237e61a82d5 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.904083 30271 tablet_replica.cc:333] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.904637 30271 raft_consensus.cc:2243] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.905117 30271 raft_consensus.cc:2272] T 2250baee2f594167a763ebb190c6ef85 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.907280 30271 tablet_replica.cc:333] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.907845 30271 raft_consensus.cc:2243] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.908617 30271 raft_consensus.cc:2272] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.911053 30271 tablet_replica.cc:333] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.911767 30271 raft_consensus.cc:2243] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.912254 30271 raft_consensus.cc:2272] T b4474482b286401ba6a66908093c0af1 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.914587 30271 tablet_replica.cc:333] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.915341 30271 raft_consensus.cc:2243] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.916301 30271 raft_consensus.cc:2272] T ef29f51530fd4a5e872b7df967e9aa9a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.918776 30271 tablet_replica.cc:333] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.919564 30271 raft_consensus.cc:2243] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.920539 30271 raft_consensus.cc:2272] T 0a9697377f5245aea57a49232473283e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.923135 30271 tablet_replica.cc:333] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.923836 30271 raft_consensus.cc:2243] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.924651 30271 raft_consensus.cc:2272] T f43ba15ae68f4e60954a666740ae7ec7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.926371 30271 tablet_replica.cc:333] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.926856 30271 raft_consensus.cc:2243] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.927542 30271 raft_consensus.cc:2272] T ed2255b163114a85a8a2aa5394891f9e P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.929291 30271 tablet_replica.cc:333] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.929765 30271 raft_consensus.cc:2243] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.930102 30271 raft_consensus.cc:2272] T 7bbe8b6f63694ab0af9a366a0096ef0b P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.931816 30271 tablet_replica.cc:333] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.932304 30271 raft_consensus.cc:2243] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.932653 30271 raft_consensus.cc:2272] T 8c85168e3fee4b5682576a9098aebf37 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.934518 30271 tablet_replica.cc:333] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.935117 30271 raft_consensus.cc:2243] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.935474 30271 raft_consensus.cc:2272] T 1bd28e008e3f4cc6b3a052fee4d4688c P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.937244 30271 tablet_replica.cc:333] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.937712 30271 raft_consensus.cc:2243] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.938179 30271 raft_consensus.cc:2272] T f74d9ce0b448489aa3fb7ae932cca398 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.940282 30271 tablet_replica.cc:333] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.940773 30271 raft_consensus.cc:2243] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.941135 30271 raft_consensus.cc:2272] T d34b89b5da1b4f08a98b364573d20b49 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.942844 30271 tablet_replica.cc:333] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.943323 30271 raft_consensus.cc:2243] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.944056 30271 raft_consensus.cc:2272] T ab49fd7331d54059a88d037ef5ada96d P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.946223 30271 tablet_replica.cc:333] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.946759 30271 raft_consensus.cc:2243] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.947116 30271 raft_consensus.cc:2272] T 8f24fa29e8f341e6919b603667ee2245 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.949031 30271 tablet_replica.cc:333] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.950003 30271 raft_consensus.cc:2243] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.950532 30271 raft_consensus.cc:2272] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.953159 30271 tablet_replica.cc:333] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.953907 30271 raft_consensus.cc:2243] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.954644 30271 raft_consensus.cc:2272] T 87bd67d607704cc6a801ef7ecc2fa2b3 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:54.955947  6955 consensus_peers.cc:597] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Couldn't send request to peer 91e8bb7cfca34631a0d9c45d8b139301. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.957054 30271 tablet_replica.cc:333] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.957679 30271 raft_consensus.cc:2243] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.958096 30271 raft_consensus.cc:2272] T 6bf1e963d9d640e3b4179db45fd20492 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.960391 30271 tablet_replica.cc:333] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.961208 30271 raft_consensus.cc:2243] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.961743 30271 raft_consensus.cc:2272] T af80e3d9967348169f8ab8bece79c333 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.963773 30271 tablet_replica.cc:333] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.964346 30271 raft_consensus.cc:2243] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.964751 30271 raft_consensus.cc:2272] T fca85df8d7a44f0a828ea763c94db545 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.966594 30271 tablet_replica.cc:333] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.967201 30271 raft_consensus.cc:2243] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.967618 30271 raft_consensus.cc:2272] T a96ad1dde254427db317a4daf42aaa96 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.969561 30271 tablet_replica.cc:333] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.971385 30271 raft_consensus.cc:2243] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.971951 30271 raft_consensus.cc:2272] T 712a0e1312454258ae9e75b931463c73 P d183b7afc3164213b30cb81edcc90c7d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.974606 30271 tablet_replica.cc:333] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.975330 30271 raft_consensus.cc:2243] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.975819 30271 raft_consensus.cc:2272] T dfee8d38cdcf420886d30dfc614d2dcd P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.978381 30271 tablet_replica.cc:333] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.979254 30271 raft_consensus.cc:2243] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:54.979790  7032 consensus_peers.cc:597] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.979790 30271 raft_consensus.cc:2272] T 5c0e0c62b350442fb08e7e7b97ab3322 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.982635 30271 tablet_replica.cc:333] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.983300 30271 raft_consensus.cc:2243] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:54.984760 30271 raft_consensus.cc:2272] T cd5451dbc9a6416781d842e1c7709a45 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.986811 30271 tablet_replica.cc:333] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.987336 30271 raft_consensus.cc:2243] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.987735 30271 raft_consensus.cc:2272] T 1ad9396234554969a1f5fc355e659c5a P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.989569 30271 tablet_replica.cc:333] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.990100 30271 raft_consensus.cc:2243] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.990602 30271 raft_consensus.cc:2272] T 75510e59268a4275bd685ff5b496ce33 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.993821 30271 tablet_replica.cc:333] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.994606 30271 raft_consensus.cc:2243] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.995119 30271 raft_consensus.cc:2272] T df5ab4fca4284754b2922f9348679d77 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:54.997251 30271 tablet_replica.cc:333] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:54.997787 30271 raft_consensus.cc:2243] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:54.998302 30271 raft_consensus.cc:2272] T 0a234f4a74e149dba651295b231774a6 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.000730 30271 tablet_replica.cc:333] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.001385 30271 raft_consensus.cc:2243] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.001904 30271 raft_consensus.cc:2272] T 9c1d3eff0cf142feb6edf343c482e453 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.004773 30271 tablet_replica.cc:333] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.005457 30271 raft_consensus.cc:2243] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.005960 30271 raft_consensus.cc:2272] T a9623b1b1de04219ac9d959598fc006c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.008739  6957 consensus_peers.cc:597] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.009044 30271 tablet_replica.cc:333] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.009852 30271 raft_consensus.cc:2243] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.010394 30271 raft_consensus.cc:2272] T e1944db928834f84aa29c6a0b169c353 P d183b7afc3164213b30cb81edcc90c7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.013363 30271 tablet_replica.cc:333] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.014195 30271 raft_consensus.cc:2243] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.014736 30271 raft_consensus.cc:2272] T aa2b22be3870440ea4db26e751648dbb P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.017484 30271 tablet_replica.cc:333] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.018124 30271 raft_consensus.cc:2243] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.019186 30271 raft_consensus.cc:2272] T de46948cdeaa436392d55477ede3126c P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.021945 30271 tablet_replica.cc:333] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.022639 30271 raft_consensus.cc:2243] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.023164 30271 raft_consensus.cc:2272] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.025255 30271 tablet_replica.cc:333] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.025767 30271 raft_consensus.cc:2243] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:55.026008  7032 consensus_peers.cc:597] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.026302 30271 raft_consensus.cc:2272] T 1ac83c19fd794ce0b286a09a261b6406 P d183b7afc3164213b30cb81edcc90c7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.029140 30271 tablet_replica.cc:333] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d: stopping tablet replica
I20260709 12:25:55.029726 30271 raft_consensus.cc:2243] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.030198 30271 raft_consensus.cc:2272] T 8b811e6cffc24cfdb05f8a591b81e5a7 P d183b7afc3164213b30cb81edcc90c7d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.038113  7032 consensus_peers.cc:597] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.084069  6957 consensus_peers.cc:597] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.103729 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
W20260709 12:25:55.105085  6957 consensus_peers.cc:597] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.176373  7032 consensus_peers.cc:597] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.176892  7032 consensus_peers.cc:597] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.183036  7032 consensus_peers.cc:597] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.196281 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
W20260709 12:25:55.214283  7030 consensus_peers.cc:597] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.216523  7032 consensus_peers.cc:597] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.244210 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:55.245162 30271 tablet_replica.cc:333] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.246188 30271 raft_consensus.cc:2243] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.247227 30271 raft_consensus.cc:2272] T 986ed6daa4ed4fdb805d9d5eef38b40b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.249418 30271 tablet_replica.cc:333] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.250054 30271 raft_consensus.cc:2243] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.250447 30271 raft_consensus.cc:2272] T da57db9ef59345a2a1467f6952f3364d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.252672 30271 tablet_replica.cc:333] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.253278 30271 raft_consensus.cc:2243] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.253750 30271 raft_consensus.cc:2272] T ad8f7290a19046fba7ff4bf9acad43b2 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.256521 30271 tablet_replica.cc:333] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.257268 30271 raft_consensus.cc:2243] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.257969 30271 raft_consensus.cc:2272] T 939129fdb05c4c798051c85011070991 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.259917  7032 consensus_peers.cc:597] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.260663 30271 tablet_replica.cc:333] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.261334 30271 raft_consensus.cc:2243] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.261806 30271 raft_consensus.cc:2272] T 5a14f3d8aa30470eba2fcf88fba00745 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.263881 30271 tablet_replica.cc:333] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.264506 30271 raft_consensus.cc:2243] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.265302 30271 raft_consensus.cc:2272] T dea4f98636ae4352bed12ff04f780dc5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.268157 30271 tablet_replica.cc:333] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.268980 30271 raft_consensus.cc:2243] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.269498 30271 raft_consensus.cc:2272] T e465e32dc8914014a33a2237e61a82d5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.272167 30271 tablet_replica.cc:333] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.272959 30271 raft_consensus.cc:2243] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.273481 30271 raft_consensus.cc:2272] T b7f9e2b4d7b24e86bb0226e3c0c8a6f6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.276274 30271 tablet_replica.cc:333] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.277032 30271 raft_consensus.cc:2243] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.277544 30271 raft_consensus.cc:2272] T 78ec6be90d254ce1874ea9379f54f53a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.280407 30271 tablet_replica.cc:333] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.281179 30271 raft_consensus.cc:2243] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.282073 30271 raft_consensus.cc:2272] T b5e75070838e424ca6c903634ffb3bf7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.282697  7030 consensus_peers.cc:597] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.284446 30271 tablet_replica.cc:333] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.285176 30271 raft_consensus.cc:2243] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.285673 30271 raft_consensus.cc:2272] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.288326 30271 tablet_replica.cc:333] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.289041 30271 raft_consensus.cc:2243] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.289593 30271 raft_consensus.cc:2272] T ef29f51530fd4a5e872b7df967e9aa9a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.292253 30271 tablet_replica.cc:333] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.293025 30271 raft_consensus.cc:2243] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.293883 30271 raft_consensus.cc:2272] T 87bd67d607704cc6a801ef7ecc2fa2b3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.296526 30271 tablet_replica.cc:333] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.297398 30271 raft_consensus.cc:2243] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.297936 30271 raft_consensus.cc:2272] T 0a9697377f5245aea57a49232473283e P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.300710 30271 tablet_replica.cc:333] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.301676 30271 raft_consensus.cc:2243] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.302232 30271 raft_consensus.cc:2272] T f43ba15ae68f4e60954a666740ae7ec7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.304811 30271 tablet_replica.cc:333] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.305567 30271 raft_consensus.cc:2243] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.306049 30271 raft_consensus.cc:2272] T 83e59c66e8424098a23bcccb441ed821 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.307690  7030 consensus_peers.cc:597] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.308538 30271 tablet_replica.cc:333] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.309405 30271 raft_consensus.cc:2243] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.310426 30271 raft_consensus.cc:2272] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.313265 30271 tablet_replica.cc:333] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.314033 30271 raft_consensus.cc:2243] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.314648 30271 raft_consensus.cc:2272] T 9c1d3eff0cf142feb6edf343c482e453 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.316840  7032 consensus_peers.cc:597] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.317818 30271 tablet_replica.cc:333] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.318598 30271 raft_consensus.cc:2243] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.319676 30271 raft_consensus.cc:2272] T 0a234f4a74e149dba651295b231774a6 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.322194 30271 tablet_replica.cc:333] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.322834 30271 raft_consensus.cc:2243] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.323252 30271 raft_consensus.cc:2272] T 4ae7f3dde5214382bea50b9b700d4ced P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.325172 30271 tablet_replica.cc:333] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.325718 30271 raft_consensus.cc:2243] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.326164 30271 raft_consensus.cc:2272] T a96ad1dde254427db317a4daf42aaa96 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.328140 30271 tablet_replica.cc:333] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.328619 30271 raft_consensus.cc:2243] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.328954 30271 raft_consensus.cc:2272] T 712a0e1312454258ae9e75b931463c73 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.331147 30271 tablet_replica.cc:333] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.331908 30271 raft_consensus.cc:2243] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.332336 30271 raft_consensus.cc:2272] T 6bf1e963d9d640e3b4179db45fd20492 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:55.333554  7030 consensus_peers.cc:597] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.334828 30271 tablet_replica.cc:333] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.335671 30271 raft_consensus.cc:2243] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:55.336398  7032 consensus_peers.cc:597] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.336637 30271 raft_consensus.cc:2272] T d085654055944f75b6657bc46c50ffad P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.339021 30271 tablet_replica.cc:333] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.339633 30271 raft_consensus.cc:2243] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.340114 30271 raft_consensus.cc:2272] T 8f24fa29e8f341e6919b603667ee2245 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.341868 30271 tablet_replica.cc:333] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.342338 30271 raft_consensus.cc:2243] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.342734 30271 raft_consensus.cc:2272] T ab49fd7331d54059a88d037ef5ada96d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.344501 30271 tablet_replica.cc:333] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.345124 30271 raft_consensus.cc:2243] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.345862 30271 raft_consensus.cc:2272] T 9b534ea90b954a8aaa26488b181a5cd7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.347837 30271 tablet_replica.cc:333] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
W20260709 12:25:55.348121  7030 consensus_peers.cc:597] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.348415 30271 raft_consensus.cc:2243] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.349190 30271 raft_consensus.cc:2272] T 5c0e0c62b350442fb08e7e7b97ab3322 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.351118 30271 tablet_replica.cc:333] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.351637 30271 raft_consensus.cc:2243] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.352365 30271 raft_consensus.cc:2272] T e93f31c1947a442ab8d8329061c6f3d4 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.354171 30271 tablet_replica.cc:333] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.354746 30271 raft_consensus.cc:2243] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.355161 30271 raft_consensus.cc:2272] T 5c661acabb704e839938f81b5474853d P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.356990 30271 tablet_replica.cc:333] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.357498 30271 raft_consensus.cc:2243] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.357892 30271 raft_consensus.cc:2272] T 9448e5bc5adc4a0383825437ec1a466b P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.359807 30271 tablet_replica.cc:333] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.360329 30271 raft_consensus.cc:2243] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.360752 30271 raft_consensus.cc:2272] T af80e3d9967348169f8ab8bece79c333 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.362594 30271 tablet_replica.cc:333] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.363184 30271 raft_consensus.cc:2243] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.363571 30271 raft_consensus.cc:2272] T cd5451dbc9a6416781d842e1c7709a45 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.365556 30271 tablet_replica.cc:333] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.366074 30271 raft_consensus.cc:2243] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:55.366304  7030 consensus_peers.cc:597] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.366915 30271 raft_consensus.cc:2272] T 1ad9396234554969a1f5fc355e659c5a P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.368912 30271 tablet_replica.cc:333] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.369442 30271 raft_consensus.cc:2243] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.369884 30271 raft_consensus.cc:2272] T 75510e59268a4275bd685ff5b496ce33 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.372586 30271 tablet_replica.cc:333] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.373152 30271 raft_consensus.cc:2243] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.373921 30271 raft_consensus.cc:2272] T 957994df5dd14b04a9ac6f7b24bd13dd P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.375703 30271 tablet_replica.cc:333] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.376195 30271 raft_consensus.cc:2243] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.376899 30271 raft_consensus.cc:2272] T 3a2750742f4f4dceab13f4552a75ff9f P 5eb7ff7a37ff47f4a040d570caed46d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.379017 30271 tablet_replica.cc:333] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.379575 30271 raft_consensus.cc:2243] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.380595 30271 raft_consensus.cc:2272] T 8c85168e3fee4b5682576a9098aebf37 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.382938 30271 tablet_replica.cc:333] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
W20260709 12:25:55.383283  7032 consensus_peers.cc:597] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer d183b7afc3164213b30cb81edcc90c7d (127.29.143.194:39331): Couldn't send request to peer d183b7afc3164213b30cb81edcc90c7d. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:39331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.383460 30271 raft_consensus.cc:2243] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.384312 30271 raft_consensus.cc:2272] T aa2b22be3870440ea4db26e751648dbb P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.386152 30271 tablet_replica.cc:333] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.386647 30271 raft_consensus.cc:2243] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.387112 30271 raft_consensus.cc:2272] T de6a6075ba174637ba0ca8a688bcaafe P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.389055 30271 tablet_replica.cc:333] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.389532 30271 raft_consensus.cc:2243] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.390218 30271 raft_consensus.cc:2272] T ae235a7a1ddc48aaa37f8297a848f365 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.392014 30271 tablet_replica.cc:333] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.392496 30271 raft_consensus.cc:2243] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.392922 30271 raft_consensus.cc:2272] T f74d9ce0b448489aa3fb7ae932cca398 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.394650 30271 tablet_replica.cc:333] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.395234 30271 raft_consensus.cc:2243] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.395603 30271 raft_consensus.cc:2272] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.397300 30271 tablet_replica.cc:333] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8: stopping tablet replica
I20260709 12:25:55.397812 30271 raft_consensus.cc:2243] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.398274 30271 raft_consensus.cc:2272] T 2f6dcc5bfa4141c08fdff7d85ee1bea5 P 5eb7ff7a37ff47f4a040d570caed46d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.468147 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:25:55.531461  8109 raft_consensus.cc:493] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:55.532168  8109 raft_consensus.cc:515] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:55.534605  8109 leader_election.cc:290] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:55.535446 30271 tablet_server.cc:179] TabletServer@127.29.143.196:0 shutting down...
W20260709 12:25:55.539952  7030 leader_election.cc:336] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Network error: Client connection negotiation failed: client connection to 127.29.143.195:40793: connect: Connection refused (error 111)
W20260709 12:25:55.540735  7030 leader_election.cc:336] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:55.541148  7030 leader_election.cc:304] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:55.541939  8109 raft_consensus.cc:2749] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:55.554984  7030 consensus_peers.cc:597] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:40793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:55.558459  7030 consensus_peers.cc:597] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc -> Peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Couldn't send request to peer 5eb7ff7a37ff47f4a040d570caed46d8. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.195:40793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.583316 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:55.584113 30271 tablet_replica.cc:333] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.584748 30271 raft_consensus.cc:2243] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.585243 30271 raft_consensus.cc:2272] T 986ed6daa4ed4fdb805d9d5eef38b40b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.587246 30271 tablet_replica.cc:333] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.587795 30271 raft_consensus.cc:2243] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.588510 30271 raft_consensus.cc:2272] T da57db9ef59345a2a1467f6952f3364d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.590888 30271 tablet_replica.cc:333] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.591538 30271 raft_consensus.cc:2243] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.592293 30271 raft_consensus.cc:2272] T c924f3222be749da91d981faff44dc5e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.594760 30271 tablet_replica.cc:333] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.595441 30271 raft_consensus.cc:2243] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.595971 30271 raft_consensus.cc:2272] T ad8f7290a19046fba7ff4bf9acad43b2 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.596585  8109 raft_consensus.cc:493] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 91e8bb7cfca34631a0d9c45d8b139301)
I20260709 12:25:55.597105  8109 raft_consensus.cc:515] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5eb7ff7a37ff47f4a040d570caed46d8" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 40793 } } peers { permanent_uuid: "735ce7f4a3244c7d877ce5feb5fb4ffc" member_type: VOTER last_known_addr { host: "127.29.143.196" port: 39137 } } peers { permanent_uuid: "91e8bb7cfca34631a0d9c45d8b139301" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 39751 } }
I20260709 12:25:55.598258 30271 tablet_replica.cc:333] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.598922  8109 leader_election.cc:290] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793), 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751)
I20260709 12:25:55.599148 30271 raft_consensus.cc:2243] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.599771 30271 raft_consensus.cc:2272] T b4474482b286401ba6a66908093c0af1 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.602257 30271 tablet_replica.cc:333] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
W20260709 12:25:55.602520  7030 leader_election.cc:336] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5eb7ff7a37ff47f4a040d570caed46d8 (127.29.143.195:40793): Network error: Client connection negotiation failed: client connection to 127.29.143.195:40793: connect: Connection refused (error 111)
I20260709 12:25:55.603106 30271 raft_consensus.cc:2243] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:55.603209  7030 leader_election.cc:336] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91e8bb7cfca34631a0d9c45d8b139301 (127.29.143.193:39751): Network error: Client connection negotiation failed: client connection to 127.29.143.193:39751: connect: Connection refused (error 111)
I20260709 12:25:55.603648  7030 leader_election.cc:304] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735ce7f4a3244c7d877ce5feb5fb4ffc; no voters: 5eb7ff7a37ff47f4a040d570caed46d8, 91e8bb7cfca34631a0d9c45d8b139301
I20260709 12:25:55.603786 30271 raft_consensus.cc:2272] T 5a14f3d8aa30470eba2fcf88fba00745 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.604351  8109 raft_consensus.cc:2749] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:55.606438 30271 tablet_replica.cc:333] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.607069 30271 raft_consensus.cc:2243] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.607488 30271 raft_consensus.cc:2272] T e465e32dc8914014a33a2237e61a82d5 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.609448 30271 tablet_replica.cc:333] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.609977 30271 raft_consensus.cc:2243] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.610666 30271 raft_consensus.cc:2272] T 2250baee2f594167a763ebb190c6ef85 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.612459 30271 tablet_replica.cc:333] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.613006 30271 raft_consensus.cc:2243] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.613669 30271 raft_consensus.cc:2272] T 78ec6be90d254ce1874ea9379f54f53a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.615535 30271 tablet_replica.cc:333] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.616068 30271 raft_consensus.cc:2243] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.616463 30271 raft_consensus.cc:2272] T b5e75070838e424ca6c903634ffb3bf7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.618235 30271 tablet_replica.cc:333] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.618783 30271 raft_consensus.cc:2243] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.619189 30271 raft_consensus.cc:2272] T e330099c2e664276a6db9bfa41dd79e4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.621289 30271 tablet_replica.cc:333] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.621824 30271 raft_consensus.cc:2243] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.622198 30271 raft_consensus.cc:2272] T 4a46d9ac5bf4436ebd73557d3bf268d3 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.624092 30271 tablet_replica.cc:333] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.624630 30271 raft_consensus.cc:2243] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.625039 30271 raft_consensus.cc:2272] T 1ad9396234554969a1f5fc355e659c5a P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.626811 30271 tablet_replica.cc:333] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.627563 30271 raft_consensus.cc:2243] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.627975 30271 raft_consensus.cc:2272] T 0a234f4a74e149dba651295b231774a6 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.629683 30271 tablet_replica.cc:333] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.630275 30271 raft_consensus.cc:2243] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.630883 30271 raft_consensus.cc:2272] T 5c661acabb704e839938f81b5474853d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.632797 30271 tablet_replica.cc:333] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.633353 30271 raft_consensus.cc:2243] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.634155 30271 raft_consensus.cc:2272] T 9448e5bc5adc4a0383825437ec1a466b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.636061 30271 tablet_replica.cc:333] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.636564 30271 raft_consensus.cc:2243] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.637262 30271 raft_consensus.cc:2272] T af80e3d9967348169f8ab8bece79c333 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.639031 30271 tablet_replica.cc:333] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.639565 30271 raft_consensus.cc:2243] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.639948 30271 raft_consensus.cc:2272] T fca85df8d7a44f0a828ea763c94db545 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.641862 30271 tablet_replica.cc:333] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.642381 30271 raft_consensus.cc:2243] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.642845 30271 raft_consensus.cc:2272] T d085654055944f75b6657bc46c50ffad P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.644596 30271 tablet_replica.cc:333] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.645087 30271 raft_consensus.cc:2243] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.645481 30271 raft_consensus.cc:2272] T 0a9697377f5245aea57a49232473283e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.647272 30271 tablet_replica.cc:333] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.647790 30271 raft_consensus.cc:2243] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.648166 30271 raft_consensus.cc:2272] T ed2255b163114a85a8a2aa5394891f9e P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.649905 30271 tablet_replica.cc:333] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.650476 30271 raft_consensus.cc:2243] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.650926 30271 raft_consensus.cc:2272] T 83e59c66e8424098a23bcccb441ed821 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.652697 30271 tablet_replica.cc:333] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.653332 30271 raft_consensus.cc:2243] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.654256 30271 raft_consensus.cc:2272] T f74d9ce0b448489aa3fb7ae932cca398 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.656278 30271 tablet_replica.cc:333] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.656831 30271 raft_consensus.cc:2243] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.657514 30271 raft_consensus.cc:2272] T 1bd28e008e3f4cc6b3a052fee4d4688c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.659442 30271 tablet_replica.cc:333] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.659967 30271 raft_consensus.cc:2243] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.660347 30271 raft_consensus.cc:2272] T d34b89b5da1b4f08a98b364573d20b49 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.662084 30271 tablet_replica.cc:333] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.662606 30271 raft_consensus.cc:2243] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.663043 30271 raft_consensus.cc:2272] T dfee8d38cdcf420886d30dfc614d2dcd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.664813 30271 tablet_replica.cc:333] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.665369 30271 raft_consensus.cc:2243] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.665771 30271 raft_consensus.cc:2272] T 5c0e0c62b350442fb08e7e7b97ab3322 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.667578 30271 tablet_replica.cc:333] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.668088 30271 raft_consensus.cc:2243] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.668473 30271 raft_consensus.cc:2272] T 9b534ea90b954a8aaa26488b181a5cd7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.670327 30271 tablet_replica.cc:333] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.670902 30271 raft_consensus.cc:2243] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.671298 30271 raft_consensus.cc:2272] T e93f31c1947a442ab8d8329061c6f3d4 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.673158 30271 tablet_replica.cc:333] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.673679 30271 raft_consensus.cc:2243] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.674438 30271 raft_consensus.cc:2272] T 8f24fa29e8f341e6919b603667ee2245 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.676277 30271 tablet_replica.cc:333] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.676805 30271 raft_consensus.cc:2243] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.677196 30271 raft_consensus.cc:2272] T ab49fd7331d54059a88d037ef5ada96d P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.679013 30271 tablet_replica.cc:333] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.679576 30271 raft_consensus.cc:2243] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.680326 30271 raft_consensus.cc:2272] T a9623b1b1de04219ac9d959598fc006c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.682169 30271 tablet_replica.cc:333] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.682700 30271 raft_consensus.cc:2243] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.683106 30271 raft_consensus.cc:2272] T e1944db928834f84aa29c6a0b169c353 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.684805 30271 tablet_replica.cc:333] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.685285 30271 raft_consensus.cc:2243] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.685675 30271 raft_consensus.cc:2272] T 957994df5dd14b04a9ac6f7b24bd13dd P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.687621 30271 tablet_replica.cc:333] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.688089 30271 raft_consensus.cc:2243] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.688781 30271 raft_consensus.cc:2272] T 9b8fb6a484de42a9b96c3cc5d38ca2d7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.690668 30271 tablet_replica.cc:333] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.691170 30271 raft_consensus.cc:2243] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.691653 30271 raft_consensus.cc:2272] T de46948cdeaa436392d55477ede3126c P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.693423 30271 tablet_replica.cc:333] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.693900 30271 raft_consensus.cc:2243] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.694597 30271 raft_consensus.cc:2272] T 1ac83c19fd794ce0b286a09a261b6406 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.696413 30271 tablet_replica.cc:333] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.696887 30271 raft_consensus.cc:2243] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.697283 30271 raft_consensus.cc:2272] T 4ae7f3dde5214382bea50b9b700d4ced P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.698987 30271 tablet_replica.cc:333] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.699492 30271 raft_consensus.cc:2243] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.700217 30271 raft_consensus.cc:2272] T a96ad1dde254427db317a4daf42aaa96 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.702037 30271 tablet_replica.cc:333] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.702527 30271 raft_consensus.cc:2243] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.702942 30271 raft_consensus.cc:2272] T ae235a7a1ddc48aaa37f8297a848f365 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.705036 30271 tablet_replica.cc:333] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.705530 30271 raft_consensus.cc:2243] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.706230 30271 raft_consensus.cc:2272] T 8b811e6cffc24cfdb05f8a591b81e5a7 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.708046 30271 tablet_replica.cc:333] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.708508 30271 raft_consensus.cc:2243] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.708909 30271 raft_consensus.cc:2272] T 3a2750742f4f4dceab13f4552a75ff9f P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.710801 30271 tablet_replica.cc:333] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.711279 30271 raft_consensus.cc:2243] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.711691 30271 raft_consensus.cc:2272] T 7bbe8b6f63694ab0af9a366a0096ef0b P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.713443 30271 tablet_replica.cc:333] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc: stopping tablet replica
I20260709 12:25:55.713876 30271 raft_consensus.cc:2243] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.714612 30271 raft_consensus.cc:2272] T df5ab4fca4284754b2922f9348679d77 P 735ce7f4a3244c7d877ce5feb5fb4ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.813930 30271 tablet_server.cc:196] TabletServer@127.29.143.196:0 shutdown complete.
I20260709 12:25:55.877676 30271 master.cc:562] Master@127.29.143.254:44241 shutting down...
I20260709 12:25:55.906054 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:55.906780 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.907127 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1101d5c10fef41dc9a47c8a69646f4e9: stopping tablet replica
I20260709 12:25:55.929454 30271 master.cc:584] Master@127.29.143.254:44241 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33832 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:25:56.016703 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:41381
I20260709 12:25:56.017812 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.024169  8110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.024272  8111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.025187  8113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.026999 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:56.028244 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.028420 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.028590 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599956028577 us; error 0 us; skew 500 ppm
I20260709 12:25:56.029183 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.031766 30271 webserver.cc:533] Webserver started at http://127.29.143.254:33537/ using document root <none> and password file <none>
I20260709 12:25:56.032271 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.032466 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.032760 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.033936 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "3d29e84bd15844d4bea2792aebc52461"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.038414 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:25:56.042047  8118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.042986 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:56.043291 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "3d29e84bd15844d4bea2792aebc52461"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.043632 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.075155 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.076397 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.114946 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:41381
I20260709 12:25:56.115046  8169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:41381 every 8 connection(s)
I20260709 12:25:56.118781  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.129536  8170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461: Bootstrap starting.
I20260709 12:25:56.134398  8170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.138614  8170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461: No bootstrap required, opened a new log
I20260709 12:25:56.140838  8170 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER }
I20260709 12:25:56.141215  8170 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.141466  8170 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d29e84bd15844d4bea2792aebc52461, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.142073  8170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER }
I20260709 12:25:56.142513  8170 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:56.142732  8170 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:56.143036  8170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.147699  8170 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER }
I20260709 12:25:56.148200  8170 leader_election.cc:304] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d29e84bd15844d4bea2792aebc52461; no voters: 
I20260709 12:25:56.149345  8170 leader_election.cc:290] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:56.149817  8173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.151298  8173 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 1 LEADER]: Becoming Leader. State: Replica: 3d29e84bd15844d4bea2792aebc52461, State: Running, Role: LEADER
I20260709 12:25:56.151952  8173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER }
I20260709 12:25:56.152259  8170 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:56.156780  8175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d29e84bd15844d4bea2792aebc52461. Latest consensus state: current_term: 1 leader_uuid: "3d29e84bd15844d4bea2792aebc52461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER } }
I20260709 12:25:56.157577  8175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:56.157299  8174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d29e84bd15844d4bea2792aebc52461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29e84bd15844d4bea2792aebc52461" member_type: VOTER } }
I20260709 12:25:56.158080  8174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:56.160244  8180 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:56.165639  8180 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:56.169981 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:56.175100  8180 catalog_manager.cc:1383] Generated new cluster ID: c6714f5c95d1444987fce229befa36c0
I20260709 12:25:56.175396  8180 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:56.197965  8180 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:56.199313  8180 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:56.214619  8180 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461: Generated new TSK 0
I20260709 12:25:56.215322  8180 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:56.236436 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.242736  8191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.243844  8192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.247772  8194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.248248 30271 server_base.cc:1061] running on GCE node
I20260709 12:25:56.249241 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.249416 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.249548 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599956249537 us; error 0 us; skew 500 ppm
I20260709 12:25:56.250029 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.252363 30271 webserver.cc:533] Webserver started at http://127.29.143.193:43749/ using document root <none> and password file <none>
I20260709 12:25:56.252791 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.252948 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.253151 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.254395 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "ed504ef86dcd4610b04ceadcf381e637"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.258783 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:25:56.262074  8199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.262976 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:25:56.263226 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "ed504ef86dcd4610b04ceadcf381e637"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.263475 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.292040 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.293316 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.294831 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:56.297001 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:56.297227 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.297485 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:56.297675 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.338581 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:42799
I20260709 12:25:56.338776  8261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:42799 every 8 connection(s)
I20260709 12:25:56.343798 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.351408  8266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.351989  8267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.355455 30271 server_base.cc:1061] running on GCE node
W20260709 12:25:56.356057  8269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.357054 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.357365 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.357580 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599956357564 us; error 0 us; skew 500 ppm
I20260709 12:25:56.358234 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.360916  8262 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41381
I20260709 12:25:56.361575  8262 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:56.361824 30271 webserver.cc:533] Webserver started at http://127.29.143.194:42675/ using document root <none> and password file <none>
I20260709 12:25:56.362751 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.362823  8262 heartbeater.cc:507] Master 127.29.143.254:41381 requested a full tablet report, sending...
I20260709 12:25:56.363018 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.363448 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.364665 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.365375  8135 ts_manager.cc:194] Registered new tserver with Master: ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799)
I20260709 12:25:56.368038  8135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37854
I20260709 12:25:56.369655 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:56.373683  8274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.374560 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:56.375176 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.375476 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.388876 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.390209 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.391848 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:56.394407 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:56.394659 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.394927 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:56.395123 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.435803 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:40517
I20260709 12:25:56.435906  8336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:40517 every 8 connection(s)
I20260709 12:25:56.440738 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:56.447824  8340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:56.451820  8341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.457674 30271 server_base.cc:1061] running on GCE node
W20260709 12:25:56.457754  8343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:56.460556  8337 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41381
I20260709 12:25:56.461234  8337 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:56.462255  8337 heartbeater.cc:507] Master 127.29.143.254:41381 requested a full tablet report, sending...
I20260709 12:25:56.462541 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:56.462873 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:56.463100 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599956463079 us; error 0 us; skew 500 ppm
I20260709 12:25:56.464139 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:56.464656  8135 ts_manager.cc:194] Registered new tserver with Master: ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:56.466367  8135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37864
I20260709 12:25:56.466987 30271 webserver.cc:533] Webserver started at http://127.29.143.195:45299/ using document root <none> and password file <none>
I20260709 12:25:56.467636 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:56.467837 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:56.468122 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:56.469255 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "9a5d97b37f01480faf357aa92b772c06"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.473742 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:56.477104  8348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.477983 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:25:56.478291 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "9a5d97b37f01480faf357aa92b772c06"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:25:56.478586 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:56.496356 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:56.497551 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:56.499012 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:56.501145 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:56.501368 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.501636 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:56.501823 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:56.543895 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:42531
I20260709 12:25:56.543977  8410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:42531 every 8 connection(s)
I20260709 12:25:56.559326  8411 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41381
I20260709 12:25:56.559814  8411 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:56.560541  8411 heartbeater.cc:507] Master 127.29.143.254:41381 requested a full tablet report, sending...
I20260709 12:25:56.562413  8135 ts_manager.cc:194] Registered new tserver with Master: 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:56.562947 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014736163s
I20260709 12:25:56.563741  8135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37878
I20260709 12:25:56.588092  8135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37884:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:56.591144  8135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:56.670943  8376 tablet_service.cc:1511] Processing CreateTablet for tablet ddd1ef78a8ed48e4a754576d3bf363ea (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:56.672458  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd1ef78a8ed48e4a754576d3bf363ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.673602  8223 tablet_service.cc:1511] Processing CreateTablet for tablet 7efd8336cb5547f5ad265dacaa3710d4 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:56.674129  8224 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7e35937db848ef8a9625d004e0af76 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:56.675146  8223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efd8336cb5547f5ad265dacaa3710d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.677680  8224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7e35937db848ef8a9625d004e0af76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.679684  8375 tablet_service.cc:1511] Processing CreateTablet for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:56.681022  8227 tablet_service.cc:1511] Processing CreateTablet for tablet ddd1ef78a8ed48e4a754576d3bf363ea (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:56.681810  8225 tablet_service.cc:1511] Processing CreateTablet for tablet c962f707404b40b593f912f68db1b344 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:56.682435  8227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd1ef78a8ed48e4a754576d3bf363ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.683202  8225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c962f707404b40b593f912f68db1b344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.683972  8222 tablet_service.cc:1511] Processing CreateTablet for tablet 987d7b24470c476ba02db74faf1aa8c2 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:56.685303  8222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987d7b24470c476ba02db74faf1aa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.689534  8221 tablet_service.cc:1511] Processing CreateTablet for tablet 3435adc93a2249b786e06b0e30e1fd52 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:56.691828  8220 tablet_service.cc:1511] Processing CreateTablet for tablet 0383446c97884aec962c3fbff02258ec (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:56.692082  8374 tablet_service.cc:1511] Processing CreateTablet for tablet c962f707404b40b593f912f68db1b344 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:56.679481  8226 tablet_service.cc:1511] Processing CreateTablet for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:56.681037  8375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.694733  8374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c962f707404b40b593f912f68db1b344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.695106  8219 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9ece10e61843b98292f24f6485b497 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:56.697186  8221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3435adc93a2249b786e06b0e30e1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.701869  8218 tablet_service.cc:1511] Processing CreateTablet for tablet 63109c99daaf4527ac9c84dfe7a7b721 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:56.703022  8226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.707001  8218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63109c99daaf4527ac9c84dfe7a7b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.711000  8220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0383446c97884aec962c3fbff02258ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.711943  8219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9ece10e61843b98292f24f6485b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.728305  8375 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7e35937db848ef8a9625d004e0af76 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:56.731370  8372 tablet_service.cc:1511] Processing CreateTablet for tablet 987d7b24470c476ba02db74faf1aa8c2 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:56.731788  8373 tablet_service.cc:1511] Processing CreateTablet for tablet 7efd8336cb5547f5ad265dacaa3710d4 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:56.732489  8375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7e35937db848ef8a9625d004e0af76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.738540  8302 tablet_service.cc:1511] Processing CreateTablet for tablet ddd1ef78a8ed48e4a754576d3bf363ea (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:56.738924  8371 tablet_service.cc:1511] Processing CreateTablet for tablet 3435adc93a2249b786e06b0e30e1fd52 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:56.739595  8376 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9ece10e61843b98292f24f6485b497 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:56.740167  8302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd1ef78a8ed48e4a754576d3bf363ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.740404  8371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3435adc93a2249b786e06b0e30e1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.746888  8294 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9ece10e61843b98292f24f6485b497 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:56.747483  8295 tablet_service.cc:1511] Processing CreateTablet for tablet 0383446c97884aec962c3fbff02258ec (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:56.752274  8293 tablet_service.cc:1511] Processing CreateTablet for tablet 63109c99daaf4527ac9c84dfe7a7b721 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:56.741716  8301 tablet_service.cc:1511] Processing CreateTablet for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:56.741998  8370 tablet_service.cc:1511] Processing CreateTablet for tablet 0383446c97884aec962c3fbff02258ec (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:56.742558  8299 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7e35937db848ef8a9625d004e0af76 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:56.755031  8293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63109c99daaf4527ac9c84dfe7a7b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.755196  8372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987d7b24470c476ba02db74faf1aa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.745694  8298 tablet_service.cc:1511] Processing CreateTablet for tablet 7efd8336cb5547f5ad265dacaa3710d4 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:56.755736  8299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7e35937db848ef8a9625d004e0af76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.756758  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0383446c97884aec962c3fbff02258ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.743805  8369 tablet_service.cc:1511] Processing CreateTablet for tablet 63109c99daaf4527ac9c84dfe7a7b721 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:56.758002  8295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0383446c97884aec962c3fbff02258ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.758272  8369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63109c99daaf4527ac9c84dfe7a7b721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.759143  8373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efd8336cb5547f5ad265dacaa3710d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.759346  8301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c611c0bf1364a1ebf6b2f0b07e98a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.743710  8300 tablet_service.cc:1511] Processing CreateTablet for tablet c962f707404b40b593f912f68db1b344 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:56.760327  8298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efd8336cb5547f5ad265dacaa3710d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.761169  8300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c962f707404b40b593f912f68db1b344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.746791  8297 tablet_service.cc:1511] Processing CreateTablet for tablet 987d7b24470c476ba02db74faf1aa8c2 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:56.745694  8296 tablet_service.cc:1511] Processing CreateTablet for tablet 3435adc93a2249b786e06b0e30e1fd52 (DEFAULT_TABLE table=test-workload [id=32f48464ed66454fa2ed4249681dfbc7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:56.765442  8294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9ece10e61843b98292f24f6485b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.766117  8296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3435adc93a2249b786e06b0e30e1fd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.771206  8297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987d7b24470c476ba02db74faf1aa8c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.791878  8427 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:56.807621  8426 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:56.852481  8376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9ece10e61843b98292f24f6485b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.883718  8427 tablet_bootstrap.cc:654] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.900386  8426 tablet_bootstrap.cc:654] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.910898  8428 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:56.928822  8428 tablet_bootstrap.cc:654] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.934077  8427 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:56.934590  8427 ts_tablet_manager.cc:1403] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.020s
I20260709 12:25:56.938961  8427 raft_consensus.cc:359] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:56.939731  8427 raft_consensus.cc:385] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.939996  8427 raft_consensus.cc:740] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.940634  8426 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:56.941193  8426 ts_tablet_manager.cc:1403] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.005s
I20260709 12:25:56.940675  8427 consensus_queue.cc:260] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:56.943065  8262 heartbeater.cc:499] Master 127.29.143.254:41381 was elected leader, sending a full tablet report...
I20260709 12:25:56.943364  8427 ts_tablet_manager.cc:1434] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:56.944188  8427 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:56.943908  8426 raft_consensus.cc:359] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:56.944639  8426 raft_consensus.cc:385] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.944955  8426 raft_consensus.cc:740] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.945832  8426 consensus_queue.cc:260] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:56.948345  8428 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:56.948858  8428 ts_tablet_manager.cc:1403] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 12:25:56.950731  8427 tablet_bootstrap.cc:654] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.951860  8411 heartbeater.cc:499] Master 127.29.143.254:41381 was elected leader, sending a full tablet report...
I20260709 12:25:56.954494  8426 ts_tablet_manager.cc:1434] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 12:25:56.955714  8426 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:56.957798  8428 raft_consensus.cc:359] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:56.958871  8428 raft_consensus.cc:385] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.959233  8428 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.960144  8428 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:56.963552  8426 tablet_bootstrap.cc:654] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.965162  8427 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:56.965898  8427 ts_tablet_manager.cc:1403] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 12:25:56.970070  8432 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.970571  8432 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:56.969820  8427 raft_consensus.cc:359] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:56.971534  8427 raft_consensus.cc:385] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.971688  8337 heartbeater.cc:499] Master 127.29.143.254:41381 was elected leader, sending a full tablet report...
I20260709 12:25:56.971876  8427 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.973285  8432 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:56.972971  8427 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:56.975562  8427 ts_tablet_manager.cc:1434] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:25:56.976951  8427 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:56.981930  8428 ts_tablet_manager.cc:1434] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.033s	user 0.013s	sys 0.004s
I20260709 12:25:56.983116  8428 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:56.984726  8427 tablet_bootstrap.cc:654] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.997148  8428 tablet_bootstrap.cc:654] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.017668  8428 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.018384  8428 ts_tablet_manager.cc:1403] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.003s
I20260709 12:25:57.022475  8428 raft_consensus.cc:359] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.030042  8428 raft_consensus.cc:385] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.030431  8428 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.033555  8428 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.040521  8426 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.040851  8428 ts_tablet_manager.cc:1434] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:25:57.041152  8426 ts_tablet_manager.cc:1403] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.086s	user 0.042s	sys 0.036s
I20260709 12:25:57.041954  8428 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.043097  8427 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.043650  8427 ts_tablet_manager.cc:1403] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.040s
I20260709 12:25:57.044292  8426 raft_consensus.cc:359] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.045048  8426 raft_consensus.cc:385] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.045504  8426 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.046267  8426 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.047477  8427 raft_consensus.cc:359] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.048261  8427 raft_consensus.cc:385] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.048702  8427 raft_consensus.cc:740] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.048332  8426 ts_tablet_manager.cc:1434] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:57.050244  8426 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
W20260709 12:25:57.051708  8412 tablet.cc:2406] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:57.057792  8428 tablet_bootstrap.cc:654] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.050766  8427 consensus_queue.cc:260] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.060559  8427 ts_tablet_manager.cc:1434] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:25:57.062112  8427 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:57.066298  8426 tablet_bootstrap.cc:654] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.070808  8428 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.071278  8428 ts_tablet_manager.cc:1403] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.012s
I20260709 12:25:57.074193  8427 tablet_bootstrap.cc:654] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.074263  8428 raft_consensus.cc:359] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.075464  8428 raft_consensus.cc:385] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.075918  8428 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.077550  8428 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.080196  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.082201  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
W20260709 12:25:57.082551  8201 leader_election.cc:343] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.082918  8386 raft_consensus.cc:2468] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.083424  8428 ts_tablet_manager.cc:1434] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:25:57.084444  8428 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.084295  8201 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:25:57.085790  8432 raft_consensus.cc:2804] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.086248  8432 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.086637  8432 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.091022  8428 tablet_bootstrap.cc:654] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.092782  8426 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.095219  8426 ts_tablet_manager.cc:1403] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.009s
I20260709 12:25:57.099226  8426 raft_consensus.cc:359] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.100149  8426 raft_consensus.cc:385] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.100451  8426 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.101394  8426 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.101867  8432 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:57.102975  8428 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.103569  8428 ts_tablet_manager.cc:1403] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 12:25:57.103596  8426 ts_tablet_manager.cc:1434] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:57.104705  8426 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.104803  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.105289  8427 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.105463  8386 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.105824  8427 ts_tablet_manager.cc:1403] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.015s
I20260709 12:25:57.107137  8428 raft_consensus.cc:359] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.107892  8428 raft_consensus.cc:385] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.108229  8428 raft_consensus.cc:740] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.108829  8427 raft_consensus.cc:359] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.109025  8428 consensus_queue.cc:260] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.109634  8427 raft_consensus.cc:385] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.110055  8427 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.110962  8427 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.111740  8426 tablet_bootstrap.cc:654] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.113931  8386 raft_consensus.cc:2468] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.117162  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.118623  8428 ts_tablet_manager.cc:1434] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
W20260709 12:25:57.119836  8201 leader_election.cc:343] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.121153  8201 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:25:57.124007  8428 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.125922  8432 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Requested vote from peers 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:57.131916  8428 tablet_bootstrap.cc:654] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.132387  8432 raft_consensus.cc:2804] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.132932  8432 raft_consensus.cc:697] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Becoming Leader. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Running, Role: LEADER
I20260709 12:25:57.133821  8432 consensus_queue.cc:237] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:57.139318  8447 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.139820  8447 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.142195  8447 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.144472  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.146927  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
W20260709 12:25:57.148629  8201 leader_election.cc:343] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:57.149499  8201 leader_election.cc:343] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.150049  8201 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:25:57.156123  8447 raft_consensus.cc:2749] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.160300  8428 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.160830  8428 ts_tablet_manager.cc:1403] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.002s
I20260709 12:25:57.163021  8427 ts_tablet_manager.cc:1434] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.057s	user 0.016s	sys 0.014s
I20260709 12:25:57.164287  8427 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
W20260709 12:25:57.164712  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:57.165426  8428 raft_consensus.cc:359] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:57.166204  8428 raft_consensus.cc:385] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.166251  8426 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.166599  8428 raft_consensus.cc:740] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.167057  8426 ts_tablet_manager.cc:1403] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.037s
I20260709 12:25:57.167639  8428 consensus_queue.cc:260] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:57.167668  8135 catalog_manager.cc:5697] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ed504ef86dcd4610b04ceadcf381e637" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.170051  8428 ts_tablet_manager.cc:1434] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:57.171080  8428 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.172132  8427 tablet_bootstrap.cc:654] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.173497  8426 raft_consensus.cc:359] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.174285  8426 raft_consensus.cc:385] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.174652  8426 raft_consensus.cc:740] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.175714  8426 consensus_queue.cc:260] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.178125  8426 ts_tablet_manager.cc:1434] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:25:57.179890  8428 tablet_bootstrap.cc:654] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.180830  8426 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.189199  8426 tablet_bootstrap.cc:654] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.193024  8428 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.193557  8428 ts_tablet_manager.cc:1403] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 12:25:57.196748  8427 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.196689  8428 raft_consensus.cc:359] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.197368  8427 ts_tablet_manager.cc:1403] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 12:25:57.197481  8428 raft_consensus.cc:385] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.197829  8428 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.198745  8428 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.200671  8427 raft_consensus.cc:359] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.201184  8428 ts_tablet_manager.cc:1434] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:25:57.201452  8427 raft_consensus.cc:385] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.201769  8427 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.202586  8427 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.203685  8428 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.205567  8427 ts_tablet_manager.cc:1434] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:57.206599  8427 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:57.210049  8435 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.210588  8435 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.212218  8428 tablet_bootstrap.cc:654] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.217121  8426 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.217645  8426 ts_tablet_manager.cc:1403] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.010s
I20260709 12:25:57.218101  8435 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.220690  8427 tablet_bootstrap.cc:654] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.225220  8426 raft_consensus.cc:359] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.226260  8426 raft_consensus.cc:385] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.226656  8426 raft_consensus.cc:740] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.227659  8426 consensus_queue.cc:260] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.230664  8426 ts_tablet_manager.cc:1434] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:25:57.232048  8426 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.249905  8433 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.250646  8433 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.256310  8433 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:57.275559  8433 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.276244  8433 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.279453  8433 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:57.251413  8426 tablet_bootstrap.cc:654] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.290577  8432 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.291330  8432 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.293910  8432 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.296439  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.297274  8386 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.298981  8201 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.300117  8432 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.300592  8432 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.301007  8432 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.309101  8445 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.309798  8445 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.311087  8432 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.313294  8445 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.314352  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.315042  8386 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.316246  8201 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.317225  8445 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.317610  8445 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.317967  8445 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.319672  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.320412  8312 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.321774  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.322415  8312 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.323714  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.323846  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.324319  8312 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.334132  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.335166  8311 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 0.
I20260709 12:25:57.335436  8312 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.336730  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.337285  8445 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.336913  8350 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:57.337960  8201 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.338551  8237 raft_consensus.cc:2393] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed0f57b9c640453ca3ad4ad0d8699044 in current term 1: Already voted for candidate ed504ef86dcd4610b04ceadcf381e637 in this term.
I20260709 12:25:57.338712  8433 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.339133  8448 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.339334  8433 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.339798  8448 raft_consensus.cc:697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Becoming Leader. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Running, Role: LEADER
I20260709 12:25:57.339902  8433 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.340816  8448 consensus_queue.cc:237] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
W20260709 12:25:57.346213  8350 leader_election.cc:343] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.354046  8428 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.354832  8428 ts_tablet_manager.cc:1403] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.153s	user 0.022s	sys 0.048s
I20260709 12:25:57.355403  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.356055  8386 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.359135  8428 raft_consensus.cc:359] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.360178  8428 raft_consensus.cc:385] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.360594  8428 raft_consensus.cc:740] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.351203  8433 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.361435  8134 catalog_manager.cc:5697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ed504ef86dcd4610b04ceadcf381e637" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.363559  8386 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.364923  8435 raft_consensus.cc:493] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.364619  8428 consensus_queue.cc:260] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.365686  8433 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:57.365438  8435 raft_consensus.cc:515] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.367884  8435 leader_election.cc:290] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.368846  8427 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.369648  8427 ts_tablet_manager.cc:1403] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.163s	user 0.066s	sys 0.080s
I20260709 12:25:57.369951  8432 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Requested vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.373421  8427 raft_consensus.cc:359] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.374218  8427 raft_consensus.cc:385] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.374600  8427 raft_consensus.cc:740] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.375519  8236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.375401  8427 consensus_queue.cc:260] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.376160  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.375447  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.377031  8235 raft_consensus.cc:2393] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a5d97b37f01480faf357aa92b772c06 in current term 1: Already voted for candidate ed504ef86dcd4610b04ceadcf381e637 in this term.
I20260709 12:25:57.377087  8310 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.377802  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.378276  8427 ts_tablet_manager.cc:1434] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:57.378571  8237 raft_consensus.cc:2393] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a5d97b37f01480faf357aa92b772c06 in current term 1: Already voted for candidate ed504ef86dcd4610b04ceadcf381e637 in this term.
I20260709 12:25:57.379525  8427 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
W20260709 12:25:57.377336  8351 leader_election.cc:343] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.380256  8351 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06; no voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:57.381052  8433 raft_consensus.cc:2749] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.381839  8435 raft_consensus.cc:493] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.382771  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.382331  8435 raft_consensus.cc:515] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.383646  8386 raft_consensus.cc:2393] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed0f57b9c640453ca3ad4ad0d8699044 in current term 1: Already voted for candidate 9a5d97b37f01480faf357aa92b772c06 in this term.
I20260709 12:25:57.385753  8310 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 1.
I20260709 12:25:57.386034  8426 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.386607  8426 ts_tablet_manager.cc:1403] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.000s
I20260709 12:25:57.388340  8427 tablet_bootstrap.cc:654] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.389688  8426 raft_consensus.cc:359] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.390440  8426 raft_consensus.cc:385] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.391027  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.392004  8350 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:57.395818  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.396478  8235 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.396661  8433 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.398515  8277 leader_election.cc:304] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.399932  8433 raft_consensus.cc:697] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:25:57.400871  8433 consensus_queue.cc:237] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.393018  8276 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044; no voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:57.393944  8435 leader_election.cc:290] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.404668  8426 raft_consensus.cc:740] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.404781  8435 raft_consensus.cc:2804] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.405196  8435 raft_consensus.cc:493] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.405553  8435 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.405648  8426 consensus_queue.cc:260] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.406709  8385 raft_consensus.cc:2468] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.409734  8426 ts_tablet_manager.cc:1434] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:25:57.410807  8426 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.394037  8445 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Requested vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.393966  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.395154  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.413694  8237 raft_consensus.cc:2468] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.415347  8277 leader_election.cc:304] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.420723  8428 ts_tablet_manager.cc:1434] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.066s	user 0.023s	sys 0.013s
I20260709 12:25:57.421746  8427 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.424364  8427 ts_tablet_manager.cc:1403] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.014s
I20260709 12:25:57.425637  8428 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.422467  8435 raft_consensus.cc:515] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.422997  8467 raft_consensus.cc:2804] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.427484  8467 raft_consensus.cc:493] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.427445  8427 raft_consensus.cc:359] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.428215  8467 raft_consensus.cc:3060] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.428503  8427 raft_consensus.cc:385] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.428839  8427 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.429590  8427 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.432212  8427 ts_tablet_manager.cc:1434] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:25:57.433267  8427 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:57.429630  8134 catalog_manager.cc:5697] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.434851  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.435554  8386 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.437366  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.439247  8471 raft_consensus.cc:2749] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.440387  8427 tablet_bootstrap.cc:654] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.440867  8310 raft_consensus.cc:2393] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed504ef86dcd4610b04ceadcf381e637 in current term 1: Already voted for candidate 9a5d97b37f01480faf357aa92b772c06 in this term.
I20260709 12:25:57.442785  8201 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:25:57.446923  8445 raft_consensus.cc:2749] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.447641  8428 tablet_bootstrap.cc:654] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.452219  8471 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.452917  8471 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.456694  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.457372  8237 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.458591  8277 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.458940  8428 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.459488  8428 ts_tablet_manager.cc:1403] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.006s
I20260709 12:25:57.459992  8471 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.460548  8471 raft_consensus.cc:2804] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.460888  8471 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.461223  8471 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.461135  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
W20260709 12:25:57.462706  8276 leader_election.cc:343] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.465797  8427 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.465909  8428 raft_consensus.cc:359] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.466598  8427 ts_tablet_manager.cc:1403] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.022s
I20260709 12:25:57.466827  8428 raft_consensus.cc:385] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.467163  8428 raft_consensus.cc:740] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.468436  8428 consensus_queue.cc:260] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.469189  8471 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.469990  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.469774  8427 raft_consensus.cc:359] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.470481  8428 ts_tablet_manager.cc:1434] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:57.470669  8427 raft_consensus.cc:385] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.470594  8386 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.472180  8427 raft_consensus.cc:740] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.472468  8428 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.472293  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.472761  8471 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.473132  8427 consensus_queue.cc:260] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
W20260709 12:25:57.473692  8276 leader_election.cc:343] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.475592  8427 ts_tablet_manager.cc:1434] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:57.476576  8427 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:57.480098  8428 tablet_bootstrap.cc:654] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.480268  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.480990  8237 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.482512  8427 tablet_bootstrap.cc:654] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.492129  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.492480  8386 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.492993  8428 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.492945  8235 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.493604  8428 ts_tablet_manager.cc:1403] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:25:57.493877  8276 leader_election.cc:304] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:57.494800  8471 raft_consensus.cc:2804] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.495276  8471 raft_consensus.cc:697] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:57.495790  8435 leader_election.cc:290] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.490658  8237 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.496091  8471 consensus_queue.cc:237] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.496721  8428 raft_consensus.cc:359] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.497393  8428 raft_consensus.cc:385] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.497644  8428 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.499719  8467 raft_consensus.cc:515] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.500370  8427 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.500895  8427 ts_tablet_manager.cc:1403] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.002s
I20260709 12:25:57.501026  8235 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.501284  8435 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.423678  8426 tablet_bootstrap.cc:654] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.501753  8435 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:57.504601  8427 raft_consensus.cc:359] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.502350  8277 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06
I20260709 12:25:57.506377  8474 raft_consensus.cc:2804] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.506184  8428 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.509099  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.509927  8385 raft_consensus.cc:3060] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.512212  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.513005  8386 raft_consensus.cc:2393] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed0f57b9c640453ca3ad4ad0d8699044 in current term 1: Already voted for candidate ed504ef86dcd4610b04ceadcf381e637 in this term.
I20260709 12:25:57.516990  8428 ts_tablet_manager.cc:1434] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 12:25:57.518332  8428 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: Bootstrap starting.
I20260709 12:25:57.505561  8427 raft_consensus.cc:385] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.523770  8427 raft_consensus.cc:740] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.524012  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.525043  8235 raft_consensus.cc:3060] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.522964  8237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.526611  8428 tablet_bootstrap.cc:654] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.527076  8427 consensus_queue.cc:260] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.527961  8474 raft_consensus.cc:697] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:57.528532  8385 raft_consensus.cc:2468] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.515825  8467 leader_election.cc:290] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.534373  8427 ts_tablet_manager.cc:1434] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 12:25:57.535826  8427 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:25:57.506291  8435 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531), ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799)
I20260709 12:25:57.540452  8276 leader_election.cc:304] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:57.533008  8474 consensus_queue.cc:237] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.540400  8277 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044; no voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:57.542140  8435 raft_consensus.cc:2804] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.542799  8435 raft_consensus.cc:697] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:57.543087  8480 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.544117  8435 consensus_queue.cc:237] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.548828  8427 tablet_bootstrap.cc:654] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.537807  8135 catalog_manager.cc:5697] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.555567  8426 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.556085  8426 ts_tablet_manager.cc:1403] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.000s
I20260709 12:25:57.559178  8426 raft_consensus.cc:359] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.559916  8426 raft_consensus.cc:385] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.560190  8426 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.554394  8480 raft_consensus.cc:2749] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.550084  8235 raft_consensus.cc:2468] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.575316  8445 consensus_queue.cc:1048] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.575547  8426 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.581532  8427 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: No bootstrap required, opened a new log
I20260709 12:25:57.578860  8428 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: No bootstrap required, opened a new log
I20260709 12:25:57.582068  8426 ts_tablet_manager.cc:1434] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:25:57.582398  8428 ts_tablet_manager.cc:1403] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.006s
I20260709 12:25:57.581754  8135 catalog_manager.cc:5697] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.583254  8426 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.582068  8427 ts_tablet_manager.cc:1403] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.006s
I20260709 12:25:57.583726  8135 catalog_manager.cc:5697] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.587090  8427 raft_consensus.cc:359] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.587798  8427 raft_consensus.cc:385] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.588086  8427 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.590271  8428 raft_consensus.cc:359] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.590998  8428 raft_consensus.cc:385] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.591281  8426 tablet_bootstrap.cc:654] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.591289  8428 raft_consensus.cc:740] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.592355  8428 consensus_queue.cc:260] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.592398  8427 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.594619  8427 ts_tablet_manager.cc:1434] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.004s
I20260709 12:25:57.595218  8428 ts_tablet_manager.cc:1434] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:57.598410  8426 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.598939  8426 ts_tablet_manager.cc:1403] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:25:57.601591  8426 raft_consensus.cc:359] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.602715  8426 raft_consensus.cc:385] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.603022  8426 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.603682  8426 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.605465  8426 ts_tablet_manager.cc:1434] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:57.606336  8426 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.606487  8448 consensus_queue.cc:1048] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.612136  8426 tablet_bootstrap.cc:654] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.614136  8445 raft_consensus.cc:493] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.614895  8445 raft_consensus.cc:515] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.618665  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.619591  8312 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.620628  8448 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.621299  8448 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.624505  8448 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.626809  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.627700  8386 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.629961  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.630810  8312 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.632876  8201 leader_election.cc:304] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.634894  8448 raft_consensus.cc:2804] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.635485  8448 raft_consensus.cc:493] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.635944  8448 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.636843  8426 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.637291  8426 ts_tablet_manager.cc:1403] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.011s
I20260709 12:25:57.634260  8201 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.639544  8426 raft_consensus.cc:359] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.640230  8426 raft_consensus.cc:385] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.640513  8426 raft_consensus.cc:740] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.640563  8447 raft_consensus.cc:2804] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.641160  8447 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.641325  8426 consensus_queue.cc:260] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.641672  8447 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.641757  8445 leader_election.cc:290] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.643450  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.648696  8386 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 0.
I20260709 12:25:57.649238  8474 raft_consensus.cc:493] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.649863  8426 ts_tablet_manager.cc:1434] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:25:57.649739  8474 raft_consensus.cc:515] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.651113  8426 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: Bootstrap starting.
I20260709 12:25:57.651917  8474 leader_election.cc:290] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.653555  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.654220  8235 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.655525  8447 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.657653  8447 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Requested vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.657827  8426 tablet_bootstrap.cc:654] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.658398  8277 leader_election.cc:304] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.659179  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.659818  8384 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.663190  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.663885  8383 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.667268  8474 raft_consensus.cc:2804] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.670305  8426 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: No bootstrap required, opened a new log
I20260709 12:25:57.670903  8426 ts_tablet_manager.cc:1403] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:25:57.670977  8448 raft_consensus.cc:515] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.673236  8448 leader_election.cc:290] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Requested vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.673840  8426 raft_consensus.cc:359] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.674518  8426 raft_consensus.cc:385] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.674815  8426 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.675596  8426 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.677534  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.678288  8311 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.678862  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.679543  8384 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.679562  8385 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.680811  8201 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.667718  8474 raft_consensus.cc:493] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.682283  8474 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.686187  8311 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.678284  8426 ts_tablet_manager.cc:1434] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:25:57.687040  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:57.687708  8312 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.688079  8201 leader_election.cc:304] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.688774  8385 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.688937  8432 raft_consensus.cc:2804] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.689499  8432 raft_consensus.cc:697] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Becoming Leader. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Running, Role: LEADER
I20260709 12:25:57.690524  8432 consensus_queue.cc:237] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.691185  8447 raft_consensus.cc:2804] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.691682  8447 raft_consensus.cc:697] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Becoming Leader. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Running, Role: LEADER
I20260709 12:25:57.692342  8447 consensus_queue.cc:237] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.699115  8474 raft_consensus.cc:515] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.702812  8474 leader_election.cc:290] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.704026  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.704452  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.704710  8235 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.705121  8384 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.702817  8312 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed504ef86dcd4610b04ceadcf381e637 in term 1.
I20260709 12:25:57.710992  8235 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.710768  8134 catalog_manager.cc:5697] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ed504ef86dcd4610b04ceadcf381e637" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.711998  8277 leader_election.cc:304] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.712656  8474 raft_consensus.cc:2804] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.713011  8384 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.713101  8474 raft_consensus.cc:697] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:57.712973  8134 catalog_manager.cc:5697] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "ed504ef86dcd4610b04ceadcf381e637" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.714401  8474 consensus_queue.cc:237] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.723224  8135 catalog_manager.cc:5697] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.738307  8474 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.738917  8474 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.740585  8474 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.741613  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.741628  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:57.742528  8235 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.742530  8384 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 0.
I20260709 12:25:57.743837  8276 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:57.744611  8474 raft_consensus.cc:2804] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.744992  8474 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.745263  8474 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.750170  8474 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.751670  8474 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:57.752581  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:25:57.752925  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:57.753101  8235 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.753552  8384 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.758141  8235 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.758533  8384 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:57.759379  8277 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:25:57.760222  8474 raft_consensus.cc:2804] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.760735  8474 raft_consensus.cc:697] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:57.761552  8474 consensus_queue.cc:237] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.768739  8135 catalog_manager.cc:5697] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.844435  8433 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.855686  8498 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:57.893890  8498 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.894332  8498 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:57.896018  8498 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:57.896874  8235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:25:57.897040  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:57.897828  8235 raft_consensus.cc:2393] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a5d97b37f01480faf357aa92b772c06 in current term 1: Already voted for candidate ed0f57b9c640453ca3ad4ad0d8699044 in this term.
I20260709 12:25:57.898793  8351 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06; no voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:57.899389  8498 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.904261  8498 raft_consensus.cc:2749] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.908387  8474 consensus_queue.cc:1048] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.916450  8447 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.922128  8474 consensus_queue.cc:1048] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.922518  8447 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.931679  8474 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:57.951357  8467 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.972133 30271 ts_manager.cc:295] Set tserver state for ed504ef86dcd4610b04ceadcf381e637 to MAINTENANCE_MODE
I20260709 12:25:57.973002 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
W20260709 12:25:57.992512  8277 consensus_peers.cc:597] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:58.002737 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:58.003684 30271 tablet_replica.cc:333] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.004650 30271 raft_consensus.cc:2243] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.005147 30271 raft_consensus.cc:2272] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.007368 30271 tablet_replica.cc:333] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.007926 30271 raft_consensus.cc:2243] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:58.008507 30271 pending_rounds.cc:70] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Trying to abort 1 pending ops.
I20260709 12:25:58.008662 30271 pending_rounds.cc:77] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625426709827584 op_type: NO_OP noop_request { }
I20260709 12:25:58.008996 30271 raft_consensus.cc:2889] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:58.009330 30271 raft_consensus.cc:2272] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.011418 30271 tablet_replica.cc:333] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.011982 30271 raft_consensus.cc:2243] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.012367 30271 raft_consensus.cc:2272] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.014040 30271 tablet_replica.cc:333] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.014668 30271 raft_consensus.cc:2243] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.015125 30271 raft_consensus.cc:2272] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.017189 30271 tablet_replica.cc:333] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.017732 30271 raft_consensus.cc:2243] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.018138 30271 raft_consensus.cc:2272] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.020298 30271 tablet_replica.cc:333] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.020838 30271 raft_consensus.cc:2243] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.021205 30271 raft_consensus.cc:2272] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.022846 30271 tablet_replica.cc:333] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.023351 30271 raft_consensus.cc:2243] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:58.024094 30271 raft_consensus.cc:2272] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.026244 30271 tablet_replica.cc:333] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.026788 30271 raft_consensus.cc:2243] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.027144 30271 raft_consensus.cc:2272] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.029021 30271 tablet_replica.cc:333] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.029475 30271 raft_consensus.cc:2243] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:58.030007 30271 pending_rounds.cc:70] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Trying to abort 1 pending ops.
I20260709 12:25:58.030158 30271 pending_rounds.cc:77] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625426715672576 op_type: NO_OP noop_request { }
I20260709 12:25:58.030407 30271 raft_consensus.cc:2889] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:58.030627 30271 raft_consensus.cc:2272] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.032713 30271 tablet_replica.cc:333] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: stopping tablet replica
I20260709 12:25:58.033135 30271 raft_consensus.cc:2243] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:58.033847 30271 raft_consensus.cc:2272] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.064713 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
I20260709 12:25:58.097957  8467 consensus_queue.cc:1048] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.165815  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:58.237891  8467 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.245795  8435 consensus_queue.cc:1048] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.254132  8277 consensus_peers.cc:597] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:58.260917  8277 consensus_peers.cc:597] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:58.349123  8351 consensus_peers.cc:597] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:58.393970  8277 consensus_peers.cc:597] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:58.421204  8277 consensus_peers.cc:597] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.112861  8467 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.113406  8467 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:59.115324  8467 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531), ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799)
I20260709 12:25:59.116231  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
W20260709 12:25:59.119179  8277 leader_election.cc:336] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.119485  8277 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044; no voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.120064  8467 raft_consensus.cc:2749] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:59.139946  8515 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.140447  8515 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:59.142117  8515 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.143232  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:59.143801  8312 raft_consensus.cc:2468] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 1.
I20260709 12:25:59.144770  8350 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:59.145423  8515 raft_consensus.cc:2804] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:59.145433  8351 leader_election.cc:336] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.145841  8515 raft_consensus.cc:493] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.146239  8515 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.151163  8515 raft_consensus.cc:515] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:25:59.152647  8515 leader_election.cc:290] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.153687  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd1ef78a8ed48e4a754576d3bf363ea" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:59.154250  8312 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:59.156347  8351 leader_election.cc:336] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.159101  8312 raft_consensus.cc:2468] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:25:59.160239  8350 leader_election.cc:304] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.160903  8515 raft_consensus.cc:2804] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.161381  8515 raft_consensus.cc:697] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:25:59.162142  8515 consensus_queue.cc:237] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
W20260709 12:25:59.166817  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:59.169361  8132 catalog_manager.cc:5697] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.447563  8467 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.448007  8467 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.449833  8467 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:59.450950  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
W20260709 12:25:59.451164  8277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111) [suppressed 113 similar messages]
W20260709 12:25:59.453790  8277 leader_election.cc:336] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.454150  8277 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044; no voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.454793  8467 raft_consensus.cc:2749] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:59.455569  8515 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.455999  8515 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.457573  8515 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.458554  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:59.459141  8312 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 1.
I20260709 12:25:59.460021  8350 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:59.460652  8515 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:59.460738  8351 leader_election.cc:336] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.460983  8515 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed504ef86dcd4610b04ceadcf381e637)
I20260709 12:25:59.461359  8515 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.466372  8515 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.467988  8515 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.469089  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:59.469717  8312 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:59.472077  8351 leader_election.cc:336] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.475818  8312 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:25:59.476938  8350 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.477727  8515 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.478157  8515 raft_consensus.cc:697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:25:59.478829  8515 consensus_queue.cc:237] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.486301  8132 catalog_manager.cc:5697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.665802  8515 raft_consensus.cc:493] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.666244  8515 raft_consensus.cc:515] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.668000  8515 leader_election.cc:290] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.669104  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:25:59.669778  8312 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 1.
I20260709 12:25:59.670778  8350 leader_election.cc:304] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:59.671418  8515 raft_consensus.cc:2804] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:59.671768  8515 raft_consensus.cc:493] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:59.671922  8351 leader_election.cc:336] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.672132  8515 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.677554  8515 raft_consensus.cc:515] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.679127  8515 leader_election.cc:290] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:25:59.680154  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efd8336cb5547f5ad265dacaa3710d4" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:25:59.680766  8312 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:59.682274  8351 leader_election.cc:336] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.684258  8467 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.684660  8467 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.685722  8312 raft_consensus.cc:2468] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:25:59.686285  8467 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:59.687047  8350 leader_election.cc:304] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.687408  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:25:59.688089  8385 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:25:59.688534  8515 raft_consensus.cc:2804] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.689054  8515 raft_consensus.cc:697] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:25:59.689070  8276 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:25:59.689998  8467 raft_consensus.cc:2804] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:59.690188  8277 leader_election.cc:336] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.690512  8467 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.690027  8515 consensus_queue.cc:237] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.690961  8467 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.697199  8467 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.698348  8132 catalog_manager.cc:5697] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.700147  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:25:59.699121  8467 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:25:59.700759  8385 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:59.703238  8277 leader_election.cc:336] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111)
I20260709 12:25:59.706972  8385 raft_consensus.cc:2468] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 2.
I20260709 12:25:59.708040  8276 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:25:59.708245  8312 raft_consensus.cc:1275] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.708841  8467 raft_consensus.cc:2804] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.709623  8515 consensus_queue.cc:1048] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.709978  8467 raft_consensus.cc:697] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:25:59.710865  8467 consensus_queue.cc:237] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:25:59.718585  8132 catalog_manager.cc:5697] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 1 to 2, leader changed from ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:59.724619  8351 consensus_peers.cc:597] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.902803  8312 raft_consensus.cc:1275] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.904127  8515 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:59.916488  8351 consensus_peers.cc:597] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.117648  8351 consensus_peers.cc:597] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.167917  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:00.189199  8385 raft_consensus.cc:1275] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:00.190423  8467 consensus_queue.cc:1048] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:00.204317  8277 consensus_peers.cc:597] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.307368  8312 raft_consensus.cc:1275] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:00.308614  8531 consensus_queue.cc:1048] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:00.619364  8277 consensus_peers.cc:597] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:00.685339  8277 consensus_peers.cc:597] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:00.723858  8277 consensus_peers.cc:597] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:00.867726  8277 consensus_peers.cc:597] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:00.889747  8351 consensus_peers.cc:597] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:00.905478  8277 consensus_peers.cc:597] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:01.169153  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:02.124372  8351 consensus_peers.cc:597] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:02.170634  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:02.468067  8351 consensus_peers.cc:597] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:02.556216  8277 consensus_peers.cc:597] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:02.727810  8351 consensus_peers.cc:597] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:03.083467 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.092505  8277 consensus_peers.cc:597] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:03.093007  8539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.093233  8540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.096022  8542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.097540 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:03.099723 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.099956 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.100162 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599963100140 us; error 0 us; skew 500 ppm
I20260709 12:26:03.100795 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.103824 30271 webserver.cc:533] Webserver started at http://127.29.143.193:43749/ using document root <none> and password file <none>
I20260709 12:26:03.104421 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.104609 30271 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:03.108865 30271 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:03.113902  8547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.114869 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:26:03.115275 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "ed504ef86dcd4610b04ceadcf381e637"
format_stamp: "Formatted at 2026-07-09 12:25:56 on dist-test-slave-9k85"
I20260709 12:26:03.115692 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.138859 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.140453 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.142206 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.146525  8554 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:26:03.171912  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:03.204875 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:26:03.205314 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:26:03.205649 30271 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:26:03.211328  8554 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.224606  8554 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:03.225416  8554 tablet_bootstrap.cc:492] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.225979  8554 ts_tablet_manager.cc:1403] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:26:03.228309  8554 raft_consensus.cc:359] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.229333  8554 raft_consensus.cc:740] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.230093  8554 consensus_queue.cc:260] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.232502  8554 ts_tablet_manager.cc:1434] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.007s
I20260709 12:26:03.233232  8554 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.244570  8554 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.245347  8554 tablet_bootstrap.cc:492] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.245498 30271 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:26:03.245847 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.035s	sys 0.003s
I20260709 12:26:03.246098  8554 ts_tablet_manager.cc:1403] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:03.248778  8554 raft_consensus.cc:359] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.249344  8554 raft_consensus.cc:740] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.250018  8554 consensus_queue.cc:260] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.251572  8554 ts_tablet_manager.cc:1434] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:03.252225  8554 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.265097  8554 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.265833  8554 tablet_bootstrap.cc:492] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.267073  8554 ts_tablet_manager.cc:1403] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:26:03.269678  8554 raft_consensus.cc:359] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.270366  8554 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.271063  8554 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.272789  8554 ts_tablet_manager.cc:1434] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:26:03.273489  8554 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.286422  8554 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.287216  8554 tablet_bootstrap.cc:492] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.287745  8554 ts_tablet_manager.cc:1403] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:26:03.289693  8554 raft_consensus.cc:359] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.290198  8554 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.290841  8554 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.292435  8554 ts_tablet_manager.cc:1434] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:03.293098  8554 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.306948  8554 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.307899  8554 tablet_bootstrap.cc:492] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.308431  8554 ts_tablet_manager.cc:1403] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:26:03.310562  8554 raft_consensus.cc:359] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.311173  8554 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.311846  8554 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.313300  8554 ts_tablet_manager.cc:1434] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:03.313939  8554 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.314147 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:42799
I20260709 12:26:03.314286  8616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:42799 every 8 connection(s)
I20260709 12:26:03.320696 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.336822  8554 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.337924  8554 tablet_bootstrap.cc:492] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.338492  8554 ts_tablet_manager.cc:1403] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 12:26:03.342029  8554 raft_consensus.cc:359] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:26:03.342844  8554 raft_consensus.cc:740] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.344271  8617 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41381
I20260709 12:26:03.344208  8554 consensus_queue.cc:260] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } } peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } }
I20260709 12:26:03.344782  8617 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.345852  8617 heartbeater.cc:507] Master 127.29.143.254:41381 requested a full tablet report, sending...
I20260709 12:26:03.346448  8554 ts_tablet_manager.cc:1434] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:26:03.347321  8554 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.354110  8133 ts_manager.cc:194] Re-registered known tserver with Master: ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799)
I20260709 12:26:03.354230  8312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:03.355103  8312 raft_consensus.cc:606] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:03.358332  8312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:03.358974  8312 raft_consensus.cc:606] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:03.361821 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:03.362488 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.363343 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.363340  8554 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.365859  8554 tablet_bootstrap.cc:492] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.366514  8554 ts_tablet_manager.cc:1403] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:26:03.368319  8133 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45388
I20260709 12:26:03.369354  8554 raft_consensus.cc:359] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.370143  8554 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.370855  8554 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.372143  8617 heartbeater.cc:499] Master 127.29.143.254:41381 was elected leader, sending a full tablet report...
I20260709 12:26:03.372885  8554 ts_tablet_manager.cc:1434] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:26:03.373703  8554 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.389431  8554 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:03.390554  8554 tablet_bootstrap.cc:492] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.391244  8554 ts_tablet_manager.cc:1403] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:26:03.393694  8554 raft_consensus.cc:359] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.394352  8554 raft_consensus.cc:740] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.395061  8554 consensus_queue.cc:260] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.397107  8554 ts_tablet_manager.cc:1434] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:03.398811  8554 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.412870  8554 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.413615  8554 tablet_bootstrap.cc:492] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.414151  8554 ts_tablet_manager.cc:1403] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:26:03.416105  8554 raft_consensus.cc:359] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.416615  8554 raft_consensus.cc:740] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.417140  8554 consensus_queue.cc:260] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.418835  8554 ts_tablet_manager.cc:1434] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.002s
I20260709 12:26:03.419521  8554 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap starting.
I20260709 12:26:03.434262  8554 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.436403  8554 tablet_bootstrap.cc:492] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Bootstrap complete.
I20260709 12:26:03.437232  8554 ts_tablet_manager.cc:1403] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:26:03.440439  8591 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.440301  8554 raft_consensus.cc:359] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.441063  8554 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed504ef86dcd4610b04ceadcf381e637, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.441854  8554 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.444057  8554 ts_tablet_manager.cc:1434] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:03.506517  8591 raft_consensus.cc:3060] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.535558  8591 raft_consensus.cc:3060] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.541111  8591 pending_rounds.cc:85] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Aborting all ops after (but not including) 0
I20260709 12:26:03.541332  8591 pending_rounds.cc:107] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:03.541627  8591 raft_consensus.cc:2889] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.689184  8591 raft_consensus.cc:3060] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.694481  8591 pending_rounds.cc:85] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Aborting all ops after (but not including) 0
I20260709 12:26:03.694761  8591 pending_rounds.cc:107] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:03.695003  8591 raft_consensus.cc:2889] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.826455  8638 raft_consensus.cc:993] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:03.827035  8638 raft_consensus.cc:1081] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:03.828769  8385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:03.829303  8385 raft_consensus.cc:493] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.829625  8385 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.836172  8385 raft_consensus.cc:515] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.838920  8385 leader_election.cc:290] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:03.840166  8591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:03.841218  8591 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:03.842820  8638 raft_consensus.cc:993] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:03.843680  8538 raft_consensus.cc:1081] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:03.843537  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:03.849833  8312 raft_consensus.cc:3055] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:03.850303  8312 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:03.851505  8312 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:03.861049  8591 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:03.863984  8351 leader_election.cc:304] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:04.571578  8312 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:04.579439  8312 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:04.593401  8631 raft_consensus.cc:2804] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:04.594906  8631 raft_consensus.cc:697] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:04.596274  8631 consensus_queue.cc:237] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
W20260709 12:26:04.593315  8351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.193:42799, user_credentials={real_user=slave}} blocked reactor thread for 729488us
I20260709 12:26:04.821628  8640 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:04.822435  8640 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:04.828011 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.826613  8640 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:04.865090  8640 raft_consensus.cc:493] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:04.866092  8640 raft_consensus.cc:515] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:04.870841  8640 leader_election.cc:290] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:04.914260  8587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:26:04.917037  8587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:26:04.964378  8644 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a5d97b37f01480faf357aa92b772c06)
I20260709 12:26:04.965193  8644 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:04.968111  8644 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.073158  8645 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9a5d97b37f01480faf357aa92b772c06)
I20260709 12:26:05.080060  8645 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.075564  8646 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a5d97b37f01480faf357aa92b772c06)
W20260709 12:26:05.078372  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:05.081545  8588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:26:05.083681  8649 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:05.084358  8649 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.074971  8647 raft_consensus.cc:493] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:05.084903  8650 raft_consensus.cc:493] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:05.085487  8647 raft_consensus.cc:515] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.085592  8650 raft_consensus.cc:515] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.087175  8133 catalog_manager.cc:5697] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.088268  8647 leader_election.cc:290] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.090721  8649 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.091392  8650 leader_election.cc:290] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.080070  8648 raft_consensus.cc:493] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:05.095506  8385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:05.081606  8646 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.096714  8385 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:05.097054  8588 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 1.
I20260709 12:26:05.097332  8385 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.100179  8646 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.100764  8648 raft_consensus.cc:515] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.105682  8648 leader_election.cc:290] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.109081  8645 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.109447  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.110260  8385 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.115439  8640 raft_consensus.cc:493] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed0f57b9c640453ca3ad4ad0d8699044)
I20260709 12:26:05.118609  8640 raft_consensus.cc:515] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.121515  8640 leader_election.cc:290] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:05.117698  8587 raft_consensus.cc:1275] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.126282  8587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637" is_pre_election: true
I20260709 12:26:05.128543  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.129568  8640 consensus_queue.cc:1048] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.131486  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.114174  8591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:05.134805  8591 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.139225  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.147215  8350 leader_election.cc:304] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06; no voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:26:05.149186  8536 raft_consensus.cc:2749] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.161332  8350 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06; no voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:26:05.165422  8536 raft_consensus.cc:2749] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.183496  8350 leader_election.cc:304] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06; no voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637
I20260709 12:26:05.184425  8591 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:05.185418  8536 raft_consensus.cc:2749] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.185670  8351 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:05.178121  8385 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:05.186708  8642 raft_consensus.cc:2804] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:05.187235  8642 raft_consensus.cc:697] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:05.194778  8642 consensus_queue.cc:237] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.196573  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:05.197311  8310 raft_consensus.cc:3055] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:05.197638  8310 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:05.208019  8312 raft_consensus.cc:1275] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.198840  8310 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.207952  8277 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:05.211930  8631 consensus_queue.cc:1048] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.212267  8657 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:05.212610  8310 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.212699  8657 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a5d97b37f01480faf357aa92b772c06)
I20260709 12:26:05.213285  8657 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.219766  8589 raft_consensus.cc:1240] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Rejecting Update request from peer ed0f57b9c640453ca3ad4ad0d8699044 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:05.225714  8384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.226406  8381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.227001  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.228363  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.229905  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.236568  8385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06" is_pre_election: true
I20260709 12:26:05.249464  8309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:05.250212  8309 raft_consensus.cc:606] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:05.245091  8310 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:05.254637  8309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:05.255576  8309 raft_consensus.cc:606] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:05.256027  8309 raft_consensus.cc:614] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:05.257169 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:05.254201  8657 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.257807 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:05.258239  8311 raft_consensus.cc:1240] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Rejecting Update request from peer 9a5d97b37f01480faf357aa92b772c06 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:05.258641 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.262971  8642 consensus_queue.cc:1059] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.264421  8666 raft_consensus.cc:3055] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:05.264775  8666 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:05.265648  8666 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.267081  8666 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.267869  8383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:05.274118  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:05.276779  8657 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:05.280194  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7e35937db848ef8a9625d004e0af76" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.280889  8310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.282303  8549 leader_election.cc:304] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.283232  8645 raft_consensus.cc:2749] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.283779  8549 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.283252  8308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.284269  8309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.281693  8312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0383446c97884aec962c3fbff02258ec" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.289196  8549 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.289961  8648 raft_consensus.cc:2749] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.290613  8648 raft_consensus.cc:2749] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.291853  8549 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.292512  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "ed504ef86dcd4610b04ceadcf381e637" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" is_pre_election: true
I20260709 12:26:05.292758  8645 raft_consensus.cc:2749] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.293198  8549 leader_election.cc:304] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.293996  8645 raft_consensus.cc:2749] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:05.294077  8383 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 2.
I20260709 12:26:05.295027  8549 leader_election.cc:304] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed504ef86dcd4610b04ceadcf381e637; no voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:05.295782  8645 raft_consensus.cc:2749] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:05.297883  8276 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: ed504ef86dcd4610b04ceadcf381e637
I20260709 12:26:05.298748  8657 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:05.299264  8657 raft_consensus.cc:697] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:05.300161  8657 consensus_queue.cc:237] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.301316  8135 catalog_manager.cc:5697] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.310644  8132 catalog_manager.cc:5697] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 1 to 2, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 2 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.603808  8586 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.604990  8666 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:05.609360  8613 debug-util.cc:398] Leaking SignalData structure 0x7b0800138060 after lost signal to thread 30274
W20260709 12:26:05.610726  8613 debug-util.cc:398] Leaking SignalData structure 0x7b0800227900 after lost signal to thread 8169
I20260709 12:26:05.613797  8311 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:05.614282  8613 debug-util.cc:398] Leaking SignalData structure 0x7b080010c220 after lost signal to thread 8616
I20260709 12:26:05.615314  8666 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.647971  8657 raft_consensus.cc:993] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:05.648494  8657 raft_consensus.cc:1081] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:05.650362  8383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:05.650915  8383 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:05.651278  8383 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.656757  8383 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.658339  8383 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:05.659257  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:05.659425  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:05.659965  8586 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.660365  8311 raft_consensus.cc:3055] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:05.660672  8311 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:05.661403  8311 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.662861  8311 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.668613  8586 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:05.668665  8311 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:05.670011  8351 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:05.670712  8666 raft_consensus.cc:2804] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:05.671214  8666 raft_consensus.cc:697] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:05.672472  8666 consensus_queue.cc:237] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:05.680430  8132 catalog_manager.cc:5697] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.711127  8586 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:05.716594  8586 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.717896  8657 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.729823  8383 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:05.731541  8657 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:06.082257  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:06.139446  8311 raft_consensus.cc:1275] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:06.141811  8666 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.153110  8586 raft_consensus.cc:1275] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:06.154918  8666 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.269877 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.288607  8383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
mode: GRACEFUL
new_leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:47832
I20260709 12:26:06.289266  8383 raft_consensus.cc:606] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Received request to transfer leadership to TS ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:06.291960  8383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
mode: GRACEFUL
new_leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:47832
I20260709 12:26:06.292575  8383 raft_consensus.cc:606] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Received request to transfer leadership to TS ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:06.295099  8311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c962f707404b40b593f912f68db1b344"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:06.295691  8311 raft_consensus.cc:606] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:06.296906 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:06.297422 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.297983 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.646858  8666 raft_consensus.cc:993] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: : Instructing follower ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:06.647292  8679 raft_consensus.cc:1081] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Signalling peer ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:06.649806  8311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:42012
I20260709 12:26:06.650596  8311 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.651083  8311 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.653288  8681 raft_consensus.cc:993] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:06.653895  8681 raft_consensus.cc:1081] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:06.654512  8679 raft_consensus.cc:993] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: : Instructing follower ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:06.655125  8679 raft_consensus.cc:1081] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Signalling peer ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:06.657433  8312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:42012
I20260709 12:26:06.658039  8312 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.658396  8312 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.662319  8383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c962f707404b40b593f912f68db1b344"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:06.662890  8311 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.663614  8383 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:06.664193  8383 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.666410  8589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:06.667238  8589 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.668377  8312 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.669402  8386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:06.670101  8386 raft_consensus.cc:3055] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:06.670507  8386 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:06.671793  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:06.671586  8386 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.672452  8586 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.672865  8386 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.678917  8311 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:06.682653  8312 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:06.684131  8586 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:06.684373  8383 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.685127  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:06.685721  8382 raft_consensus.cc:3055] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:06.686131  8382 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:06.685606  8277 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:06.688231  8383 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 3 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:06.686975  8382 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.688723  8663 raft_consensus.cc:2804] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.689219  8663 raft_consensus.cc:697] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:06.689296  8382 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.690101  8663 consensus_queue.cc:237] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.691452  8386 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:06.687819  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:06.678911  8589 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:06.694011  8586 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.694622  8277 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:06.696177  8681 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.697280  8382 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:06.698879  8681 raft_consensus.cc:697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:06.700001  8681 consensus_queue.cc:237] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.702616  8586 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 3.
I20260709 12:26:06.704105  8351 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:06.704281  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:06.705019  8311 raft_consensus.cc:3055] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:06.705390  8311 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:06.706319  8311 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.708066  8311 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:06.708861  8679 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:06.709465  8679 raft_consensus.cc:697] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:06.710894  8679 consensus_queue.cc:237] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:06.710994  8135 catalog_manager.cc:5697] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 2 to 3, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.716894  8311 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 3.
I20260709 12:26:06.719292  8132 catalog_manager.cc:5697] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 2 to 3, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.736843  8132 catalog_manager.cc:5697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 2 to 3, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:07.083339  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:07.166728  8586 raft_consensus.cc:1275] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.168313  8681 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.184230  8382 raft_consensus.cc:1275] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.186167  8685 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.196254  8383 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.197942  8685 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.207753  8586 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.209249  8681 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.267098  8311 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.268364  8679 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.279572  8586 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:07.281365  8679 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.304867 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.313158  8311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:07.313875  8311 raft_consensus.cc:606] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:07.316915  8311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:07.317420  8311 raft_consensus.cc:606] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:07.319944  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c962f707404b40b593f912f68db1b344"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
mode: GRACEFUL
new_leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:47832
I20260709 12:26:07.320581  8382 raft_consensus.cc:606] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 LEADER]: Received request to transfer leadership to TS ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:07.321951 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:07.322465 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:07.323092 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.332398  8663 raft_consensus.cc:993] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:07.332988  8681 raft_consensus.cc:1081] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:07.334661  8382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:07.335177  8382 raft_consensus.cc:493] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.335489  8382 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.340543  8382 raft_consensus.cc:515] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.342082  8382 leader_election.cc:290] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:07.343101  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:07.343160  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987d7b24470c476ba02db74faf1aa8c2" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:07.343912  8311 raft_consensus.cc:3055] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:07.344255  8311 raft_consensus.cc:740] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:07.344429  8586 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.345230  8311 consensus_queue.cc:260] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.346721  8311 raft_consensus.cc:3060] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:07.349697  8586 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:07.350891  8351 leader_election.cc:304] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:07.351570  8679 raft_consensus.cc:2804] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:07.352011  8679 raft_consensus.cc:697] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:07.352867  8679 consensus_queue.cc:237] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.355221  8311 raft_consensus.cc:2468] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 2.
I20260709 12:26:07.368907  8135 catalog_manager.cc:5697] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 1 to 2, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.659291  8681 raft_consensus.cc:993] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:07.659826  8663 raft_consensus.cc:1081] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:07.661454  8382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:07.661991  8382 raft_consensus.cc:493] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.662340  8382 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.672825  8382 raft_consensus.cc:515] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.675964  8382 leader_election.cc:290] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 4 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:07.676617  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:07.676934  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9ece10e61843b98292f24f6485b497" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:07.677476  8586 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.677699  8311 raft_consensus.cc:3055] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:07.678206  8311 raft_consensus.cc:740] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:07.679018  8311 consensus_queue.cc:260] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.680097  8311 raft_consensus.cc:3060] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.686043  8311 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 4.
I20260709 12:26:07.686373  8586 raft_consensus.cc:2468] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 4.
I20260709 12:26:07.687090  8350 leader_election.cc:304] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:26:07.687915  8679 raft_consensus.cc:2804] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:07.688390  8679 raft_consensus.cc:697] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 4 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:07.689230  8679 consensus_queue.cc:237] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.696241  8135 catalog_manager.cc:5697] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 3 to 4, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 4 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.711118  8702 raft_consensus.cc:993] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: : Instructing follower ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:07.711606  8679 raft_consensus.cc:1081] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 LEADER]: Signalling peer ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:07.713443  8311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c962f707404b40b593f912f68db1b344"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:42012
I20260709 12:26:07.714071  8311 raft_consensus.cc:493] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.714444  8311 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.723315  8311 raft_consensus.cc:515] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.725901  8311 leader_election.cc:290] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 4 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:07.726712  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:07.727429  8586 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.727324  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c962f707404b40b593f912f68db1b344" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:07.728212  8382 raft_consensus.cc:3055] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:07.728689  8382 raft_consensus.cc:740] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:07.729722  8382 consensus_queue.cc:260] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.731537  8382 raft_consensus.cc:3060] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:07.733469  8586 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 4.
I20260709 12:26:07.734531  8277 leader_election.cc:304] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:07.735256  8681 raft_consensus.cc:2804] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:07.735709  8681 raft_consensus.cc:697] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:07.736526  8681 consensus_queue.cc:237] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:07.740650  8382 raft_consensus.cc:2468] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 4.
I20260709 12:26:07.744367  8135 catalog_manager.cc:5697] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 3 to 4, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 4 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.763860  8311 raft_consensus.cc:1275] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:07.765367  8679 consensus_queue.cc:1048] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:07.777334  8586 raft_consensus.cc:1275] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:07.778558  8701 consensus_queue.cc:1048] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:08.084270  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:08.147408  8586 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:08.148957  8701 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.159759  8311 raft_consensus.cc:1275] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:08.161276  8702 consensus_queue.cc:1048] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.238938  8382 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:08.240408  8681 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.254590  8586 raft_consensus.cc:1275] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:08.257849  8710 consensus_queue.cc:1048] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.330080 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.337462  8311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
mode: GRACEFUL
new_leader_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:40914
I20260709 12:26:08.338165  8311 raft_consensus.cc:606] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Received request to transfer leadership to TS 9a5d97b37f01480faf357aa92b772c06
I20260709 12:26:08.341784  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
mode: GRACEFUL
new_leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:47832
I20260709 12:26:08.342357  8382 raft_consensus.cc:606] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Received request to transfer leadership to TS ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:08.345117  8382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
mode: GRACEFUL
new_leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:47832
I20260709 12:26:08.345609  8382 raft_consensus.cc:606] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Received request to transfer leadership to TS ed0f57b9c640453ca3ad4ad0d8699044
I20260709 12:26:08.346781 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:08.347381 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.347949 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.418151  8701 raft_consensus.cc:993] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: : Instructing follower ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:08.418772  8702 raft_consensus.cc:1081] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Signalling peer ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:08.420475  8311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:42012
I20260709 12:26:08.421093  8311 raft_consensus.cc:493] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.421468  8311 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.429769  8311 raft_consensus.cc:515] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.432068  8311 leader_election.cc:290] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:08.432638  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:08.433174  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3435adc93a2249b786e06b0e30e1fd52" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:08.433362  8586 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.433818  8382 raft_consensus.cc:3055] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:08.434227  8382 raft_consensus.cc:740] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:08.435109  8382 consensus_queue.cc:260] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.436460  8382 raft_consensus.cc:3060] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.438743  8586 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:08.439942  8277 leader_election.cc:304] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:08.440586  8710 raft_consensus.cc:2804] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:08.441099  8710 raft_consensus.cc:697] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:08.441869  8710 consensus_queue.cc:237] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.444159  8382 raft_consensus.cc:2468] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:08.449738  8135 catalog_manager.cc:5697] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 2 to 3, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.636997  8701 raft_consensus.cc:993] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: : Instructing follower ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:08.637540  8701 raft_consensus.cc:1081] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Signalling peer ed0f57b9c640453ca3ad4ad0d8699044 to start an election
I20260709 12:26:08.639293  8311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721"
dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
 from {username='slave'} at 127.0.0.1:42012
I20260709 12:26:08.639887  8311 raft_consensus.cc:493] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.640280  8311 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.647662  8311 raft_consensus.cc:515] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.649694  8311 leader_election.cc:290] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195:42531)
I20260709 12:26:08.650070  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:08.650341  8382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63109c99daaf4527ac9c84dfe7a7b721" candidate_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
I20260709 12:26:08.650786  8586 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.651098  8382 raft_consensus.cc:3055] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:08.651490  8382 raft_consensus.cc:740] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:08.652251  8382 consensus_queue.cc:260] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.653290  8382 raft_consensus.cc:3060] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:08.657986  8586 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:08.658912  8382 raft_consensus.cc:2468] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed0f57b9c640453ca3ad4ad0d8699044 in term 3.
I20260709 12:26:08.659173  8277 leader_election.cc:304] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ed0f57b9c640453ca3ad4ad0d8699044, ed504ef86dcd4610b04ceadcf381e637; no voters: 
I20260709 12:26:08.660027  8681 raft_consensus.cc:2804] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:08.660573  8681 raft_consensus.cc:697] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Leader. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:08.661379  8681 consensus_queue.cc:237] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.669935  8135 catalog_manager.cc:5697] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 reported cstate change: term changed from 2 to 3, leader changed from 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195) to ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194). New cstate: current_term: 3 leader_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.784642  8710 raft_consensus.cc:993] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: : Instructing follower 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:08.785121  8681 raft_consensus.cc:1081] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Signalling peer 9a5d97b37f01480faf357aa92b772c06 to start an election
I20260709 12:26:08.786890  8382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26"
dest_uuid: "9a5d97b37f01480faf357aa92b772c06"
 from {username='slave'} at 127.0.0.1:36418
I20260709 12:26:08.787405  8382 raft_consensus.cc:493] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.787705  8382 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:08.792725  8382 raft_consensus.cc:515] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.794389  8382 leader_election.cc:290] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 4 election: Requested vote from peers ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799), ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517)
I20260709 12:26:08.795262  8586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed504ef86dcd4610b04ceadcf381e637"
I20260709 12:26:08.795449  8311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c611c0bf1364a1ebf6b2f0b07e98a26" candidate_uuid: "9a5d97b37f01480faf357aa92b772c06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed0f57b9c640453ca3ad4ad0d8699044"
I20260709 12:26:08.795935  8586 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:08.796254  8311 raft_consensus.cc:3055] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:08.796547  8311 raft_consensus.cc:740] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed0f57b9c640453ca3ad4ad0d8699044, State: Running, Role: LEADER
I20260709 12:26:08.797174  8311 consensus_queue.cc:260] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.798079  8311 raft_consensus.cc:3060] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:08.802736  8311 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 4.
I20260709 12:26:08.803011  8586 raft_consensus.cc:2468] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a5d97b37f01480faf357aa92b772c06 in term 4.
I20260709 12:26:08.803865  8350 leader_election.cc:304] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a5d97b37f01480faf357aa92b772c06, ed0f57b9c640453ca3ad4ad0d8699044; no voters: 
I20260709 12:26:08.804740  8702 raft_consensus.cc:2804] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:08.805238  8702 raft_consensus.cc:697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 4 LEADER]: Becoming Leader. State: Replica: 9a5d97b37f01480faf357aa92b772c06, State: Running, Role: LEADER
I20260709 12:26:08.806068  8702 consensus_queue.cc:237] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } }
I20260709 12:26:08.814635  8135 catalog_manager.cc:5697] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 reported cstate change: term changed from 3 to 4, leader changed from ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194) to 9a5d97b37f01480faf357aa92b772c06 (127.29.143.195). New cstate: current_term: 4 leader_uuid: "9a5d97b37f01480faf357aa92b772c06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.953995  8382 raft_consensus.cc:1275] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:08.955696  8681 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.971961  8586 raft_consensus.cc:1275] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:08.973459  8685 consensus_queue.cc:1048] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:09.085173  8183 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:09.108639  8382 raft_consensus.cc:1275] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:09.110060  8685 consensus_queue.cc:1048] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a5d97b37f01480faf357aa92b772c06" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:09.122400  8586 raft_consensus.cc:1275] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Refusing update from remote peer ed0f57b9c640453ca3ad4ad0d8699044: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:09.125837  8710 consensus_queue.cc:1048] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:09.217891  8311 raft_consensus.cc:1275] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:09.219592  8702 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed0f57b9c640453ca3ad4ad0d8699044" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 40517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:09.234731  8586 raft_consensus.cc:1275] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Refusing update from remote peer 9a5d97b37f01480faf357aa92b772c06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:09.237098  8726 consensus_queue.cc:1048] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed504ef86dcd4610b04ceadcf381e637" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 42799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:09.355407 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.387293 30271 tablet_server.cc:179] TabletServer@127.29.143.193:42799 shutting down...
W20260709 12:26:09.413137  8351 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
W20260709 12:26:09.418912  8351 consensus_peers.cc:597] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.426168 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:09.427201 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.428009 30271 raft_consensus.cc:2243] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.428589 30271 raft_consensus.cc:2272] T 987d7b24470c476ba02db74faf1aa8c2 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:09.429337  8277 consensus_peers.cc:597] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.430814 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.431479 30271 raft_consensus.cc:2243] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.431938 30271 raft_consensus.cc:2272] T 0383446c97884aec962c3fbff02258ec P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.434361 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.435015 30271 raft_consensus.cc:2243] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.435487 30271 raft_consensus.cc:2272] T 4b9ece10e61843b98292f24f6485b497 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.437484 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.438066 30271 raft_consensus.cc:2243] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.438526 30271 raft_consensus.cc:2272] T c962f707404b40b593f912f68db1b344 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.440506 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.441063 30271 raft_consensus.cc:2243] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.441483 30271 raft_consensus.cc:2272] T 3435adc93a2249b786e06b0e30e1fd52 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.443960 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.444547 30271 raft_consensus.cc:2243] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.444969 30271 raft_consensus.cc:2272] T 2e7e35937db848ef8a9625d004e0af76 P ed504ef86dcd4610b04ceadcf381e637 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.446841 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.447369 30271 raft_consensus.cc:2243] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.447803 30271 raft_consensus.cc:2272] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed504ef86dcd4610b04ceadcf381e637 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.450198 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.450883 30271 raft_consensus.cc:2243] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.451354 30271 raft_consensus.cc:2272] T ddd1ef78a8ed48e4a754576d3bf363ea P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.453205 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.453715 30271 raft_consensus.cc:2243] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.454164 30271 raft_consensus.cc:2272] T 63109c99daaf4527ac9c84dfe7a7b721 P ed504ef86dcd4610b04ceadcf381e637 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.456845 30271 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:09.457374 30271 raft_consensus.cc:2243] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.457864 30271 raft_consensus.cc:2272] T 7efd8336cb5547f5ad265dacaa3710d4 P ed504ef86dcd4610b04ceadcf381e637 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:09.477357  8351 consensus_peers.cc:597] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.533370  8277 consensus_peers.cc:597] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.617352  8277 consensus_peers.cc:597] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.630271  8351 consensus_peers.cc:597] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.634939  8351 consensus_peers.cc:597] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.675529  8277 consensus_peers.cc:597] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.733875  8277 consensus_peers.cc:597] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.759951  8351 consensus_peers.cc:597] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed504ef86dcd4610b04ceadcf381e637 (127.29.143.193:42799): Couldn't send request to peer ed504ef86dcd4610b04ceadcf381e637. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:42799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.799485 30271 tablet_server.cc:196] TabletServer@127.29.143.193:42799 shutdown complete.
I20260709 12:26:09.817929 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
I20260709 12:26:09.845065 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:09.845798 30271 tablet_replica.cc:333] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.846671 30271 raft_consensus.cc:2243] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.847213 30271 raft_consensus.cc:2272] T 4b9ece10e61843b98292f24f6485b497 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.849310 30271 tablet_replica.cc:333] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.849997 30271 raft_consensus.cc:2243] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.850910 30271 raft_consensus.cc:2272] T 0383446c97884aec962c3fbff02258ec P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.852952 30271 tablet_replica.cc:333] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.853494 30271 raft_consensus.cc:2243] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.853850 30271 raft_consensus.cc:2272] T 987d7b24470c476ba02db74faf1aa8c2 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.855747 30271 tablet_replica.cc:333] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.856228 30271 raft_consensus.cc:2243] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.856588 30271 raft_consensus.cc:2272] T 7efd8336cb5547f5ad265dacaa3710d4 P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.858640 30271 tablet_replica.cc:333] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.859166 30271 raft_consensus.cc:2243] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.859967 30271 raft_consensus.cc:2272] T 63109c99daaf4527ac9c84dfe7a7b721 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.862921 30271 tablet_replica.cc:333] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.863440 30271 raft_consensus.cc:2243] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.863858 30271 raft_consensus.cc:2272] T ddd1ef78a8ed48e4a754576d3bf363ea P ed0f57b9c640453ca3ad4ad0d8699044 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.865815 30271 tablet_replica.cc:333] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.866254 30271 raft_consensus.cc:2243] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.867055 30271 raft_consensus.cc:2272] T 3435adc93a2249b786e06b0e30e1fd52 P ed0f57b9c640453ca3ad4ad0d8699044 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.869411 30271 tablet_replica.cc:333] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.869968 30271 raft_consensus.cc:2243] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.870317 30271 raft_consensus.cc:2272] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.872864 30271 tablet_replica.cc:333] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.873371 30271 raft_consensus.cc:2243] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.874171 30271 raft_consensus.cc:2272] T 2e7e35937db848ef8a9625d004e0af76 P ed0f57b9c640453ca3ad4ad0d8699044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.876194 30271 tablet_replica.cc:333] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044: stopping tablet replica
I20260709 12:26:09.876709 30271 raft_consensus.cc:2243] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.877444 30271 raft_consensus.cc:2272] T c962f707404b40b593f912f68db1b344 P ed0f57b9c640453ca3ad4ad0d8699044 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:09.882943  8350 consensus_peers.cc:597] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 -> Peer ed0f57b9c640453ca3ad4ad0d8699044 (127.29.143.194:40517): Couldn't send request to peer ed0f57b9c640453ca3ad4ad0d8699044. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.910290 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
I20260709 12:26:09.932735 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
I20260709 12:26:09.958616 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:09.959440 30271 tablet_replica.cc:333] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.960410 30271 raft_consensus.cc:2243] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.961184 30271 raft_consensus.cc:2272] T 987d7b24470c476ba02db74faf1aa8c2 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.963260 30271 tablet_replica.cc:333] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.963784 30271 raft_consensus.cc:2243] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.964170 30271 raft_consensus.cc:2272] T c962f707404b40b593f912f68db1b344 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.965930 30271 tablet_replica.cc:333] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.966406 30271 raft_consensus.cc:2243] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.967422 30271 raft_consensus.cc:2272] T 4b9ece10e61843b98292f24f6485b497 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.969866 30271 tablet_replica.cc:333] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.970571 30271 raft_consensus.cc:2243] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.971215 30271 raft_consensus.cc:2272] T 0383446c97884aec962c3fbff02258ec P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.973634 30271 tablet_replica.cc:333] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.974293 30271 raft_consensus.cc:2243] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.974828 30271 raft_consensus.cc:2272] T 3435adc93a2249b786e06b0e30e1fd52 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.977074 30271 tablet_replica.cc:333] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.977698 30271 raft_consensus.cc:2243] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.978200 30271 raft_consensus.cc:2272] T 2e7e35937db848ef8a9625d004e0af76 P 9a5d97b37f01480faf357aa92b772c06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.980645 30271 tablet_replica.cc:333] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.981210 30271 raft_consensus.cc:2243] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.982108 30271 raft_consensus.cc:2272] T 2c611c0bf1364a1ebf6b2f0b07e98a26 P 9a5d97b37f01480faf357aa92b772c06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.984944 30271 tablet_replica.cc:333] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.985581 30271 raft_consensus.cc:2243] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.986469 30271 raft_consensus.cc:2272] T 7efd8336cb5547f5ad265dacaa3710d4 P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.988914 30271 tablet_replica.cc:333] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.989465 30271 raft_consensus.cc:2243] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:09.989945 30271 raft_consensus.cc:2272] T 63109c99daaf4527ac9c84dfe7a7b721 P 9a5d97b37f01480faf357aa92b772c06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:09.992928 30271 tablet_replica.cc:333] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06: stopping tablet replica
I20260709 12:26:09.993479 30271 raft_consensus.cc:2243] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:09.994386 30271 raft_consensus.cc:2272] T ddd1ef78a8ed48e4a754576d3bf363ea P 9a5d97b37f01480faf357aa92b772c06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.027161 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:26:10.050343 30271 master.cc:562] Master@127.29.143.254:41381 shutting down...
I20260709 12:26:10.074769 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:10.075331 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.075665 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3d29e84bd15844d4bea2792aebc52461: stopping tablet replica
I20260709 12:26:10.096268 30271 master.cc:584] Master@127.29.143.254:41381 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14122 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:26:10.138936 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:36001
I20260709 12:26:10.140144 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:10.145555  8735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.145774  8736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.147060  8738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.148257 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:10.149255 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:10.149425 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:10.149660 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599970149625 us; error 0 us; skew 500 ppm
I20260709 12:26:10.150218 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:10.152549 30271 webserver.cc:533] Webserver started at http://127.29.143.254:45315/ using document root <none> and password file <none>
I20260709 12:26:10.153044 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:10.153239 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:10.153535 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:10.154628 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "44ec6356b55648e9bce07f038e9283dd"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.159077 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:26:10.162621  8743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.163437 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:10.163745 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "44ec6356b55648e9bce07f038e9283dd"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.164034 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:10.179342 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:10.180518 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:10.218427 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:36001
I20260709 12:26:10.218526  8794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:36001 every 8 connection(s)
I20260709 12:26:10.222203  8795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.233115  8795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd: Bootstrap starting.
I20260709 12:26:10.237813  8795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.242064  8795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd: No bootstrap required, opened a new log
I20260709 12:26:10.244263  8795 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER }
I20260709 12:26:10.244659  8795 raft_consensus.cc:385] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.244917  8795 raft_consensus.cc:740] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ec6356b55648e9bce07f038e9283dd, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.245705  8795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER }
I20260709 12:26:10.246160  8795 raft_consensus.cc:399] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:10.246371  8795 raft_consensus.cc:493] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:10.246734  8795 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.252303  8795 raft_consensus.cc:515] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER }
I20260709 12:26:10.252879  8795 leader_election.cc:304] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44ec6356b55648e9bce07f038e9283dd; no voters: 
I20260709 12:26:10.254112  8795 leader_election.cc:290] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:10.254527  8798 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.256181  8798 raft_consensus.cc:697] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 1 LEADER]: Becoming Leader. State: Replica: 44ec6356b55648e9bce07f038e9283dd, State: Running, Role: LEADER
I20260709 12:26:10.257058  8795 sys_catalog.cc:565] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:10.256966  8798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER }
I20260709 12:26:10.262732  8799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44ec6356b55648e9bce07f038e9283dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER } }
I20260709 12:26:10.262823  8800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44ec6356b55648e9bce07f038e9283dd. Latest consensus state: current_term: 1 leader_uuid: "44ec6356b55648e9bce07f038e9283dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44ec6356b55648e9bce07f038e9283dd" member_type: VOTER } }
I20260709 12:26:10.263428  8799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:10.263599  8800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:10.265762  8806 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:10.271971  8806 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:10.272981 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:10.281224  8806 catalog_manager.cc:1383] Generated new cluster ID: b2143bf36d3f41b786828b8a789beb75
I20260709 12:26:10.281545  8806 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:10.306337  8806 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:10.307698  8806 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:10.323127  8806 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd: Generated new TSK 0
I20260709 12:26:10.323800  8806 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:10.340528 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:10.346649  8816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.347627  8817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.351696 30271 server_base.cc:1061] running on GCE node
W20260709 12:26:10.352574  8819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.353525 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:10.353715 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:10.353842 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599970353829 us; error 0 us; skew 500 ppm
I20260709 12:26:10.354319 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:10.356567 30271 webserver.cc:533] Webserver started at http://127.29.143.193:40819/ using document root <none> and password file <none>
I20260709 12:26:10.357010 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:10.357183 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:10.357402 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:10.358525 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.363128 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:10.366335  8824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.367144 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:10.367514 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.367803 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:10.382975 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:10.384102 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:10.385555 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:10.387797 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:10.388019 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.388262 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:10.388437 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.428867 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:33353
I20260709 12:26:10.428974  8886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:33353 every 8 connection(s)
I20260709 12:26:10.435105 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:10.442135  8891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.442802  8892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.444736  8894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.446780  8887 heartbeater.cc:344] Connected to a master server at 127.29.143.254:36001
I20260709 12:26:10.447224  8887 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:10.447414 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:10.448236  8887 heartbeater.cc:507] Master 127.29.143.254:36001 requested a full tablet report, sending...
I20260709 12:26:10.448676 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:10.448964 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:10.449167 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599970449148 us; error 0 us; skew 500 ppm
I20260709 12:26:10.449810 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:10.450493  8760 ts_manager.cc:194] Registered new tserver with Master: 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353)
I20260709 12:26:10.452339 30271 webserver.cc:533] Webserver started at http://127.29.143.194:43809/ using document root <none> and password file <none>
I20260709 12:26:10.452715  8760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50102
I20260709 12:26:10.452879 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:10.453197 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:10.453466 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:10.454715 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "4c4be3441a054fd696f5121d3ac84786"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.459239 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:10.462728  8899 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.463852 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:26:10.464183 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "4c4be3441a054fd696f5121d3ac84786"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.464490 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:10.485560 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:10.486783 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:10.488211 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:10.490379 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:10.490610 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.490873 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:10.491048 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.531407 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:37037
I20260709 12:26:10.531558  8961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:37037 every 8 connection(s)
I20260709 12:26:10.536324 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:10.543833  8965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:10.545693  8966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.549593 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:10.549783  8962 heartbeater.cc:344] Connected to a master server at 127.29.143.254:36001
I20260709 12:26:10.550324  8962 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:10.550264  8968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:10.551337  8962 heartbeater.cc:507] Master 127.29.143.254:36001 requested a full tablet report, sending...
I20260709 12:26:10.551383 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:10.551761 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:10.551960 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599970551943 us; error 0 us; skew 500 ppm
I20260709 12:26:10.552722 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:10.553488  8760 ts_manager.cc:194] Registered new tserver with Master: 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037)
I20260709 12:26:10.555214  8760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50118
I20260709 12:26:10.555406 30271 webserver.cc:533] Webserver started at http://127.29.143.195:32983/ using document root <none> and password file <none>
I20260709 12:26:10.556034 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:10.556300 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:10.556612 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:10.557829 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "53185d51b5b044e187acc5bfa4142f2a"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.562400 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:10.565937  8973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.566816 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:10.567117 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "53185d51b5b044e187acc5bfa4142f2a"
format_stamp: "Formatted at 2026-07-09 12:26:10 on dist-test-slave-9k85"
I20260709 12:26:10.567471 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:10.585911 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:10.587170 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:10.588598 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:10.590857 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:10.591079 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.591316 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:10.591493 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:10.634023 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:44753
I20260709 12:26:10.634116  9035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:44753 every 8 connection(s)
I20260709 12:26:10.648352  9036 heartbeater.cc:344] Connected to a master server at 127.29.143.254:36001
I20260709 12:26:10.648773  9036 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:10.649506  9036 heartbeater.cc:507] Master 127.29.143.254:36001 requested a full tablet report, sending...
I20260709 12:26:10.651558  8760 ts_manager.cc:194] Registered new tserver with Master: 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:10.652253 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014759354s
I20260709 12:26:10.652957  8760 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50126
I20260709 12:26:10.679141  8760 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50132:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:10.681274  8760 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:10.722323  8927 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff35ecff5ca4286a51881e4ef8af182 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:10.722920  8926 tablet_service.cc:1511] Processing CreateTablet for tablet f9362de4f77b4bf19f6c2ee1beb4910c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:10.723803  8927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff35ecff5ca4286a51881e4ef8af182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.725493  8926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9362de4f77b4bf19f6c2ee1beb4910c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.725549  9001 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff35ecff5ca4286a51881e4ef8af182 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:10.726897  9001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff35ecff5ca4286a51881e4ef8af182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.730830  8852 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff35ecff5ca4286a51881e4ef8af182 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:10.731192  8851 tablet_service.cc:1511] Processing CreateTablet for tablet f9362de4f77b4bf19f6c2ee1beb4910c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:10.732254  8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff35ecff5ca4286a51881e4ef8af182. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.735407  8851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9362de4f77b4bf19f6c2ee1beb4910c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.736392  9000 tablet_service.cc:1511] Processing CreateTablet for tablet f9362de4f77b4bf19f6c2ee1beb4910c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=552be48756aa44efaeaa20b330bc1901]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:10.737684  9000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9362de4f77b4bf19f6c2ee1beb4910c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.750203  9051 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: Bootstrap starting.
I20260709 12:26:10.756138  9052 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: Bootstrap starting.
I20260709 12:26:10.766947  9052 tablet_bootstrap.cc:654] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.769050  9051 tablet_bootstrap.cc:654] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.769701  9053 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: Bootstrap starting.
I20260709 12:26:10.773367  9052 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: No bootstrap required, opened a new log
I20260709 12:26:10.773936  9052 ts_tablet_manager.cc:1403] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:26:10.776793  9051 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: No bootstrap required, opened a new log
I20260709 12:26:10.777325  9051 ts_tablet_manager.cc:1403] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 12:26:10.776868  9052 raft_consensus.cc:359] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.777521  9053 tablet_bootstrap.cc:654] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.777834  9052 raft_consensus.cc:385] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.778157  9052 raft_consensus.cc:740] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.779003  9052 consensus_queue.cc:260] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.779994  9051 raft_consensus.cc:359] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.780587  9051 raft_consensus.cc:385] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.780826  9051 raft_consensus.cc:740] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.781484  9051 consensus_queue.cc:260] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.786141  9052 ts_tablet_manager.cc:1434] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:26:10.786258  9053 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: No bootstrap required, opened a new log
I20260709 12:26:10.786881  9053 ts_tablet_manager.cc:1403] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 12:26:10.787346  9052 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: Bootstrap starting.
I20260709 12:26:10.788028  8887 heartbeater.cc:499] Master 127.29.143.254:36001 was elected leader, sending a full tablet report...
I20260709 12:26:10.789876  9053 raft_consensus.cc:359] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.790644  9053 raft_consensus.cc:385] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.791025  9053 raft_consensus.cc:740] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53185d51b5b044e187acc5bfa4142f2a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.792424  9053 consensus_queue.cc:260] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.793778  9052 tablet_bootstrap.cc:654] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.794857  8962 heartbeater.cc:499] Master 127.29.143.254:36001 was elected leader, sending a full tablet report...
I20260709 12:26:10.795367  9051 ts_tablet_manager.cc:1434] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:26:10.796361  9051 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: Bootstrap starting.
I20260709 12:26:10.799422  9053 ts_tablet_manager.cc:1434] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.007s
I20260709 12:26:10.800279  9036 heartbeater.cc:499] Master 127.29.143.254:36001 was elected leader, sending a full tablet report...
I20260709 12:26:10.802873  9051 tablet_bootstrap.cc:654] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.803958  9053 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: Bootstrap starting.
I20260709 12:26:10.813926  9053 tablet_bootstrap.cc:654] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.821816  9052 tablet_bootstrap.cc:492] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: No bootstrap required, opened a new log
I20260709 12:26:10.822431  9052 ts_tablet_manager.cc:1403] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.008s
I20260709 12:26:10.823036  9053 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: No bootstrap required, opened a new log
I20260709 12:26:10.823698  9053 ts_tablet_manager.cc:1403] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:26:10.824996  9051 tablet_bootstrap.cc:492] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: No bootstrap required, opened a new log
I20260709 12:26:10.825611  9051 ts_tablet_manager.cc:1403] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.016s
I20260709 12:26:10.825502  9052 raft_consensus.cc:359] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.826426  9052 raft_consensus.cc:385] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.826814  9052 raft_consensus.cc:740] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.826697  9053 raft_consensus.cc:359] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.827770  9053 raft_consensus.cc:385] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.828181  9053 raft_consensus.cc:740] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53185d51b5b044e187acc5bfa4142f2a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.829042  9053 consensus_queue.cc:260] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.831575  9053 ts_tablet_manager.cc:1434] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:10.829109  9051 raft_consensus.cc:359] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.827847  9052 consensus_queue.cc:260] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.832815  9051 raft_consensus.cc:385] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.833230  9051 raft_consensus.cc:740] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.833678  9052 ts_tablet_manager.cc:1434] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:26:10.834079  9051 consensus_queue.cc:260] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.836408  9051 ts_tablet_manager.cc:1434] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 12:26:10.864827  9058 raft_consensus.cc:493] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.865427  9058 raft_consensus.cc:515] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.868057  9058 leader_election.cc:290] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:10.877723  9059 raft_consensus.cc:493] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.878060  8862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" is_pre_election: true
I20260709 12:26:10.878513  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a" is_pre_election: true
I20260709 12:26:10.878348  9059 raft_consensus.cc:515] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.878827  8862 raft_consensus.cc:2468] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 0.
I20260709 12:26:10.879455  9011 raft_consensus.cc:2468] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 0.
I20260709 12:26:10.880288  8903 leader_election.cc:304] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:10.881228  9058 raft_consensus.cc:2804] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.881629  9058 raft_consensus.cc:493] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.881951  9058 raft_consensus.cc:3060] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.881301  9059 leader_election.cc:290] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037)
I20260709 12:26:10.890518  9058 raft_consensus.cc:515] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.892247  8862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "53185d51b5b044e187acc5bfa4142f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" is_pre_election: true
I20260709 12:26:10.892953  8862 raft_consensus.cc:2468] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53185d51b5b044e187acc5bfa4142f2a in term 0.
I20260709 12:26:10.893249  9058 leader_election.cc:290] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 election: Requested vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:10.893518  8861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
I20260709 12:26:10.894194  8861 raft_consensus.cc:3060] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.894418  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
I20260709 12:26:10.895026  9011 raft_consensus.cc:3060] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.895186  8977 leader_election.cc:304] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53185d51b5b044e187acc5bfa4142f2a, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:10.895691  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9362de4f77b4bf19f6c2ee1beb4910c" candidate_uuid: "53185d51b5b044e187acc5bfa4142f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4be3441a054fd696f5121d3ac84786" is_pre_election: true
I20260709 12:26:10.896555  8937 raft_consensus.cc:2393] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53185d51b5b044e187acc5bfa4142f2a in current term 1: Already voted for candidate 4c4be3441a054fd696f5121d3ac84786 in this term.
I20260709 12:26:10.902117  8861 raft_consensus.cc:2468] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 1.
I20260709 12:26:10.902369  9011 raft_consensus.cc:2468] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 1.
I20260709 12:26:10.902961  9059 raft_consensus.cc:2764] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:10.903275  8903 leader_election.cc:304] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:10.904088  9058 raft_consensus.cc:2804] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.905197  9058 raft_consensus.cc:697] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Becoming Leader. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Running, Role: LEADER
I20260709 12:26:10.905854  9058 consensus_queue.cc:237] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:10.913663  8760 catalog_manager.cc:5697] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "4c4be3441a054fd696f5121d3ac84786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.953635  9056 raft_consensus.cc:493] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.954234  9056 raft_consensus.cc:515] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.956434  9056 leader_election.cc:290] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:10.966310  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff35ecff5ca4286a51881e4ef8af182" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4be3441a054fd696f5121d3ac84786" is_pre_election: true
I20260709 12:26:10.967157  8937 raft_consensus.cc:2468] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 0.
I20260709 12:26:10.967787  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff35ecff5ca4286a51881e4ef8af182" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a" is_pre_election: true
I20260709 12:26:10.968304  8826 leader_election.cc:304] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:10.968410  9011 raft_consensus.cc:2468] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 0.
I20260709 12:26:10.969120  9056 raft_consensus.cc:2804] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.969491  9056 raft_consensus.cc:493] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.969820  9056 raft_consensus.cc:3060] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.975332  9056 raft_consensus.cc:515] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.977207  9056 leader_election.cc:290] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 election: Requested vote from peers 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:10.978025  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff35ecff5ca4286a51881e4ef8af182" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4be3441a054fd696f5121d3ac84786"
I20260709 12:26:10.978138  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff35ecff5ca4286a51881e4ef8af182" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
I20260709 12:26:10.978608  8937 raft_consensus.cc:3060] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.978760  9011 raft_consensus.cc:3060] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.983865  9011 raft_consensus.cc:2468] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 1.
I20260709 12:26:10.984351  8937 raft_consensus.cc:2468] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 1.
I20260709 12:26:10.984802  8825 leader_election.cc:304] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53185d51b5b044e187acc5bfa4142f2a, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:10.985559  9056 raft_consensus.cc:2804] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.986452  9056 raft_consensus.cc:697] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Becoming Leader. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Running, Role: LEADER
I20260709 12:26:10.987128  9056 consensus_queue.cc:237] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } }
I20260709 12:26:10.994231  8760 catalog_manager.cc:5697] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193). New cstate: current_term: 1 leader_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.036799  8760 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50138:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:11.038723  8760 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:11.061030  8851 tablet_service.cc:1511] Processing CreateTablet for tablet ff50ac165c504ea9a8e52f4412bac414 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:11.062332  8851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff50ac165c504ea9a8e52f4412bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.062027  8927 tablet_service.cc:1511] Processing CreateTablet for tablet ff50ac165c504ea9a8e52f4412bac414 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:11.063468  8927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff50ac165c504ea9a8e52f4412bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.063606  9000 tablet_service.cc:1511] Processing CreateTablet for tablet ff50ac165c504ea9a8e52f4412bac414 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:11.064822  9000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff50ac165c504ea9a8e52f4412bac414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.067780  8852 tablet_service.cc:1511] Processing CreateTablet for tablet e5af30f0434c42a2b6244451e13dd869 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:11.069072  8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af30f0434c42a2b6244451e13dd869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.071928  8926 tablet_service.cc:1511] Processing CreateTablet for tablet e5af30f0434c42a2b6244451e13dd869 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:11.073213  8926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af30f0434c42a2b6244451e13dd869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.077134  9001 tablet_service.cc:1511] Processing CreateTablet for tablet e5af30f0434c42a2b6244451e13dd869 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e6a81288a9154899b9fab9f07522f92b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:11.078387  9001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af30f0434c42a2b6244451e13dd869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:11.079835  9052 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: Bootstrap starting.
I20260709 12:26:11.087489  9052 tablet_bootstrap.cc:654] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.088317  9051 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: Bootstrap starting.
I20260709 12:26:11.097693  9051 tablet_bootstrap.cc:654] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.099009  9052 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: No bootstrap required, opened a new log
I20260709 12:26:11.099623  9052 ts_tablet_manager.cc:1403] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 12:26:11.102629  9052 raft_consensus.cc:359] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.103502  9052 raft_consensus.cc:385] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.103839  9052 raft_consensus.cc:740] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.104671  9052 consensus_queue.cc:260] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.108779  9053 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: Bootstrap starting.
I20260709 12:26:11.108860  9052 ts_tablet_manager.cc:1434] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:26:11.113199  9052 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Bootstrap starting.
I20260709 12:26:11.114300  9051 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: No bootstrap required, opened a new log
I20260709 12:26:11.114881  9051 ts_tablet_manager.cc:1403] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.012s
I20260709 12:26:11.118052  9051 raft_consensus.cc:359] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.118629  9051 raft_consensus.cc:385] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.118803  9053 tablet_bootstrap.cc:654] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.119024  9051 raft_consensus.cc:740] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.120194  9052 tablet_bootstrap.cc:654] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.120043  9051 consensus_queue.cc:260] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.127465  9051 ts_tablet_manager.cc:1434] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:11.130792  9051 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: Bootstrap starting.
I20260709 12:26:11.132999  9052 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: No bootstrap required, opened a new log
I20260709 12:26:11.133033  9053 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: No bootstrap required, opened a new log
I20260709 12:26:11.133793  9052 ts_tablet_manager.cc:1403] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:26:11.133911  9053 ts_tablet_manager.cc:1403] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.001s
I20260709 12:26:11.137073  9052 raft_consensus.cc:359] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.137758  9052 raft_consensus.cc:385] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.137470  9053 raft_consensus.cc:359] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.138098  9052 raft_consensus.cc:740] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.138197  9051 tablet_bootstrap.cc:654] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.138429  9053 raft_consensus.cc:385] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.138860  9053 raft_consensus.cc:740] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53185d51b5b044e187acc5bfa4142f2a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.139057  9052 consensus_queue.cc:260] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.139909  9053 consensus_queue.cc:260] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.141397  9052 ts_tablet_manager.cc:1434] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:11.142743  9053 ts_tablet_manager.cc:1434] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:11.144407  9053 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Bootstrap starting.
I20260709 12:26:11.155117  9053 tablet_bootstrap.cc:654] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.161046  9051 tablet_bootstrap.cc:492] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: No bootstrap required, opened a new log
I20260709 12:26:11.161089  9053 tablet_bootstrap.cc:492] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: No bootstrap required, opened a new log
I20260709 12:26:11.161670  9051 ts_tablet_manager.cc:1403] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.006s
I20260709 12:26:11.161769  9053 ts_tablet_manager.cc:1403] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:26:11.164469  9051 raft_consensus.cc:359] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.165022  9051 raft_consensus.cc:385] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.164844  9053 raft_consensus.cc:359] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.165307  9051 raft_consensus.cc:740] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.165664  9053 raft_consensus.cc:385] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.166040  9053 raft_consensus.cc:740] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53185d51b5b044e187acc5bfa4142f2a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.166374  9051 consensus_queue.cc:260] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.166834  9053 consensus_queue.cc:260] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.168956  9051 ts_tablet_manager.cc:1434] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:26:11.169143  9053 ts_tablet_manager.cc:1434] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:26:11.186666  9056 raft_consensus.cc:493] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.187259  9056 raft_consensus.cc:515] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.188838  9056 leader_election.cc:290] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:11.189730  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4be3441a054fd696f5121d3ac84786" is_pre_election: true
I20260709 12:26:11.189954  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a" is_pre_election: true
I20260709 12:26:11.190450  8937 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 0.
I20260709 12:26:11.190514  9011 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 0.
I20260709 12:26:11.191536  8825 leader_election.cc:304] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53185d51b5b044e187acc5bfa4142f2a, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:11.192209  9056 raft_consensus.cc:2804] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.192559  9056 raft_consensus.cc:493] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.192793  9056 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.197710  9056 raft_consensus.cc:515] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.199251  9056 leader_election.cc:290] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 election: Requested vote from peers 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:11.200012  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c4be3441a054fd696f5121d3ac84786"
I20260709 12:26:11.200230  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
I20260709 12:26:11.200660  8937 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.200747  9011 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.207733  9011 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 1.
I20260709 12:26:11.207733  8937 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 1.
I20260709 12:26:11.208967  8825 leader_election.cc:304] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53185d51b5b044e187acc5bfa4142f2a, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:11.210064  9056 raft_consensus.cc:2804] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.210526  9056 raft_consensus.cc:697] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Becoming Leader. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Running, Role: LEADER
I20260709 12:26:11.211275  9056 consensus_queue.cc:237] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.218340  8759 catalog_manager.cc:5697] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193). New cstate: current_term: 1 leader_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.233649  9058 raft_consensus.cc:493] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.234099  9058 raft_consensus.cc:515] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.235687  9058 leader_election.cc:290] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:11.236653  8861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" is_pre_election: true
I20260709 12:26:11.236855  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a" is_pre_election: true
I20260709 12:26:11.237288  8861 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 0.
I20260709 12:26:11.237471  9011 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 0.
I20260709 12:26:11.238410  8903 leader_election.cc:304] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:11.239145  9058 raft_consensus.cc:2804] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.239427  9058 raft_consensus.cc:493] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.239741  9058 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.245036  9058 raft_consensus.cc:515] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.246551  9058 leader_election.cc:290] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 election: Requested vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:11.247486  8861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
I20260709 12:26:11.247613  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "4c4be3441a054fd696f5121d3ac84786" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
I20260709 12:26:11.248267  8861 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.248394  9011 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.253968  9011 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 1.
I20260709 12:26:11.253968  8861 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c4be3441a054fd696f5121d3ac84786 in term 1.
I20260709 12:26:11.255092  8900 leader_election.cc:304] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 53185d51b5b044e187acc5bfa4142f2a; no voters: 
I20260709 12:26:11.255817  9058 raft_consensus.cc:2804] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.256249  9058 raft_consensus.cc:697] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Becoming Leader. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Running, Role: LEADER
I20260709 12:26:11.257022  9058 consensus_queue.cc:237] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.263664  8759 catalog_manager.cc:5697] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194). New cstate: current_term: 1 leader_uuid: "4c4be3441a054fd696f5121d3ac84786" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:11.269896  8808 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:11.301390  8937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869"
dest_uuid: "4c4be3441a054fd696f5121d3ac84786"
mode: GRACEFUL
new_leader_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
 from {username='slave'} at 127.0.0.1:45918
I20260709 12:26:11.301914  8937 raft_consensus.cc:606] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Received request to transfer leadership to TS 9c5b640c8db946b2ba1ea64ce2d2806a
I20260709 12:26:11.414896  9058 consensus_queue.cc:1048] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:11.428345  9058 consensus_queue.cc:1048] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.463440  9056 consensus_queue.cc:1048] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.474910  9056 consensus_queue.cc:1048] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Connected to new peer: Peer: permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.735373  9058 consensus_queue.cc:1048] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:11.739115  9056 consensus_queue.cc:1048] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.760215  9097 consensus_queue.cc:1048] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:11.764513  9056 consensus_queue.cc:1048] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Connected to new peer: Peer: permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:11.783106  9065 raft_consensus.cc:993] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: : Instructing follower 9c5b640c8db946b2ba1ea64ce2d2806a to start an election
I20260709 12:26:11.783663  9065 raft_consensus.cc:1081] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Signalling peer 9c5b640c8db946b2ba1ea64ce2d2806a to start an election
I20260709 12:26:11.786121  8861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869"
dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
 from {username='slave'} at 127.0.0.1:39256
I20260709 12:26:11.786979  8861 raft_consensus.cc:493] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.787715  8861 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.800320  8861 raft_consensus.cc:515] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.803141  8861 leader_election.cc:290] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 2 election: Requested vote from peers 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037), 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195:44753)
I20260709 12:26:11.804404  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c4be3441a054fd696f5121d3ac84786"
I20260709 12:26:11.805168  8937 raft_consensus.cc:3055] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:11.805079  9011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af30f0434c42a2b6244451e13dd869" candidate_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
I20260709 12:26:11.805603  8937 raft_consensus.cc:740] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4c4be3441a054fd696f5121d3ac84786, State: Running, Role: LEADER
I20260709 12:26:11.805830  9011 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.806794  8937 consensus_queue.cc:260] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.808313  8937 raft_consensus.cc:3060] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.816610  9011 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 2.
I20260709 12:26:11.817834  8937 raft_consensus.cc:2468] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c5b640c8db946b2ba1ea64ce2d2806a in term 2.
I20260709 12:26:11.818068  8825 leader_election.cc:304] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53185d51b5b044e187acc5bfa4142f2a, 9c5b640c8db946b2ba1ea64ce2d2806a; no voters: 
I20260709 12:26:11.819169  9056 raft_consensus.cc:2804] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.819664  9056 raft_consensus.cc:697] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 LEADER]: Becoming Leader. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Running, Role: LEADER
I20260709 12:26:11.820605  9056 consensus_queue.cc:237] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:11.826589  8757 catalog_manager.cc:5697] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a reported cstate change: term changed from 1 to 2, leader changed from 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194) to 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193). New cstate: current_term: 2 leader_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.082011 30271 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:26:12.083698 30271 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:26:12.084295 30271 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:26:12.098727  8861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414"
dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
mode: GRACEFUL
new_leader_uuid: "53185d51b5b044e187acc5bfa4142f2a"
 from {username='slave'} at 127.0.0.1:39268
I20260709 12:26:12.099464  8861 raft_consensus.cc:606] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Received request to transfer leadership to TS 53185d51b5b044e187acc5bfa4142f2a
I20260709 12:26:12.100800 30271 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:26:12.145553  9091 raft_consensus.cc:993] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: : Instructing follower 53185d51b5b044e187acc5bfa4142f2a to start an election
I20260709 12:26:12.146028  9056 raft_consensus.cc:1081] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Signalling peer 53185d51b5b044e187acc5bfa4142f2a to start an election
I20260709 12:26:12.147881  9011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414"
dest_uuid: "53185d51b5b044e187acc5bfa4142f2a"
 from {username='slave'} at 127.0.0.1:42424
I20260709 12:26:12.148444  9011 raft_consensus.cc:493] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.148864  9011 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.154486  9011 raft_consensus.cc:515] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:12.156495  9011 leader_election.cc:290] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [CANDIDATE]: Term 2 election: Requested vote from peers 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193:33353), 4c4be3441a054fd696f5121d3ac84786 (127.29.143.194:37037)
I20260709 12:26:12.157490  8861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "53185d51b5b044e187acc5bfa4142f2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a"
I20260709 12:26:12.157693  8937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff50ac165c504ea9a8e52f4412bac414" candidate_uuid: "53185d51b5b044e187acc5bfa4142f2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c4be3441a054fd696f5121d3ac84786"
I20260709 12:26:12.158110  8861 raft_consensus.cc:3055] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:12.158352  8937 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.158497  8861 raft_consensus.cc:740] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c5b640c8db946b2ba1ea64ce2d2806a, State: Running, Role: LEADER
I20260709 12:26:12.159572  8861 consensus_queue.cc:260] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:12.160715  8861 raft_consensus.cc:3060] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.165553  8937 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53185d51b5b044e187acc5bfa4142f2a in term 2.
I20260709 12:26:12.167106  8975 leader_election.cc:304] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c4be3441a054fd696f5121d3ac84786, 53185d51b5b044e187acc5bfa4142f2a; no voters: 
I20260709 12:26:12.168191  9059 raft_consensus.cc:2804] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.169580  9059 raft_consensus.cc:697] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 LEADER]: Becoming Leader. State: Replica: 53185d51b5b044e187acc5bfa4142f2a, State: Running, Role: LEADER
I20260709 12:26:12.171080  8861 raft_consensus.cc:2468] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53185d51b5b044e187acc5bfa4142f2a in term 2.
I20260709 12:26:12.170899  9059 consensus_queue.cc:237] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } }
I20260709 12:26:12.177425  8757 catalog_manager.cc:5697] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a reported cstate change: term changed from 1 to 2, leader changed from 9c5b640c8db946b2ba1ea64ce2d2806a (127.29.143.193) to 53185d51b5b044e187acc5bfa4142f2a (127.29.143.195). New cstate: current_term: 2 leader_uuid: "53185d51b5b044e187acc5bfa4142f2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c5b640c8db946b2ba1ea64ce2d2806a" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c4be3441a054fd696f5121d3ac84786" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53185d51b5b044e187acc5bfa4142f2a" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 44753 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.199796 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
I20260709 12:26:12.227248 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.228119 30271 tablet_replica.cc:333] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: stopping tablet replica
I20260709 12:26:12.228915 30271 raft_consensus.cc:2243] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.229606 30271 pending_rounds.cc:70] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Trying to abort 1 pending ops.
I20260709 12:26:12.229790 30271 pending_rounds.cc:77] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625484584185856 op_type: NO_OP noop_request { }
I20260709 12:26:12.230108 30271 raft_consensus.cc:2889] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:12.230439 30271 raft_consensus.cc:2272] T e5af30f0434c42a2b6244451e13dd869 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.233265 30271 tablet_replica.cc:333] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a: stopping tablet replica
I20260709 12:26:12.233855 30271 raft_consensus.cc:2243] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.234236 30271 raft_consensus.cc:2272] T ff50ac165c504ea9a8e52f4412bac414 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.236925 30271 tablet_replica.cc:333] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a: stopping tablet replica
I20260709 12:26:12.237483 30271 raft_consensus.cc:2243] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.237963 30271 raft_consensus.cc:2272] T f9362de4f77b4bf19f6c2ee1beb4910c P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.241128 30271 tablet_replica.cc:333] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a: stopping tablet replica
I20260709 12:26:12.241681 30271 raft_consensus.cc:2243] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.242539 30271 raft_consensus.cc:2272] T 0ff35ecff5ca4286a51881e4ef8af182 P 9c5b640c8db946b2ba1ea64ce2d2806a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.268587 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
I20260709 12:26:12.288235 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
I20260709 12:26:12.309475 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.310338 30271 tablet_replica.cc:333] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786: stopping tablet replica
I20260709 12:26:12.311093 30271 raft_consensus.cc:2243] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.311602 30271 raft_consensus.cc:2272] T e5af30f0434c42a2b6244451e13dd869 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.314391 30271 tablet_replica.cc:333] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786: stopping tablet replica
I20260709 12:26:12.315056 30271 raft_consensus.cc:2243] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.315516 30271 raft_consensus.cc:2272] T ff50ac165c504ea9a8e52f4412bac414 P 4c4be3441a054fd696f5121d3ac84786 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.318603 30271 tablet_replica.cc:333] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786: stopping tablet replica
I20260709 12:26:12.319270 30271 raft_consensus.cc:2243] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.319762 30271 raft_consensus.cc:2272] T 0ff35ecff5ca4286a51881e4ef8af182 P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.322466 30271 tablet_replica.cc:333] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786: stopping tablet replica
I20260709 12:26:12.323035 30271 raft_consensus.cc:2243] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.323850 30271 raft_consensus.cc:2272] T f9362de4f77b4bf19f6c2ee1beb4910c P 4c4be3441a054fd696f5121d3ac84786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.349053 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
I20260709 12:26:12.366376 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
I20260709 12:26:12.391191 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.391858 30271 tablet_replica.cc:333] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: stopping tablet replica
I20260709 12:26:12.392434 30271 raft_consensus.cc:2243] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.393047 30271 pending_rounds.cc:70] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Trying to abort 1 pending ops.
I20260709 12:26:12.393217 30271 pending_rounds.cc:77] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625486021615616 op_type: NO_OP noop_request { }
I20260709 12:26:12.393440 30271 raft_consensus.cc:2889] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:12.393668 30271 raft_consensus.cc:2272] T ff50ac165c504ea9a8e52f4412bac414 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.396190 30271 tablet_replica.cc:333] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a: stopping tablet replica
I20260709 12:26:12.396759 30271 raft_consensus.cc:2243] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.397164 30271 raft_consensus.cc:2272] T e5af30f0434c42a2b6244451e13dd869 P 53185d51b5b044e187acc5bfa4142f2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.399956 30271 tablet_replica.cc:333] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a: stopping tablet replica
I20260709 12:26:12.400431 30271 raft_consensus.cc:2243] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.400822 30271 raft_consensus.cc:2272] T 0ff35ecff5ca4286a51881e4ef8af182 P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.403496 30271 tablet_replica.cc:333] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a: stopping tablet replica
I20260709 12:26:12.403921 30271 raft_consensus.cc:2243] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.404340 30271 raft_consensus.cc:2272] T f9362de4f77b4bf19f6c2ee1beb4910c P 53185d51b5b044e187acc5bfa4142f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.429059 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:26:12.446878 30271 master.cc:562] Master@127.29.143.254:36001 shutting down...
I20260709 12:26:12.468729 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.469261 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.469559 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 44ec6356b55648e9bce07f038e9283dd: stopping tablet replica
I20260709 12:26:12.488834 30271 master.cc:584] Master@127.29.143.254:36001 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2389 ms)
[----------] 6 tests from LeaderRebalancerTest (351716 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:26:12.528934 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:43029
I20260709 12:26:12.530193 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:12.536094  9106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.536299  9107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.537744  9109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.538952 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:12.539819 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:12.539999 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:12.540120 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599972540109 us; error 0 us; skew 500 ppm
I20260709 12:26:12.540602 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:12.542897 30271 webserver.cc:533] Webserver started at http://127.29.143.254:40161/ using document root <none> and password file <none>
I20260709 12:26:12.543340 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:12.543494 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:12.543715 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:12.544838 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "8d698368f7824df69076b56f72b6536f"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.549284 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:26:12.552800  9114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.553613 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:12.553903 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "8d698368f7824df69076b56f72b6536f"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.554191 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:12.569186 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:12.570446 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:12.608247 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:43029
I20260709 12:26:12.608362  9165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:43029 every 8 connection(s)
I20260709 12:26:12.612344  9166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.624969  9166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: Bootstrap starting.
I20260709 12:26:12.629804  9166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.634142  9166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: No bootstrap required, opened a new log
I20260709 12:26:12.636487  9166 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER }
I20260709 12:26:12.636868  9166 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.637048  9166 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d698368f7824df69076b56f72b6536f, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.637673  9166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER }
I20260709 12:26:12.638118  9166 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:12.638329  9166 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:12.638561  9166 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.643677  9166 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER }
I20260709 12:26:12.644167  9166 leader_election.cc:304] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d698368f7824df69076b56f72b6536f; no voters: 
I20260709 12:26:12.645226  9166 leader_election.cc:290] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:12.645589  9169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.646957  9169 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 1 LEADER]: Becoming Leader. State: Replica: 8d698368f7824df69076b56f72b6536f, State: Running, Role: LEADER
I20260709 12:26:12.647648  9169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER }
I20260709 12:26:12.648381  9166 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:12.650867  9171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d698368f7824df69076b56f72b6536f. Latest consensus state: current_term: 1 leader_uuid: "8d698368f7824df69076b56f72b6536f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER } }
I20260709 12:26:12.650770  9170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d698368f7824df69076b56f72b6536f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d698368f7824df69076b56f72b6536f" member_type: VOTER } }
I20260709 12:26:12.651561  9171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:12.651631  9170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:12.657547  9174 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:12.663712  9174 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:12.664861 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:12.672977  9174 catalog_manager.cc:1383] Generated new cluster ID: 9d4fdc7425f646a792dbac1edfabbf79
I20260709 12:26:12.673307  9174 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:12.690291  9174 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:12.691892  9174 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:12.704555  9174 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: Generated new TSK 0
I20260709 12:26:12.705265  9174 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:12.732219 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:12.738492  9187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.739689  9188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.742872 30271 server_base.cc:1061] running on GCE node
W20260709 12:26:12.743129  9190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.744076 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:12.744295 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:12.744431 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599972744419 us; error 0 us; skew 500 ppm
I20260709 12:26:12.744946 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:12.747318 30271 webserver.cc:533] Webserver started at http://127.29.143.193:35359/ using document root <none> and password file <none>
I20260709 12:26:12.747767 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:12.747925 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:12.748135 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:12.749176 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "cc5f07c44fb345f79a613769f670f73b"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.753870 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:12.757252  9195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.758299 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:12.758773 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "cc5f07c44fb345f79a613769f670f73b"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.759063 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:12.771495 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:12.772666 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:12.774031 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:12.776273 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:12.776494 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.776748 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:12.776896 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.818817 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:34603
I20260709 12:26:12.818938  9257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:34603 every 8 connection(s)
I20260709 12:26:12.825033 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:12.832940  9262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.833333  9263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.836534  9265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.836791 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:12.837776 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:12.838028 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:12.838208 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599972838188 us; error 0 us; skew 500 ppm
I20260709 12:26:12.838472  9258 heartbeater.cc:344] Connected to a master server at 127.29.143.254:43029
I20260709 12:26:12.838917  9258 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:12.838936 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:12.839990  9258 heartbeater.cc:507] Master 127.29.143.254:43029 requested a full tablet report, sending...
I20260709 12:26:12.841892 30271 webserver.cc:533] Webserver started at http://127.29.143.194:39675/ using document root <none> and password file <none>
I20260709 12:26:12.842494 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:12.842689 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:12.842816  9131 ts_manager.cc:194] Registered new tserver with Master: cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603)
I20260709 12:26:12.843011 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:12.844377 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "809eae370c384ccdaf3804b2e179afae"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.844902  9131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52094
I20260709 12:26:12.849644 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:26:12.853376  9270 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.854101 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:12.854406 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "809eae370c384ccdaf3804b2e179afae"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.854684 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:12.864748 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:12.865887 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:12.867514 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:12.869697 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:12.869922 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.870174 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:12.870348 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.912642 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:38377
I20260709 12:26:12.912735  9332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:38377 every 8 connection(s)
I20260709 12:26:12.917805 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:12.925473  9337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:12.925817  9336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.930497  9333 heartbeater.cc:344] Connected to a master server at 127.29.143.254:43029
I20260709 12:26:12.930976  9333 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:12.931187 30271 server_base.cc:1061] running on GCE node
W20260709 12:26:12.931627  9339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:12.931878  9333 heartbeater.cc:507] Master 127.29.143.254:43029 requested a full tablet report, sending...
I20260709 12:26:12.932749 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:12.933049 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:12.933293 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599972933276 us; error 0 us; skew 500 ppm
I20260709 12:26:12.934024 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:12.934275  9131 ts_manager.cc:194] Registered new tserver with Master: 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:12.935985  9131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52108
I20260709 12:26:12.936549 30271 webserver.cc:533] Webserver started at http://127.29.143.195:37949/ using document root <none> and password file <none>
I20260709 12:26:12.937216 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:12.937470 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:12.937757 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:12.939011 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "e953690054e2496da0781506a7d20ea7"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.943327 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:12.946738  9344 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.947834 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:12.948158 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "e953690054e2496da0781506a7d20ea7"
format_stamp: "Formatted at 2026-07-09 12:26:12 on dist-test-slave-9k85"
I20260709 12:26:12.948485 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:12.976979 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:12.978243 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:12.979856 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:12.982344 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:12.982585 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:12.982916 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:12.983103 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.024382 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:39167
I20260709 12:26:13.024495  9406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:39167 every 8 connection(s)
I20260709 12:26:13.038307  9407 heartbeater.cc:344] Connected to a master server at 127.29.143.254:43029
I20260709 12:26:13.038833  9407 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:13.039620  9407 heartbeater.cc:507] Master 127.29.143.254:43029 requested a full tablet report, sending...
I20260709 12:26:13.041548  9131 ts_manager.cc:194] Registered new tserver with Master: e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.042474 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014648977s
I20260709 12:26:13.042986  9131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52120
I20260709 12:26:13.069705  9131 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52134:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:13.072486  9131 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:13.132771  9372 tablet_service.cc:1511] Processing CreateTablet for tablet b837185f01b947538676d920ce6a697d (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:13.134397  9372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b837185f01b947538676d920ce6a697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.141351  9371 tablet_service.cc:1511] Processing CreateTablet for tablet c510de9f64d343bba79dcf34bfec0349 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:13.142946  9371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c510de9f64d343bba79dcf34bfec0349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.146265  9370 tablet_service.cc:1511] Processing CreateTablet for tablet b2cefb989e64476285ef0e61a4376aa0 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:13.146266  9223 tablet_service.cc:1511] Processing CreateTablet for tablet b837185f01b947538676d920ce6a697d (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:13.147805  9370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cefb989e64476285ef0e61a4376aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.148020  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b837185f01b947538676d920ce6a697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.151775  9298 tablet_service.cc:1511] Processing CreateTablet for tablet b837185f01b947538676d920ce6a697d (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:13.155746  9221 tablet_service.cc:1511] Processing CreateTablet for tablet b2cefb989e64476285ef0e61a4376aa0 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:13.154179  9296 tablet_service.cc:1511] Processing CreateTablet for tablet b2cefb989e64476285ef0e61a4376aa0 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:13.156549  9222 tablet_service.cc:1511] Processing CreateTablet for tablet c510de9f64d343bba79dcf34bfec0349 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:13.157258  9221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cefb989e64476285ef0e61a4376aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.157325  9296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2cefb989e64476285ef0e61a4376aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.154186  9297 tablet_service.cc:1511] Processing CreateTablet for tablet c510de9f64d343bba79dcf34bfec0349 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:13.158767  9297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c510de9f64d343bba79dcf34bfec0349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.163411  9298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b837185f01b947538676d920ce6a697d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.168460  9222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c510de9f64d343bba79dcf34bfec0349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.185724  9220 tablet_service.cc:1511] Processing CreateTablet for tablet 6836e524bdb543f28e5a00f8c21076bd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:13.193928  9294 tablet_service.cc:1511] Processing CreateTablet for tablet ad776107cf654948bb53a05343b58b1c (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:13.195298  9220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836e524bdb543f28e5a00f8c21076bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.192240  9369 tablet_service.cc:1511] Processing CreateTablet for tablet 6836e524bdb543f28e5a00f8c21076bd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:13.192747  9219 tablet_service.cc:1511] Processing CreateTablet for tablet ad776107cf654948bb53a05343b58b1c (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:13.190063  9295 tablet_service.cc:1511] Processing CreateTablet for tablet 6836e524bdb543f28e5a00f8c21076bd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:13.203559  9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836e524bdb543f28e5a00f8c21076bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.204097  9218 tablet_service.cc:1511] Processing CreateTablet for tablet c3cd052e8b3c420b881b7952d47e0519 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:13.205879  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cd052e8b3c420b881b7952d47e0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.207440  9219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad776107cf654948bb53a05343b58b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.215270  9293 tablet_service.cc:1511] Processing CreateTablet for tablet c3cd052e8b3c420b881b7952d47e0519 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:13.216404  9368 tablet_service.cc:1511] Processing CreateTablet for tablet ad776107cf654948bb53a05343b58b1c (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:13.217429  9368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad776107cf654948bb53a05343b58b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.219287  9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6836e524bdb543f28e5a00f8c21076bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.221163  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad776107cf654948bb53a05343b58b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.223856  9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cd052e8b3c420b881b7952d47e0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.267292  9423 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.271692  9372 tablet_service.cc:1511] Processing CreateTablet for tablet c3cd052e8b3c420b881b7952d47e0519 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:13.273182  9372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3cd052e8b3c420b881b7952d47e0519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.274878  9423 tablet_bootstrap.cc:654] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.295929  9422 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.296432  9296 tablet_service.cc:1511] Processing CreateTablet for tablet e23638187f0a48f591e5ad5af6b8fe8a (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:13.298105  9296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23638187f0a48f591e5ad5af6b8fe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.301770  9218 tablet_service.cc:1511] Processing CreateTablet for tablet e23638187f0a48f591e5ad5af6b8fe8a (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:13.304651  9424 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.306958  9423 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.307646  9423 ts_tablet_manager.cc:1403] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.011s
I20260709 12:26:13.308274  9371 tablet_service.cc:1511] Processing CreateTablet for tablet e23638187f0a48f591e5ad5af6b8fe8a (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:13.309880  9371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23638187f0a48f591e5ad5af6b8fe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.311293  9424 tablet_bootstrap.cc:654] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.313130  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23638187f0a48f591e5ad5af6b8fe8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.316180  9424 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.316781  9424 ts_tablet_manager.cc:1403] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:26:13.312875  9423 raft_consensus.cc:359] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.318499  9219 tablet_service.cc:1511] Processing CreateTablet for tablet 1515a52128c045438f5000a759a9dcfd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:13.319172  9423 raft_consensus.cc:385] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.319515  9423 raft_consensus.cc:740] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.320019  9219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1515a52128c045438f5000a759a9dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.320457  9423 consensus_queue.cc:260] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.323319  9424 raft_consensus.cc:359] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.324060  9424 raft_consensus.cc:385] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.324344  9424 raft_consensus.cc:740] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.325089  9424 consensus_queue.cc:260] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.332901  9294 tablet_service.cc:1511] Processing CreateTablet for tablet 1515a52128c045438f5000a759a9dcfd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:13.333727  9423 ts_tablet_manager.cc:1434] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 12:26:13.334075  9422 tablet_bootstrap.cc:654] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.334339  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1515a52128c045438f5000a759a9dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.335192  9370 tablet_service.cc:1511] Processing CreateTablet for tablet 1515a52128c045438f5000a759a9dcfd (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:13.336498  9370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1515a52128c045438f5000a759a9dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.339174  9258 heartbeater.cc:499] Master 127.29.143.254:43029 was elected leader, sending a full tablet report...
I20260709 12:26:13.343978  9223 tablet_service.cc:1511] Processing CreateTablet for tablet d2cb291f50e7422aad35b2739ffdf003 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:13.345351  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cb291f50e7422aad35b2739ffdf003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.355378  9423 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.359067  9293 tablet_service.cc:1511] Processing CreateTablet for tablet d2cb291f50e7422aad35b2739ffdf003 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:13.360440  9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cb291f50e7422aad35b2739ffdf003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.380955  9423 tablet_bootstrap.cc:654] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.384907  9370 tablet_service.cc:1511] Processing CreateTablet for tablet d2cb291f50e7422aad35b2739ffdf003 (DEFAULT_TABLE table=test-workload [id=be8c654df6a441e2a7a400c3aab92e7c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:13.386270  9370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cb291f50e7422aad35b2739ffdf003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.387441  9422 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.388305  9422 ts_tablet_manager.cc:1403] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.017s
I20260709 12:26:13.392182  9333 heartbeater.cc:499] Master 127.29.143.254:43029 was elected leader, sending a full tablet report...
I20260709 12:26:13.392428  9422 raft_consensus.cc:359] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.393633  9422 raft_consensus.cc:385] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.394110  9422 raft_consensus.cc:740] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.393235  9424 ts_tablet_manager.cc:1434] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.076s	user 0.020s	sys 0.008s
I20260709 12:26:13.396131  9424 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.396766  9422 consensus_queue.cc:260] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.403172  9423 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.403910  9423 ts_tablet_manager.cc:1403] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.011s
I20260709 12:26:13.406566  9424 tablet_bootstrap.cc:654] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.406981  9423 raft_consensus.cc:359] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.407825  9423 raft_consensus.cc:385] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.408169  9423 raft_consensus.cc:740] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.409073  9423 consensus_queue.cc:260] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.411213  9423 ts_tablet_manager.cc:1434] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:13.412185  9423 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.419646  9423 tablet_bootstrap.cc:654] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.424198  9424 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.424962  9424 ts_tablet_manager.cc:1403] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.011s
I20260709 12:26:13.429003  9424 raft_consensus.cc:359] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.430231  9424 raft_consensus.cc:385] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.430711  9424 raft_consensus.cc:740] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.431937  9424 consensus_queue.cc:260] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.435328  9424 ts_tablet_manager.cc:1434] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:26:13.436663  9424 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.447337  9424 tablet_bootstrap.cc:654] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.454061  9428 raft_consensus.cc:493] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.454957  9428 raft_consensus.cc:515] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.461951  9422 ts_tablet_manager.cc:1434] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.073s	user 0.040s	sys 0.027s
I20260709 12:26:13.462606  9407 heartbeater.cc:499] Master 127.29.143.254:43029 was elected leader, sending a full tablet report...
I20260709 12:26:13.463196  9422 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.464996  9423 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.465505  9423 ts_tablet_manager.cc:1403] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.027s
I20260709 12:26:13.465440  9428 leader_election.cc:290] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167), cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603)
I20260709 12:26:13.468776  9423 raft_consensus.cc:359] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.469499  9423 raft_consensus.cc:385] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.469772  9423 raft_consensus.cc:740] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.470885  9422 tablet_bootstrap.cc:654] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.470547  9423 consensus_queue.cc:260] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.473114  9423 ts_tablet_manager.cc:1434] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:13.474164  9423 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.479816  9428 raft_consensus.cc:493] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.480741  9423 tablet_bootstrap.cc:654] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.480638  9428 raft_consensus.cc:515] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.484047  9428 leader_election.cc:290] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.496377  9427 raft_consensus.cc:493] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.496912  9427 raft_consensus.cc:515] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.510663  9427 leader_election.cc:290] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.512032  9424 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.513415  9424 ts_tablet_manager.cc:1403] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.001s
I20260709 12:26:13.515241  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.517269  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.517546  9424 raft_consensus.cc:359] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.518268  9382 raft_consensus.cc:2468] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.518646  9424 raft_consensus.cc:385] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.519256  9424 raft_consensus.cc:740] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
W20260709 12:26:13.519840  9271 leader_election.cc:343] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.520417  9424 consensus_queue.cc:260] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.523140  9271 leader_election.cc:304] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.524389  9428 raft_consensus.cc:2804] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.524940  9428 raft_consensus.cc:493] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.525436  9428 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.532763  9424 ts_tablet_manager.cc:1434] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:26:13.543700  9424 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.552968  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.554957  9424 tablet_bootstrap.cc:654] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:13.555577  9196 leader_election.cc:343] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.562783  9423 tablet_bootstrap.cc:492] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.563400  9422 tablet_bootstrap.cc:492] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.563426  9423 ts_tablet_manager.cc:1403] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.047s
I20260709 12:26:13.565610  9428 raft_consensus.cc:515] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.566289  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.567221  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.568791  9232 raft_consensus.cc:2468] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.569721  9428 leader_election.cc:290] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167), cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603)
I20260709 12:26:13.570755  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:13.571399  9382 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.572644  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:13.573161  9424 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.573359  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:13.567693  9423 raft_consensus.cc:359] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.563958  9422 ts_tablet_manager.cc:1403] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.101s	user 0.043s	sys 0.053s
I20260709 12:26:13.574903  9424 ts_tablet_manager.cc:1403] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
W20260709 12:26:13.576256  9197 leader_election.cc:343] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.576730  9197 leader_election.cc:304] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b; no voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7
I20260709 12:26:13.577927  9427 raft_consensus.cc:2749] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:13.578133  9422 raft_consensus.cc:359] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.574033  9273 leader_election.cc:304] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: e953690054e2496da0781506a7d20ea7
I20260709 12:26:13.578963  9422 raft_consensus.cc:385] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.578744  9424 raft_consensus.cc:359] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.579387  9422 raft_consensus.cc:740] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.579583  9424 raft_consensus.cc:385] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.579939  9424 raft_consensus.cc:740] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.579948  9382 raft_consensus.cc:2468] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.580396  9428 raft_consensus.cc:2804] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.580279  9422 consensus_queue.cc:260] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.580844  9428 raft_consensus.cc:493] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.581303  9423 raft_consensus.cc:385] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.581511  9428 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.581537  9271 leader_election.cc:304] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:13.581717  9423 raft_consensus.cc:740] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.583132  9423 consensus_queue.cc:260] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.584297  9233 raft_consensus.cc:2468] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.585114  9422 ts_tablet_manager.cc:1434] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:26:13.586082  9427 raft_consensus.cc:493] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.586472  9422 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.586625  9427 raft_consensus.cc:515] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.593751  9422 tablet_bootstrap.cc:654] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.580793  9424 consensus_queue.cc:260] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.602262  9424 ts_tablet_manager.cc:1434] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:26:13.603349  9424 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.605142  9445 raft_consensus.cc:2804] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.607059  9427 leader_election.cc:290] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.605865  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:13.607295  9445 raft_consensus.cc:697] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:13.607832  9308 raft_consensus.cc:2468] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:13.608290  9445 consensus_queue.cc:237] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:13.609297  9197 leader_election.cc:304] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:13.610256  9444 raft_consensus.cc:2804] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.610826  9444 raft_consensus.cc:493] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.611218  9444 raft_consensus.cc:3060] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.617945  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.611388  9424 tablet_bootstrap.cc:654] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:13.619735  9196 leader_election.cc:343] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.622283  9422 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.606180  9423 ts_tablet_manager.cc:1434] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.041s	user 0.016s	sys 0.007s
I20260709 12:26:13.622931  9422 ts_tablet_manager.cc:1403] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.003s
I20260709 12:26:13.623898  9428 raft_consensus.cc:515] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.624998  9423 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.626055  9422 raft_consensus.cc:359] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.626843  9422 raft_consensus.cc:385] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.627048  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:13.627816  9233 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.630739  9444 raft_consensus.cc:515] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.632335  9423 tablet_bootstrap.cc:654] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.633809  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:13.627135  9422 raft_consensus.cc:740] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.634773  9444 leader_election.cc:290] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.635427  9308 raft_consensus.cc:3060] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.635957  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:13.636596  9381 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.637210  9233 raft_consensus.cc:2468] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.638465  9273 leader_election.cc:304] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:13.639362  9445 raft_consensus.cc:2804] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.639845  9445 raft_consensus.cc:697] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:13.640723  9445 consensus_queue.cc:237] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.642379  9428 leader_election.cc:290] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.643790  9422 consensus_queue.cc:260] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.644338  9424 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.645097  9424 ts_tablet_manager.cc:1403] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 12:26:13.647477  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:13.646463  9422 ts_tablet_manager.cc:1434] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
W20260709 12:26:13.649721  9196 leader_election.cc:343] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.651640  9422 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
W20260709 12:26:13.659296  9179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:13.660825  9424 raft_consensus.cc:359] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.661679  9424 raft_consensus.cc:385] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.661976  9424 raft_consensus.cc:740] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.662866  9424 consensus_queue.cc:260] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.666715  9424 ts_tablet_manager.cc:1434] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:13.669108  9424 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.674837  9308 raft_consensus.cc:2468] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:13.664932  9381 raft_consensus.cc:2468] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.676393  9197 leader_election.cc:304] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: e953690054e2496da0781506a7d20ea7
I20260709 12:26:13.676745  9422 tablet_bootstrap.cc:654] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.677258  9444 raft_consensus.cc:2804] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.677778  9444 raft_consensus.cc:697] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:13.678314  9424 tablet_bootstrap.cc:654] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.678658  9444 consensus_queue.cc:237] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.683794  9423 tablet_bootstrap.cc:492] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.684590  9423 ts_tablet_manager.cc:1403] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.022s
I20260709 12:26:13.688606  9423 raft_consensus.cc:359] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.689576  9423 raft_consensus.cc:385] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.689941  9423 raft_consensus.cc:740] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.693989  9423 consensus_queue.cc:260] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.697572  9423 ts_tablet_manager.cc:1434] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:13.698978  9423 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.701560  9129 catalog_manager.cc:5697] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.705113  9129 catalog_manager.cc:5697] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.707532  9423 tablet_bootstrap.cc:654] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.708544  9431 raft_consensus.cc:493] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.709044  9431 raft_consensus.cc:515] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.709693  9424 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.710196  9424 ts_tablet_manager.cc:1403] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.028s
I20260709 12:26:13.713487  9424 raft_consensus.cc:359] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.714268  9424 raft_consensus.cc:385] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.714589  9424 raft_consensus.cc:740] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.715365  9424 consensus_queue.cc:260] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.718312  9424 ts_tablet_manager.cc:1434] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:26:13.719718  9424 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.721377  9431 leader_election.cc:290] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:13.727886  9424 tablet_bootstrap.cc:654] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.736181  9422 tablet_bootstrap.cc:492] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.736989  9422 ts_tablet_manager.cc:1403] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.018s
I20260709 12:26:13.757500  9422 raft_consensus.cc:359] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.758615  9422 raft_consensus.cc:385] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.759023  9422 raft_consensus.cc:740] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.759995  9422 consensus_queue.cc:260] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.763538  9422 ts_tablet_manager.cc:1434] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:26:13.764297  9422 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.769107  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.769876  9233 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:13.770413  9422 tablet_bootstrap.cc:654] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.770470  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:13.771327  9308 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:13.771416  9347 leader_election.cc:304] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.772349  9431 raft_consensus.cc:2804] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.772720  9431 raft_consensus.cc:493] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.773068  9424 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.773079  9431 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.773834  9424 ts_tablet_manager.cc:1403] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.012s
I20260709 12:26:13.776835  9424 raft_consensus.cc:359] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.777747  9424 raft_consensus.cc:385] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.778108  9424 raft_consensus.cc:740] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.779146  9424 consensus_queue.cc:260] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.782274  9445 raft_consensus.cc:493] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.782452  9424 ts_tablet_manager.cc:1434] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:13.782763  9445 raft_consensus.cc:515] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.783902  9424 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.784300  9423 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.784833  9423 ts_tablet_manager.cc:1403] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.039s
I20260709 12:26:13.785002  9445 leader_election.cc:290] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.786633  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.787597  9422 tablet_bootstrap.cc:492] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.788102  9422 ts_tablet_manager.cc:1403] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
W20260709 12:26:13.788295  9271 leader_election.cc:343] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.788020  9423 raft_consensus.cc:359] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.788867  9423 raft_consensus.cc:385] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.789299  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.789868  9431 raft_consensus.cc:515] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.790591  9423 raft_consensus.cc:740] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.791334  9424 tablet_bootstrap.cc:654] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.791344  9422 raft_consensus.cc:359] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.792342  9422 raft_consensus.cc:385] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.792671  9422 raft_consensus.cc:740] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.793292  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:13.793612  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:13.793934  9232 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.794346  9308 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.791810  9423 consensus_queue.cc:260] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.796520  9423 ts_tablet_manager.cc:1434] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:26:13.797520  9423 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.799026  9233 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.801625  9273 leader_election.cc:304] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: e953690054e2496da0781506a7d20ea7
I20260709 12:26:13.802235  9232 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:13.803321  9445 raft_consensus.cc:2804] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.803574  9347 leader_election.cc:304] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.803957  9423 tablet_bootstrap.cc:654] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.803877  9445 raft_consensus.cc:493] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.804540  9445 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.793527  9422 consensus_queue.cc:260] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.807127  9462 raft_consensus.cc:2804] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.813859  9422 ts_tablet_manager.cc:1434] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:26:13.814807  9431 leader_election.cc:290] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:13.815833  9422 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.818634  9462 raft_consensus.cc:697] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:13.822731  9308 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:13.822736  9445 raft_consensus.cc:515] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.826988  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:13.829140  9424 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.829411  9233 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.829510  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:13.830370  9422 tablet_bootstrap.cc:654] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.830315  9381 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.824312  9423 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.838860  9445 leader_election.cc:290] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.829635  9424 ts_tablet_manager.cc:1403] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.009s
I20260709 12:26:13.839591  9423 ts_tablet_manager.cc:1403] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.015s
I20260709 12:26:13.840421  9381 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.841831  9271 leader_election.cc:304] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.842793  9445 raft_consensus.cc:2804] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.843557  9445 raft_consensus.cc:697] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:13.843369  9462 consensus_queue.cc:237] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.844739  9233 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.844656  9445 consensus_queue.cc:237] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.842486  9424 raft_consensus.cc:359] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.847965  9423 raft_consensus.cc:359] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.848735  9424 raft_consensus.cc:385] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.849157  9424 raft_consensus.cc:740] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.850549  9424 consensus_queue.cc:260] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.849017  9423 raft_consensus.cc:385] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.853250  9423 raft_consensus.cc:740] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.854022  9423 consensus_queue.cc:260] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.854343  9424 ts_tablet_manager.cc:1434] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:26:13.855942  9424 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:13.856226  9423 ts_tablet_manager.cc:1434] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.007s
I20260709 12:26:13.857252  9423 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.861850  9422 tablet_bootstrap.cc:492] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.862612  9422 ts_tablet_manager.cc:1403] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.010s
I20260709 12:26:13.864122  9423 tablet_bootstrap.cc:654] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.865089  9131 catalog_manager.cc:5697] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 0 to 1, leader changed from <none> to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.866384  9422 raft_consensus.cc:359] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.867337  9424 tablet_bootstrap.cc:654] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.867391  9422 raft_consensus.cc:385] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.868058  9422 raft_consensus.cc:740] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.869304  9445 raft_consensus.cc:493] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.869386  9422 consensus_queue.cc:260] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.869885  9445 raft_consensus.cc:515] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.873505  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.875093  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
W20260709 12:26:13.877039  9271 leader_election.cc:343] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.878178  9445 leader_election.cc:290] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.880538  9423 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.881121  9423 ts_tablet_manager.cc:1403] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:26:13.882036  9422 ts_tablet_manager.cc:1434] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
W20260709 12:26:13.883450  9273 leader_election.cc:343] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:13.883684  9422 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.883960  9273 leader_election.cc:304] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae; no voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7
I20260709 12:26:13.883985  9423 raft_consensus.cc:359] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.884907  9423 raft_consensus.cc:385] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.885169  9423 raft_consensus.cc:740] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.885382  9445 raft_consensus.cc:2749] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:13.881949  9129 catalog_manager.cc:5697] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.886503  9423 consensus_queue.cc:260] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.895190  9422 tablet_bootstrap.cc:654] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.903554  9423 ts_tablet_manager.cc:1434] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:26:13.904593  9423 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:13.907917  9422 tablet_bootstrap.cc:492] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.908542  9422 ts_tablet_manager.cc:1403] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 12:26:13.910725  9423 tablet_bootstrap.cc:654] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.911888  9422 raft_consensus.cc:359] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.912739  9422 raft_consensus.cc:385] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.913086  9422 raft_consensus.cc:740] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.914271  9422 consensus_queue.cc:260] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.917824  9130 catalog_manager.cc:5697] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.922004  9424 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:13.922663  9424 ts_tablet_manager.cc:1403] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.028s
I20260709 12:26:13.925773  9424 raft_consensus.cc:359] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.926393  9424 raft_consensus.cc:385] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.926653  9424 raft_consensus.cc:740] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.917824  9422 ts_tablet_manager.cc:1434] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:13.927762  9424 consensus_queue.cc:260] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.928397  9422 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.936746  9422 tablet_bootstrap.cc:654] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.937338  9424 ts_tablet_manager.cc:1434] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:26:13.942559  9445 raft_consensus.cc:493] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.943379  9445 raft_consensus.cc:515] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.945250  9423 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:13.945839  9423 ts_tablet_manager.cc:1403] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.013s
I20260709 12:26:13.947665  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.948597  9233 raft_consensus.cc:2468] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.949064  9423 raft_consensus.cc:359] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.950038  9423 raft_consensus.cc:385] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.950417  9423 raft_consensus.cc:740] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.950342  9273 leader_election.cc:304] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:13.951709  9428 raft_consensus.cc:2804] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.951669  9423 consensus_queue.cc:260] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.952309  9428 raft_consensus.cc:493] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.952808  9428 raft_consensus.cc:3060] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.954732  9423 ts_tablet_manager.cc:1434] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:26:13.955973  9445 leader_election.cc:290] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.957134  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:13.957849  9381 raft_consensus.cc:2468] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:13.957187  9462 raft_consensus.cc:493] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.959252  9462 raft_consensus.cc:515] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.961035  9422 tablet_bootstrap.cc:492] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.961406  9462 leader_election.cc:290] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:13.961684  9422 ts_tablet_manager.cc:1403] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.000s
I20260709 12:26:13.961922  9428 raft_consensus.cc:515] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.964078  9428 leader_election.cc:290] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:13.964741  9422 raft_consensus.cc:359] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.964900  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.965368  9422 raft_consensus.cc:385] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.965703  9422 raft_consensus.cc:740] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.966609  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:13.966549  9422 consensus_queue.cc:260] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.965611  9233 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:13.969463  9422 ts_tablet_manager.cc:1434] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:13.967253  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3cd052e8b3c420b881b7952d47e0519" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:13.967918  9465 raft_consensus.cc:493] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.965466  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:13.967224  9381 raft_consensus.cc:3060] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.972703  9422 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:13.972826  9308 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:13.973642  9232 raft_consensus.cc:3060] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.972604  9465 raft_consensus.cc:515] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.976454  9465 leader_election.cc:290] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:13.972705  9347 leader_election.cc:304] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.980370  9422 tablet_bootstrap.cc:654] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.981261  9381 raft_consensus.cc:2468] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.982072  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:13.982496  9232 raft_consensus.cc:2468] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:13.982610  9271 leader_election.cc:304] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:13.983662  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2cefb989e64476285ef0e61a4376aa0" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:13.983855  9428 raft_consensus.cc:2804] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.984790  9465 raft_consensus.cc:2804] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:13.983088  9308 raft_consensus.cc:2393] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e953690054e2496da0781506a7d20ea7 in current term 1: Already voted for candidate cc5f07c44fb345f79a613769f670f73b in this term.
I20260709 12:26:13.985700  9428 raft_consensus.cc:697] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:13.988548  9428 consensus_queue.cc:237] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.988987  9422 tablet_bootstrap.cc:492] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:13.989001  9346 leader_election.cc:304] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e953690054e2496da0781506a7d20ea7; no voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:13.989560  9422 ts_tablet_manager.cc:1403] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:26:13.989884  9462 raft_consensus.cc:3060] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.987823  9465 raft_consensus.cc:493] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.993046  9465 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.992758  9422 raft_consensus.cc:359] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.993736  9422 raft_consensus.cc:385] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.994097  9422 raft_consensus.cc:740] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.995059  9422 consensus_queue.cc:260] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:13.997277  9422 ts_tablet_manager.cc:1434] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:13.997363  9462 raft_consensus.cc:2749] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:14.001812  9465 raft_consensus.cc:515] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.004757  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.005263  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.005772  9232 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.006230  9308 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.006851  9129 catalog_manager.cc:5697] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.014797  9465 leader_election.cc:290] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:14.015300  9232 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:14.014660  9308 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:14.016618  9347 leader_election.cc:304] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.017592  9465 raft_consensus.cc:2804] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.017978  9465 raft_consensus.cc:697] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.018729  9465 consensus_queue.cc:237] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.026214  9129 catalog_manager.cc:5697] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.043764  9428 consensus_queue.cc:1048] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.053241  9232 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.061691  9443 consensus_queue.cc:1048] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.069943  9427 consensus_queue.cc:1048] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.072865  9443 consensus_queue.cc:1048] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.077369  9427 consensus_queue.cc:1048] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.087046  9445 consensus_queue.cc:1048] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.144377  9465 raft_consensus.cc:493] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.144867  9465 raft_consensus.cc:515] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.146816  9465 leader_election.cc:290] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:14.147823  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:14.148036  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:14.148484  9232 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:14.148800  9308 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:14.149731  9347 leader_election.cc:304] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.150765  9465 raft_consensus.cc:2804] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.151078  9465 raft_consensus.cc:493] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.151307  9465 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.156633  9465 raft_consensus.cc:515] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.158406  9465 leader_election.cc:290] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:14.159130  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.159403  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.159713  9232 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.160079  9308 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.165210  9308 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:14.165683  9232 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:14.166232  9346 leader_election.cc:304] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.167042  9465 raft_consensus.cc:2804] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.167613  9465 raft_consensus.cc:697] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.168393  9465 consensus_queue.cc:237] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.178473  9131 catalog_manager.cc:5697] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.222378  9489 raft_consensus.cc:493] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.223168  9489 raft_consensus.cc:515] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.225191  9489 leader_election.cc:290] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.226056  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:14.226394  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:14.226858  9308 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:14.227092  9382 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:14.227996  9197 leader_election.cc:304] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:14.228741  9489 raft_consensus.cc:2804] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.229105  9489 raft_consensus.cc:493] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.229387  9489 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.234452  9489 raft_consensus.cc:515] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.235951  9489 leader_election.cc:290] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.236840  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.237043  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.237452  9308 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.237581  9382 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.244570  9308 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:14.244573  9382 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:14.245873  9197 leader_election.cc:304] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:14.246666  9489 raft_consensus.cc:2804] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.247267  9489 raft_consensus.cc:697] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:14.248059  9489 consensus_queue.cc:237] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.253449  9465 consensus_queue.cc:1048] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.256209  9131 catalog_manager.cc:5697] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 0 to 1, leader changed from <none> to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.270291  9462 consensus_queue.cc:1048] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.299465  9308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b837185f01b947538676d920ce6a697d"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:26:14.299985  9308 raft_consensus.cc:606] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:14.305306  9308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:26:14.305760  9308 raft_consensus.cc:606] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:14.313495  9308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:26:14.313944  9308 raft_consensus.cc:606] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:14.326886  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:14.327437  9382 raft_consensus.cc:606] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:14.336155  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:14.336688  9382 raft_consensus.cc:606] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:14.341598  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:14.342068  9382 raft_consensus.cc:606] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:14.355206  9232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:32936
I20260709 12:26:14.355786  9232 raft_consensus.cc:606] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:14.369438  9486 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.375849  9428 raft_consensus.cc:993] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.376382  9445 raft_consensus.cc:1081] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.379593  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32926
I20260709 12:26:14.380264  9233 raft_consensus.cc:493] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.380734  9233 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.383661  9428 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.391417  9233 raft_consensus.cc:515] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.393535  9233 leader_election.cc:290] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.394507  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.394870  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.395269  9308 raft_consensus.cc:3055] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.395547  9382 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.395784  9308 raft_consensus.cc:740] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.396785  9308 consensus_queue.cc:260] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.398005  9308 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.401475  9382 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.402793  9196 leader_election.cc:304] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.403648  9489 raft_consensus.cc:2804] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.404031  9308 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.404227  9489 raft_consensus.cc:697] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:14.405280  9489 consensus_queue.cc:237] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.412457  9129 catalog_manager.cc:5697] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.432116  9445 consensus_queue.cc:1048] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.444126  9445 consensus_queue.cc:1048] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.591104  9462 consensus_queue.cc:1048] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.602769  9463 consensus_queue.cc:1048] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.604445  9486 raft_consensus.cc:993] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.605063  9486 raft_consensus.cc:1081] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.607224  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b837185f01b947538676d920ce6a697d"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32926
I20260709 12:26:14.609956  9233 raft_consensus.cc:493] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.611225  9233 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.611613  9463 raft_consensus.cc:993] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.612213  9463 raft_consensus.cc:1081] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.614017  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:14.614645  9307 raft_consensus.cc:493] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.615047  9307 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.619099  9233 raft_consensus.cc:515] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:14.621359  9233 leader_election.cc:290] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:14.622665  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.622560  9463 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:14.623176  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b837185f01b947538676d920ce6a697d" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.623394  9308 raft_consensus.cc:3055] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.623788  9308 raft_consensus.cc:740] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.623822  9382 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.624605  9443 raft_consensus.cc:993] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.625125  9443 raft_consensus.cc:1081] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:14.624722  9308 consensus_queue.cc:260] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:14.626171  9308 raft_consensus.cc:3060] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.627025  9233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32926
I20260709 12:26:14.627684  9233 raft_consensus.cc:493] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.628108  9233 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.632903  9382 raft_consensus.cc:2468] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.634343  9196 leader_election.cc:304] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.634980  9307 raft_consensus.cc:515] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.637742  9308 raft_consensus.cc:2468] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.638281  9489 raft_consensus.cc:2804] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.641911  9489 raft_consensus.cc:697] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:14.641963  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.638175  9463 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.640923  9307 leader_election.cc:290] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.642609  9382 raft_consensus.cc:3055] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.653717  9382 raft_consensus.cc:740] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.648216  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23638187f0a48f591e5ad5af6b8fe8a" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.642882  9489 consensus_queue.cc:237] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } }
I20260709 12:26:14.654794  9382 consensus_queue.cc:260] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.655450  9231 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.656172  9382 raft_consensus.cc:3060] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.651337  9233 raft_consensus.cc:515] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.652195  9431 raft_consensus.cc:993] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.659560  9431 raft_consensus.cc:1081] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.660471  9233 leader_election.cc:290] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.661664  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.662271  9308 raft_consensus.cc:3055] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.662572  9308 raft_consensus.cc:740] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.663393  9308 consensus_queue.cc:260] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.664589  9308 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.667557  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:14.667733  9382 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.668164  9307 raft_consensus.cc:493] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.669104  9271 leader_election.cc:304] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.670018  9445 raft_consensus.cc:2804] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.670054  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6836e524bdb543f28e5a00f8c21076bd" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.670614  9445 raft_consensus.cc:697] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.670902  9381 raft_consensus.cc:3060] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.671540  9445 consensus_queue.cc:237] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.676934  9231 raft_consensus.cc:2468] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.677655  9307 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.678798  9381 raft_consensus.cc:2468] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.681193  9308 raft_consensus.cc:2468] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:14.681710  9196 leader_election.cc:304] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.682807  9489 raft_consensus.cc:2804] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.683336  9489 raft_consensus.cc:697] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:14.681788  9129 catalog_manager.cc:5697] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.684172  9489 consensus_queue.cc:237] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.686830  9307 raft_consensus.cc:515] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.690621  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.691314  9231 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.691949  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.692600  9382 raft_consensus.cc:3055] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.692912  9382 raft_consensus.cc:740] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.693746  9382 consensus_queue.cc:260] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.694772  9307 leader_election.cc:290] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.695358  9130 catalog_manager.cc:5697] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.696588  9382 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.702802  9231 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.704074  9489 consensus_queue.cc:1048] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:14.704174  9273 leader_election.cc:304] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:14.705283  9382 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.706037  9445 raft_consensus.cc:2804] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.706529  9445 raft_consensus.cc:697] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.707409  9445 consensus_queue.cc:237] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.710130  9129 catalog_manager.cc:5697] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.715870  9489 consensus_queue.cc:1048] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.718158  9130 catalog_manager.cc:5697] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.729645  9491 raft_consensus.cc:993] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:14.730707  9509 raft_consensus.cc:1081] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:14.732501  9381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38032
I20260709 12:26:14.733088  9381 raft_consensus.cc:493] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.733443  9381 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.740020  9381 raft_consensus.cc:515] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.742578  9381 leader_election.cc:290] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:14.742767  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.743692  9231 raft_consensus.cc:3055] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.743810  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cb291f50e7422aad35b2739ffdf003" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:14.744073  9231 raft_consensus.cc:740] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:14.744491  9308 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.744915  9231 consensus_queue.cc:260] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.746251  9231 raft_consensus.cc:3060] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.751111  9308 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 2.
I20260709 12:26:14.752336  9346 leader_election.cc:304] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:14.752523  9231 raft_consensus.cc:2468] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 2.
I20260709 12:26:14.753069  9462 raft_consensus.cc:2804] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.753552  9462 raft_consensus.cc:697] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 2 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.754321  9462 consensus_queue.cc:237] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.761025  9131 catalog_manager.cc:5697] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 1 to 2, leader changed from cc5f07c44fb345f79a613769f670f73b (127.29.143.193) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.812049  9462 raft_consensus.cc:993] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.812597  9463 raft_consensus.cc:1081] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:14.814393  9308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:14.815099  9308 raft_consensus.cc:493] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.815546  9308 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.821354  9308 raft_consensus.cc:515] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.822989  9308 leader_election.cc:290] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:14.824002  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:14.824105  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad776107cf654948bb53a05343b58b1c" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:14.824662  9231 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.824784  9381 raft_consensus.cc:3055] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.825178  9381 raft_consensus.cc:740] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:14.825846  9381 consensus_queue.cc:260] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.826890  9381 raft_consensus.cc:3060] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.829954  9231 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.831120  9273 leader_election.cc:304] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:14.831851  9445 raft_consensus.cc:2804] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.831986  9381 raft_consensus.cc:2468] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:14.832273  9445 raft_consensus.cc:697] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:14.833196  9445 consensus_queue.cc:237] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:14.839270  9131 catalog_manager.cc:5697] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.844959  9308 raft_consensus.cc:1275] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:14.846508  9509 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.854350  9381 raft_consensus.cc:1275] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:14.857604  9489 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.075285  9308 raft_consensus.cc:1275] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.076525  9489 consensus_queue.cc:1048] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.088361  9381 raft_consensus.cc:1275] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.090667  9509 consensus_queue.cc:1048] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.097681  9382 raft_consensus.cc:1275] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.099474  9445 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.109498  9231 raft_consensus.cc:1275] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.111129  9445 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.138886  9382 raft_consensus.cc:1275] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.140149  9509 consensus_queue.cc:1048] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.149158  9308 raft_consensus.cc:1275] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.150871  9489 consensus_queue.cc:1048] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.201215  9308 raft_consensus.cc:1275] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.202447  9463 consensus_queue.cc:1048] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.210089  9231 raft_consensus.cc:1275] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.211700  9462 consensus_queue.cc:1048] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.225181  9382 raft_consensus.cc:1275] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.226610  9445 consensus_queue.cc:1048] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.233937  9231 raft_consensus.cc:1275] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.235580  9443 consensus_queue.cc:1048] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.275552  9231 raft_consensus.cc:1275] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.276913  9443 consensus_queue.cc:1048] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.286221  9382 raft_consensus.cc:1275] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.287652  9443 consensus_queue.cc:1048] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:17.406370  9131 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52136:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:17.408811  9131 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:17.464313  9223 tablet_service.cc:1511] Processing CreateTablet for tablet 82cd00f581ee450597da4de9e7796dbf (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:17.465628  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cd00f581ee450597da4de9e7796dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.465286  9293 tablet_service.cc:1511] Processing CreateTablet for tablet 82cd00f581ee450597da4de9e7796dbf (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:17.466629  9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cd00f581ee450597da4de9e7796dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.469647  9296 tablet_service.cc:1511] Processing CreateTablet for tablet 1304ab8074d74f63a99d72214db07ac0 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:17.471004  9296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1304ab8074d74f63a99d72214db07ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.477228  9294 tablet_service.cc:1511] Processing CreateTablet for tablet e1a134e609ce4844964075005d9a0d95 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:17.478750  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a134e609ce4844964075005d9a0d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.483325  9297 tablet_service.cc:1511] Processing CreateTablet for tablet d9da5f42c7654c93a0ae4f3856a26e24 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:17.483980  9219 tablet_service.cc:1511] Processing CreateTablet for tablet 1304ab8074d74f63a99d72214db07ac0 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:17.484915  9297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9da5f42c7654c93a0ae4f3856a26e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.485357  9219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1304ab8074d74f63a99d72214db07ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.488477  9370 tablet_service.cc:1511] Processing CreateTablet for tablet 82cd00f581ee450597da4de9e7796dbf (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:17.489832  9370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cd00f581ee450597da4de9e7796dbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.491922  9371 tablet_service.cc:1511] Processing CreateTablet for tablet 1304ab8074d74f63a99d72214db07ac0 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:17.493328  9371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1304ab8074d74f63a99d72214db07ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.495219  9220 tablet_service.cc:1511] Processing CreateTablet for tablet 88fadd903d234da7b4aafac97d13ae48 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:17.495488  9221 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2896cefefa41338f3cd4248489bd20 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:17.497804  9369 tablet_service.cc:1511] Processing CreateTablet for tablet d9da5f42c7654c93a0ae4f3856a26e24 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:17.499178  9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9da5f42c7654c93a0ae4f3856a26e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.499719  9372 tablet_service.cc:1511] Processing CreateTablet for tablet e1a134e609ce4844964075005d9a0d95 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:17.500531  9216 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7d6d4ac064ebd8062ec3ebf290401 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:17.498733  9217 tablet_service.cc:1511] Processing CreateTablet for tablet b6395c1d872c410087bd9a42adb65496 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:17.502442  9215 tablet_service.cc:1511] Processing CreateTablet for tablet d53bf31240204d32bd529ecd089e5840 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:17.502635  9292 tablet_service.cc:1511] Processing CreateTablet for tablet b6395c1d872c410087bd9a42adb65496 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:17.502450  9298 tablet_service.cc:1511] Processing CreateTablet for tablet 88fadd903d234da7b4aafac97d13ae48 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:17.503984  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6395c1d872c410087bd9a42adb65496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.504701  9298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fadd903d234da7b4aafac97d13ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.505117  9222 tablet_service.cc:1511] Processing CreateTablet for tablet d9da5f42c7654c93a0ae4f3856a26e24 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:17.505985  9291 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7d6d4ac064ebd8062ec3ebf290401 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:17.507321  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7d6d4ac064ebd8062ec3ebf290401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.510993  9218 tablet_service.cc:1511] Processing CreateTablet for tablet e1a134e609ce4844964075005d9a0d95 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:17.511776  9290 tablet_service.cc:1511] Processing CreateTablet for tablet d53bf31240204d32bd529ecd089e5840 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:17.513082  9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bf31240204d32bd529ecd089e5840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.503597  9295 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2896cefefa41338f3cd4248489bd20 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:17.514642  9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2896cefefa41338f3cd4248489bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.501152  9372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a134e609ce4844964075005d9a0d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.518536  9368 tablet_service.cc:1511] Processing CreateTablet for tablet 88fadd903d234da7b4aafac97d13ae48 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:17.519929  9368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fadd903d234da7b4aafac97d13ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.524645  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2896cefefa41338f3cd4248489bd20 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:17.525130  9365 tablet_service.cc:1511] Processing CreateTablet for tablet a0f7d6d4ac064ebd8062ec3ebf290401 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:17.526120  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2896cefefa41338f3cd4248489bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.527132  9364 tablet_service.cc:1511] Processing CreateTablet for tablet d53bf31240204d32bd529ecd089e5840 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:17.527815  9366 tablet_service.cc:1511] Processing CreateTablet for tablet b6395c1d872c410087bd9a42adb65496 (DEFAULT_TABLE table=soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:17.528486  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7d6d4ac064ebd8062ec3ebf290401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.531347  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6395c1d872c410087bd9a42adb65496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.535336  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bf31240204d32bd529ecd089e5840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.541697  9222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9da5f42c7654c93a0ae4f3856a26e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.542431  9217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6395c1d872c410087bd9a42adb65496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.543352  9221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2896cefefa41338f3cd4248489bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.543991  9218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a134e609ce4844964075005d9a0d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.552419  9216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f7d6d4ac064ebd8062ec3ebf290401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.554157  9220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fadd903d234da7b4aafac97d13ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.562824  9215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53bf31240204d32bd529ecd089e5840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.608004  9533 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
W20260709 12:26:17.736369  9179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:17.754472  9533 tablet_bootstrap.cc:654] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.766754  9534 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:17.795212  9533 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:17.795787  9533 ts_tablet_manager.cc:1403] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.038s
I20260709 12:26:17.797215  9534 tablet_bootstrap.cc:654] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.798954  9533 raft_consensus.cc:359] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.799760  9533 raft_consensus.cc:385] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.808393  9533 raft_consensus.cc:740] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.809435  9533 consensus_queue.cc:260] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.849248  9533 ts_tablet_manager.cc:1434] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.053s	user 0.014s	sys 0.003s
I20260709 12:26:17.850270  9535 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:17.855060  9533 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:17.860285  9535 tablet_bootstrap.cc:654] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.862867  9534 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:17.866050  9534 ts_tablet_manager.cc:1403] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.010s
I20260709 12:26:17.870954  9534 raft_consensus.cc:359] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.873287  9534 raft_consensus.cc:385] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.873677  9534 raft_consensus.cc:740] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.877117  9533 tablet_bootstrap.cc:654] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.874753  9534 consensus_queue.cc:260] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.880327  9534 ts_tablet_manager.cc:1434] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:26:17.881426  9534 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:17.889851  9534 tablet_bootstrap.cc:654] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.895711  9535 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:17.896265  9535 ts_tablet_manager.cc:1403] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.014s
I20260709 12:26:17.900979  9535 raft_consensus.cc:359] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.901721  9535 raft_consensus.cc:385] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.902016  9535 raft_consensus.cc:740] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.902761  9535 consensus_queue.cc:260] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.905066  9535 ts_tablet_manager.cc:1434] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:17.907532  9535 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:17.908150  9533 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:17.908699  9533 ts_tablet_manager.cc:1403] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.008s
I20260709 12:26:17.911851  9533 raft_consensus.cc:359] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.912756  9533 raft_consensus.cc:385] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.913074  9533 raft_consensus.cc:740] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.913874  9534 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:17.914496  9534 ts_tablet_manager.cc:1403] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.020s
I20260709 12:26:17.913830  9533 consensus_queue.cc:260] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.915191  9535 tablet_bootstrap.cc:654] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.916745  9533 ts_tablet_manager.cc:1434] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:26:17.917881  9533 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:17.923533  9534 raft_consensus.cc:359] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.924254  9534 raft_consensus.cc:385] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.924561  9534 raft_consensus.cc:740] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.925253  9534 consensus_queue.cc:260] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.926388  9533 tablet_bootstrap.cc:654] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.930001  9534 ts_tablet_manager.cc:1434] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:17.931073  9534 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:17.933425  9533 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:17.933992  9533 ts_tablet_manager.cc:1403] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 12:26:17.935905  9535 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:17.936474  9535 ts_tablet_manager.cc:1403] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.006s
I20260709 12:26:17.937598  9534 tablet_bootstrap.cc:654] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.937323  9533 raft_consensus.cc:359] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.938243  9533 raft_consensus.cc:385] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.938711  9533 raft_consensus.cc:740] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.939563  9533 consensus_queue.cc:260] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.939993  9535 raft_consensus.cc:359] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.940713  9535 raft_consensus.cc:385] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:17.941041  9535 raft_consensus.cc:740] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.941818  9535 consensus_queue.cc:260] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.942255  9533 ts_tablet_manager.cc:1434] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:17.943535  9533 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:17.944211  9535 ts_tablet_manager.cc:1434] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:17.945649  9535 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:17.945953  9513 raft_consensus.cc:493] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.946467  9513 raft_consensus.cc:515] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:17.948596  9513 leader_election.cc:290] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:17.949860  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:17.950605  9533 tablet_bootstrap.cc:654] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.952461  9535 tablet_bootstrap.cc:654] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:17.952836  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:17.953751  9231 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
W20260709 12:26:17.955608  9271 leader_election.cc:343] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:17.958290  9273 leader_election.cc:304] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: e953690054e2496da0781506a7d20ea7
I20260709 12:26:17.959961  9513 raft_consensus.cc:2804] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:17.960425  9513 raft_consensus.cc:493] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.960911  9513 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:17.999221  9513 raft_consensus.cc:515] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.013486  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.014360  9231 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.027959  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
W20260709 12:26:18.035112  9271 leader_election.cc:343] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.058135  9513 leader_election.cc:290] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.064325  9231 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:18.066265  9273 leader_election.cc:304] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: e953690054e2496da0781506a7d20ea7
I20260709 12:26:18.067922  9513 raft_consensus.cc:2804] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.068570  9513 raft_consensus.cc:697] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:18.069437  9513 consensus_queue.cc:237] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.074256  9534 tablet_bootstrap.cc:492] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.074882  9534 ts_tablet_manager.cc:1403] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.144s	user 0.046s	sys 0.081s
I20260709 12:26:18.075101  9533 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.075567  9535 tablet_bootstrap.cc:492] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.076007  9533 ts_tablet_manager.cc:1403] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.133s	user 0.054s	sys 0.074s
I20260709 12:26:18.076097  9535 ts_tablet_manager.cc:1403] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.131s	user 0.051s	sys 0.074s
I20260709 12:26:18.079283  9533 raft_consensus.cc:359] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.079638  9535 raft_consensus.cc:359] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.080047  9533 raft_consensus.cc:385] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.080029  9534 raft_consensus.cc:359] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.080600  9535 raft_consensus.cc:385] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.080657  9533 raft_consensus.cc:740] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.080927  9534 raft_consensus.cc:385] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.081197  9535 raft_consensus.cc:740] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.081414  9534 raft_consensus.cc:740] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.081874  9533 consensus_queue.cc:260] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.082145  9535 consensus_queue.cc:260] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.082454  9534 consensus_queue.cc:260] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.084892  9534 ts_tablet_manager.cc:1434] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:18.085959  9534 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.086405  9535 ts_tablet_manager.cc:1434] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:26:18.087466  9535 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.088615  9519 raft_consensus.cc:493] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.089139  9519 raft_consensus.cc:515] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.090170  9533 ts_tablet_manager.cc:1434] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:18.091279  9519 leader_election.cc:290] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.091742  9533 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:18.092824  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1304ab8074d74f63a99d72214db07ac0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.093477  9308 raft_consensus.cc:2468] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:18.095098  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1304ab8074d74f63a99d72214db07ac0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.095795  9382 raft_consensus.cc:2468] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:18.096665  9535 tablet_bootstrap.cc:654] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.097575  9534 tablet_bootstrap.cc:654] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.100107  9533 tablet_bootstrap.cc:654] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.102804  9197 leader_election.cc:304] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:18.107085  9519 raft_consensus.cc:2804] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.107537  9519 raft_consensus.cc:493] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.107925  9519 raft_consensus.cc:3060] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.115485  9535 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.116431  9535 ts_tablet_manager.cc:1403] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 12:26:18.118083  9130 catalog_manager.cc:5697] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.121420  9535 raft_consensus.cc:359] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.122272  9535 raft_consensus.cc:385] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.122615  9535 raft_consensus.cc:740] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.122731  9533 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.123420  9533 ts_tablet_manager.cc:1403] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.007s
I20260709 12:26:18.123536  9535 consensus_queue.cc:260] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.126226  9535 ts_tablet_manager.cc:1434] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:18.127336  9535 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.127046  9533 raft_consensus.cc:359] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.128011  9533 raft_consensus.cc:385] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.127940  9519 raft_consensus.cc:515] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.128612  9533 raft_consensus.cc:740] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.129933  9533 consensus_queue.cc:260] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.133023  9533 ts_tablet_manager.cc:1434] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:18.133064  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1304ab8074d74f63a99d72214db07ac0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.133744  9307 raft_consensus.cc:3060] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.134308  9533 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:18.141490  9533 tablet_bootstrap.cc:654] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.141566  9307 raft_consensus.cc:2468] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:18.142840  9197 leader_election.cc:304] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:18.144392  9527 raft_consensus.cc:2804] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.145687  9535 tablet_bootstrap.cc:654] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.154148  9533 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.154651  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1304ab8074d74f63a99d72214db07ac0" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:18.154853  9533 ts_tablet_manager.cc:1403] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.001s
I20260709 12:26:18.155397  9382 raft_consensus.cc:3060] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.159193  9533 raft_consensus.cc:359] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.160408  9533 raft_consensus.cc:385] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.160902  9533 raft_consensus.cc:740] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.161939  9533 consensus_queue.cc:260] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.165148  9533 ts_tablet_manager.cc:1434] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 12:26:18.165807  9535 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.166206  9533 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:18.166344  9535 ts_tablet_manager.cc:1403] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.010s
I20260709 12:26:18.166893  9519 leader_election.cc:290] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.171545  9534 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.172360  9534 ts_tablet_manager.cc:1403] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.007s
I20260709 12:26:18.171597  9535 raft_consensus.cc:359] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.173147  9535 raft_consensus.cc:385] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.173430  9533 tablet_bootstrap.cc:654] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.173496  9535 raft_consensus.cc:740] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.175362  9382 raft_consensus.cc:2468] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:18.176719  9527 raft_consensus.cc:697] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:18.176960  9535 consensus_queue.cc:260] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.178982  9534 raft_consensus.cc:359] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.179126  9527 consensus_queue.cc:237] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.180212  9534 raft_consensus.cc:385] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.180415  9535 ts_tablet_manager.cc:1434] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:26:18.180714  9534 raft_consensus.cc:740] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.181690  9535 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.181828  9534 consensus_queue.cc:260] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.185469  9534 ts_tablet_manager.cc:1434] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:18.186913  9534 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.191203  9535 tablet_bootstrap.cc:654] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.200934  9533 tablet_bootstrap.cc:492] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.201524  9533 ts_tablet_manager.cc:1403] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.014s
I20260709 12:26:18.201922  9535 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.202106  9534 tablet_bootstrap.cc:654] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.202453  9535 ts_tablet_manager.cc:1403] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 12:26:18.204623  9533 raft_consensus.cc:359] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.205436  9533 raft_consensus.cc:385] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.205760  9533 raft_consensus.cc:740] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.206187  9535 raft_consensus.cc:359] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.206533  9533 consensus_queue.cc:260] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.207249  9535 raft_consensus.cc:385] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.207691  9535 raft_consensus.cc:740] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.209302  9533 ts_tablet_manager.cc:1434] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:26:18.209044  9535 consensus_queue.cc:260] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.210670  9533 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:18.212342  9535 ts_tablet_manager.cc:1434] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:18.213804  9535 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.219398  9533 tablet_bootstrap.cc:654] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.199426  9128 catalog_manager.cc:5697] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 0 to 1, leader changed from <none> to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.221815  9513 raft_consensus.cc:493] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.222739  9535 tablet_bootstrap.cc:654] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.225404  9536 raft_consensus.cc:493] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.226568  9513 raft_consensus.cc:515] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.227479  9536 raft_consensus.cc:515] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.230068  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.230365  9536 leader_election.cc:290] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.232795  9513 leader_election.cc:290] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
W20260709 12:26:18.234331  9273 leader_election.cc:343] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.236536  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.238245  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.239173  9381 raft_consensus.cc:2468] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 0.
I20260709 12:26:18.240463  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
W20260709 12:26:18.242373  9273 leader_election.cc:343] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:18.244009  9271 leader_election.cc:343] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.244592  9271 leader_election.cc:304] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae; no voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7
I20260709 12:26:18.246857  9536 raft_consensus.cc:493] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.247538  9536 raft_consensus.cc:515] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.250765  9536 leader_election.cc:290] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.251443  9536 raft_consensus.cc:2749] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:18.256812  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.246208  9271 leader_election.cc:304] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.259359  9537 raft_consensus.cc:2804] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.259861  9537 raft_consensus.cc:493] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.260293  9537 raft_consensus.cc:3060] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:18.263940  9273 leader_election.cc:343] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.276496  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.283511  9462 raft_consensus.cc:493] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.284129  9462 raft_consensus.cc:515] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
W20260709 12:26:18.284849  9271 leader_election.cc:343] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.285394  9271 leader_election.cc:304] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae; no voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7
I20260709 12:26:18.287770  9513 raft_consensus.cc:2749] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:18.293792  9462 leader_election.cc:290] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.294864  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.295662  9307 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.294766  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.296890  9231 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.298430  9347 leader_election.cc:304] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.299520  9462 raft_consensus.cc:2804] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.299877  9462 raft_consensus.cc:493] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.300181  9462 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.307515  9462 raft_consensus.cc:515] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.309917  9462 leader_election.cc:290] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.307511  9537 raft_consensus.cc:515] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.313329  9537 leader_election.cc:290] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.320838  9462 raft_consensus.cc:493] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.321170  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.321635  9462 raft_consensus.cc:515] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
W20260709 12:26:18.323334  9273 leader_election.cc:343] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.325575  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.326449  9462 leader_election.cc:290] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.326599  9233 raft_consensus.cc:2468] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.328743  9347 leader_election.cc:304] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.327708  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.332516  9231 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.350577  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:18.354331  9381 raft_consensus.cc:3060] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.370338  9462 raft_consensus.cc:2804] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.374120  9462 raft_consensus.cc:493] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.374634  9462 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.394371  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.395207  9307 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.403796  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
W20260709 12:26:18.405886  9346 leader_election.cc:343] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.407584  9537 raft_consensus.cc:493] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.408306  9537 raft_consensus.cc:515] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.411283  9537 leader_election.cc:290] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.411815  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
W20260709 12:26:18.413345  9273 leader_election.cc:343] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.415215  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.419958  9307 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.422026  9566 raft_consensus.cc:493] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.427413  9346 leader_election.cc:304] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
W20260709 12:26:18.429558  9271 leader_election.cc:343] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.430083  9271 leader_election.cc:304] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae; no voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7
I20260709 12:26:18.431397  9537 raft_consensus.cc:2749] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:18.431732  9568 raft_consensus.cc:2804] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.432158  9566 raft_consensus.cc:515] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.432272  9568 raft_consensus.cc:697] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:18.435446  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.436275  9233 raft_consensus.cc:2393] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e953690054e2496da0781506a7d20ea7 in current term 1: Already voted for candidate 809eae370c384ccdaf3804b2e179afae in this term.
I20260709 12:26:18.437511  9381 raft_consensus.cc:2468] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 1.
I20260709 12:26:18.434466  9568 consensus_queue.cc:237] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.442207  9231 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.457394  9129 catalog_manager.cc:5697] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.445660  9271 leader_election.cc:304] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.447499  9566 leader_election.cc:290] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.459417  9537 raft_consensus.cc:2804] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.459792  9535 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.459892  9537 raft_consensus.cc:697] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:18.460485  9535 ts_tablet_manager.cc:1403] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.247s	user 0.102s	sys 0.119s
I20260709 12:26:18.460902  9537 consensus_queue.cc:237] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.463056  9535 raft_consensus.cc:359] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.463830  9535 raft_consensus.cc:385] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.464166  9535 raft_consensus.cc:740] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.464956  9535 consensus_queue.cc:260] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.466353  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.467481  9535 ts_tablet_manager.cc:1434] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:18.468118  9346 leader_election.cc:304] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e953690054e2496da0781506a7d20ea7; no voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.468565  9535 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.469333  9566 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.475672  9535 tablet_bootstrap.cc:654] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.477720  9566 raft_consensus.cc:2749] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:18.452797  9533 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.455199  9462 raft_consensus.cc:515] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.456190  9534 tablet_bootstrap.cc:492] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.480619  9533 ts_tablet_manager.cc:1403] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.270s	user 0.059s	sys 0.109s
I20260709 12:26:18.480763  9534 ts_tablet_manager.cc:1403] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.294s	user 0.075s	sys 0.145s
I20260709 12:26:18.482116  9462 leader_election.cc:290] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.483903  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.484622  9231 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.484391  9534 raft_consensus.cc:359] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.485244  9534 raft_consensus.cc:385] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.485577  9534 raft_consensus.cc:740] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.485937  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.486505  9534 consensus_queue.cc:260] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
W20260709 12:26:18.487840  9346 leader_election.cc:343] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.489578  9534 ts_tablet_manager.cc:1434] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:18.490772  9533 raft_consensus.cc:359] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.491513  9533 raft_consensus.cc:385] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.491789  9533 raft_consensus.cc:740] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.492544  9533 consensus_queue.cc:260] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.494210  9533 ts_tablet_manager.cc:1434] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 12:26:18.495546  9534 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.495400  9462 raft_consensus.cc:493] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.496101  9462 raft_consensus.cc:515] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.499300  9233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
W20260709 12:26:18.501057  9347 leader_election.cc:343] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.503202  9533 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Bootstrap starting.
I20260709 12:26:18.504474  9462 leader_election.cc:290] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.506953  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.508653  9307 raft_consensus.cc:2468] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.508893  9231 raft_consensus.cc:2468] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.510210  9347 leader_election.cc:304] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:18.510221  9346 leader_election.cc:304] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.511670  9462 raft_consensus.cc:2804] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.512297  9568 raft_consensus.cc:2804] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.512653  9568 raft_consensus.cc:493] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.512972  9535 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.512989  9568 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.513576  9535 ts_tablet_manager.cc:1403] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.014s
I20260709 12:26:18.513051  9534 tablet_bootstrap.cc:654] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.516379  9535 raft_consensus.cc:359] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.517035  9535 raft_consensus.cc:385] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.517298  9535 raft_consensus.cc:740] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.517964  9535 consensus_queue.cc:260] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.520383  9535 ts_tablet_manager.cc:1434] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:18.521302  9535 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: Bootstrap starting.
I20260709 12:26:18.513098  9462 raft_consensus.cc:697] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:18.523481  9568 raft_consensus.cc:515] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.523736  9462 consensus_queue.cc:237] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.513733  9533 tablet_bootstrap.cc:654] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.527086  9535 tablet_bootstrap.cc:654] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.534317  9534 tablet_bootstrap.cc:492] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.535036  9534 ts_tablet_manager.cc:1403] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.009s
I20260709 12:26:18.534106  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.535209  9533 tablet_bootstrap.cc:492] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: No bootstrap required, opened a new log
I20260709 12:26:18.536444  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.539355  9533 ts_tablet_manager.cc:1403] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
W20260709 12:26:18.537665  9347 leader_election.cc:343] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:18.538183  9534 raft_consensus.cc:359] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.542693  9130 catalog_manager.cc:5697] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.547547  9534 raft_consensus.cc:385] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.548053  9534 raft_consensus.cc:740] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.539537  9129 catalog_manager.cc:5697] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 0 to 1, leader changed from <none> to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 1 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.548821  9534 consensus_queue.cc:260] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.539436  9307 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.537122  9568 leader_election.cc:290] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.553303  9535 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: No bootstrap required, opened a new log
I20260709 12:26:18.548936  9533 raft_consensus.cc:359] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.553833  9535 ts_tablet_manager.cc:1403] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 12:26:18.556869  9535 raft_consensus.cc:359] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.558041  9535 raft_consensus.cc:385] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.558327  9535 raft_consensus.cc:740] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.558411  9307 raft_consensus.cc:2468] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.554025  9533 raft_consensus.cc:385] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.559875  9533 raft_consensus.cc:740] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.559530  9535 consensus_queue.cc:260] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.561833  9535 ts_tablet_manager.cc:1434] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:18.562508  9533 consensus_queue.cc:260] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.562573  9534 ts_tablet_manager.cc:1434] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:26:18.563691  9346 leader_election.cc:304] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.564316  9534 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.564601  9568 raft_consensus.cc:2804] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.564735  9533 ts_tablet_manager.cc:1434] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:18.565245  9568 raft_consensus.cc:697] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:18.566136  9568 consensus_queue.cc:237] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.568372  9536 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.570923  9534 tablet_bootstrap.cc:654] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.586637  9534 tablet_bootstrap.cc:492] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.587188  9534 ts_tablet_manager.cc:1403] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 12:26:18.587448  9130 catalog_manager.cc:5697] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.590211  9534 raft_consensus.cc:359] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.590919  9534 raft_consensus.cc:385] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.591173  9534 raft_consensus.cc:740] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.591841  9534 consensus_queue.cc:260] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.599594  9537 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.604417  9534 ts_tablet_manager.cc:1434] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:26:18.605597  9534 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.611057  9534 tablet_bootstrap.cc:654] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.611542  9527 raft_consensus.cc:493] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.612149  9527 raft_consensus.cc:515] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.616034  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:18.616523  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.616650  9382 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:18.617164  9307 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 0.
I20260709 12:26:18.617934  9534 tablet_bootstrap.cc:492] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.618417  9534 ts_tablet_manager.cc:1403] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:26:18.618707  9197 leader_election.cc:304] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:18.619158  9527 leader_election.cc:290] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.619760  9527 raft_consensus.cc:2804] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.620177  9527 raft_consensus.cc:493] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.620522  9527 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.621423  9534 raft_consensus.cc:359] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.622191  9534 raft_consensus.cc:385] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.622486  9534 raft_consensus.cc:740] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.623221  9534 consensus_queue.cc:260] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.625559  9534 ts_tablet_manager.cc:1434] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:18.626511  9534 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: Bootstrap starting.
I20260709 12:26:18.626726  9527 raft_consensus.cc:515] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.628513  9527 leader_election.cc:290] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:18.629406  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.630141  9307 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.630236  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:18.630934  9382 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.632687  9534 tablet_bootstrap.cc:654] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:18.640339  9307 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:18.638590  9382 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 1.
I20260709 12:26:18.642459  9197 leader_election.cc:304] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:18.643466  9527 raft_consensus.cc:2804] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.644004  9527 raft_consensus.cc:697] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:18.644734  9534 tablet_bootstrap.cc:492] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: No bootstrap required, opened a new log
I20260709 12:26:18.645361  9534 ts_tablet_manager.cc:1403] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.013s
I20260709 12:26:18.644966  9527 consensus_queue.cc:237] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.648499  9534 raft_consensus.cc:359] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.649271  9534 raft_consensus.cc:385] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:18.649577  9534 raft_consensus.cc:740] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.650588  9534 consensus_queue.cc:260] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.652376  9534 ts_tablet_manager.cc:1434] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:18.655877  9129 catalog_manager.cc:5697] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 0 to 1, leader changed from <none> to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 1 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.717221  9568 raft_consensus.cc:493] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.717818  9568 raft_consensus.cc:515] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.720526  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.720346  9568 leader_election.cc:290] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.720820  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.721246  9231 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.721510  9308 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.722272  9527 consensus_queue.cc:1048] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.722468  9346 leader_election.cc:304] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.723335  9568 raft_consensus.cc:2804] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.723701  9568 raft_consensus.cc:493] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.723964  9568 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.731240  9568 raft_consensus.cc:515] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.733258  9568 leader_election.cc:290] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.734431  9555 consensus_queue.cc:1048] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:18.735191  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.735834  9307 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:18.741019  9179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:18.742121  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.742826  9231 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.745666  9307 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.746973  9346 leader_election.cc:304] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.748529  9568 raft_consensus.cc:2804] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.749004  9568 raft_consensus.cc:697] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:18.749919  9568 consensus_queue.cc:237] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.753991  9231 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.759584  9129 catalog_manager.cc:5697] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.776311  9568 raft_consensus.cc:493] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.776829  9568 raft_consensus.cc:515] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.778712  9568 leader_election.cc:290] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.779542  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:18.779714  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:18.780238  9231 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.780362  9307 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 0.
I20260709 12:26:18.781339  9347 leader_election.cc:304] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.782063  9568 raft_consensus.cc:2804] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:18.782460  9568 raft_consensus.cc:493] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.782823  9568 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.788455  9568 raft_consensus.cc:515] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.790282  9568 leader_election.cc:290] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:18.791316  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:18.791356  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:18.792053  9231 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.792171  9307 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.797601  9307 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.797941  9231 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 1.
I20260709 12:26:18.798607  9346 leader_election.cc:304] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:18.799543  9568 raft_consensus.cc:2804] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:18.799991  9568 raft_consensus.cc:697] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:18.800724  9568 consensus_queue.cc:237] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:18.808552  9129 catalog_manager.cc:5697] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.821902  9568 consensus_queue.cc:1048] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.834415  9568 consensus_queue.cc:1048] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.867892  9307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:35156
I20260709 12:26:18.868465  9307 raft_consensus.cc:606] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.876971  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:18.877487  9382 raft_consensus.cc:606] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.882541  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:18.883101  9382 raft_consensus.cc:606] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:18.888727  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:18.889184  9382 raft_consensus.cc:606] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:18.896051  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:18.896507  9382 raft_consensus.cc:606] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:18.901495  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
mode: GRACEFUL
new_leader_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:38048
I20260709 12:26:18.901974  9382 raft_consensus.cc:606] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Received request to transfer leadership to TS 809eae370c384ccdaf3804b2e179afae
I20260709 12:26:18.906451  9231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:32936
I20260709 12:26:18.906947  9231 raft_consensus.cc:606] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:18.970604  9568 consensus_queue.cc:1048] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.980204  9231 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:18.984329  9536 consensus_queue.cc:1048] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.990823  9462 consensus_queue.cc:1048] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:18.994891  9233 raft_consensus.cc:3060] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:19.002424  9527 raft_consensus.cc:493] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.003095  9527 raft_consensus.cc:515] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.006209  9462 raft_consensus.cc:993] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.006749  9462 raft_consensus.cc:1081] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.008153  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "809eae370c384ccdaf3804b2e179afae" is_pre_election: true
I20260709 12:26:19.008502  9231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32934
I20260709 12:26:19.008605  9527 leader_election.cc:290] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.009079  9231 raft_consensus.cc:493] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.008522  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2896cefefa41338f3cd4248489bd20" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:19.009594  9231 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.010809  9196 leader_election.cc:304] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b; no voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7
I20260709 12:26:19.011503  9513 consensus_queue.cc:1048] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.013391  9527 raft_consensus.cc:2749] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.017094  9231 raft_consensus.cc:515] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.018975  9231 leader_election.cc:290] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.019721  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:19.020314  9307 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.021037  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a134e609ce4844964075005d9a0d95" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.021584  9382 raft_consensus.cc:3055] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.021725  9513 raft_consensus.cc:493] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.021940  9382 raft_consensus.cc:740] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.022307  9513 raft_consensus.cc:515] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.023036  9382 consensus_queue.cc:260] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.024287  9382 raft_consensus.cc:3060] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.025774  9513 leader_election.cc:290] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.027741  9307 raft_consensus.cc:2468] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.028034  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e953690054e2496da0781506a7d20ea7" is_pre_election: true
I20260709 12:26:19.026533  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5f07c44fb345f79a613769f670f73b" is_pre_election: true
I20260709 12:26:19.029201  9231 raft_consensus.cc:2393] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 809eae370c384ccdaf3804b2e179afae in current term 1: Already voted for candidate e953690054e2496da0781506a7d20ea7 in this term.
I20260709 12:26:19.029168  9197 leader_election.cc:304] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:19.030390  9527 raft_consensus.cc:2804] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.030526  9273 leader_election.cc:304] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae; no voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7
I20260709 12:26:19.030912  9527 raft_consensus.cc:697] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:19.031816  9527 consensus_queue.cc:237] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.033058  9513 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:19.033609  9382 raft_consensus.cc:2468] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.037596  9555 consensus_queue.cc:1048] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.040617  9513 raft_consensus.cc:2749] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:19.042582  9129 catalog_manager.cc:5697] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.046860  9462 consensus_queue.cc:1048] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.053218  9519 consensus_queue.cc:1048] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.061414  9462 raft_consensus.cc:993] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.061849  9462 raft_consensus.cc:1081] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.067557  9527 raft_consensus.cc:993] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:19.067696  9566 consensus_queue.cc:1048] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.068032  9527 raft_consensus.cc:1081] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:19.070633  9306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:19.071319  9306 raft_consensus.cc:493] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.071750  9306 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.077533  9382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38032
I20260709 12:26:19.078145  9382 raft_consensus.cc:493] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.078544  9382 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.079391  9306 raft_consensus.cc:515] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.082178  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:19.082376  9306 leader_election.cc:290] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.083868  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6395c1d872c410087bd9a42adb65496" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.084416  9381 raft_consensus.cc:3055] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.084719  9381 raft_consensus.cc:740] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.085482  9381 consensus_queue.cc:260] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.085595  9382 raft_consensus.cc:515] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.086545  9381 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.087589  9382 leader_election.cc:290] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:19.089211  9306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:19.090445  9306 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.089869  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53bf31240204d32bd529ecd089e5840" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:19.093041  9231 raft_consensus.cc:3055] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.093393  9231 raft_consensus.cc:740] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:19.094163  9231 consensus_queue.cc:260] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.095441  9231 raft_consensus.cc:3060] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.096107  9381 raft_consensus.cc:2468] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:19.097355  9271 leader_election.cc:304] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:19.097926  9306 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 2.
I20260709 12:26:19.098758  9513 raft_consensus.cc:2804] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.099316  9513 raft_consensus.cc:697] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:19.100185  9513 consensus_queue.cc:237] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.100569  9346 leader_election.cc:304] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:19.101432  9566 raft_consensus.cc:2804] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.101745  9231 raft_consensus.cc:2468] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 2.
I20260709 12:26:19.101926  9566 raft_consensus.cc:697] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 2 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.103329  9566 consensus_queue.cc:237] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.109894  9130 catalog_manager.cc:5697] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.111160  9128 catalog_manager.cc:5697] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 1 to 2, leader changed from cc5f07c44fb345f79a613769f670f73b (127.29.143.193) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.163820  9566 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.171586  9567 raft_consensus.cc:993] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.172087  9568 raft_consensus.cc:1081] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.176505  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:19.177183  9307 raft_consensus.cc:493] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.177670  9307 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.189653  9307 raft_consensus.cc:515] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.194805  9566 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.197172  9306 raft_consensus.cc:1240] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Rejecting Update request from peer e953690054e2496da0781506a7d20ea7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.203460  9231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:19.204141  9566 consensus_queue.cc:1059] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:19.206108  9307 leader_election.cc:290] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.206748  9568 raft_consensus.cc:3055] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.207875  9537 raft_consensus.cc:993] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.208366  9537 raft_consensus.cc:1081] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.209506  9381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.207176  9568 raft_consensus.cc:740] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.212146  9568 consensus_queue.cc:260] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.210158  9232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32926
I20260709 12:26:19.213266  9232 raft_consensus.cc:493] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.213599  9568 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.213701  9232 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.222883  9232 raft_consensus.cc:515] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.225107  9232 leader_election.cc:290] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.226123  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.226126  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:19.226975  9382 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.227468  9307 raft_consensus.cc:3055] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.227856  9307 raft_consensus.cc:740] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:19.228672  9307 consensus_queue.cc:260] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.229897  9307 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.230579  9381 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:19.232352  9382 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.233564  9196 leader_election.cc:304] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:19.234356  9527 raft_consensus.cc:2804] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.234838  9527 raft_consensus.cc:697] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:19.235526  9271 leader_election.cc:304] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: cc5f07c44fb345f79a613769f670f73b
I20260709 12:26:19.235626  9527 consensus_queue.cc:237] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.236524  9307 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.237010  9513 raft_consensus.cc:2804] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.237596  9513 raft_consensus.cc:697] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:19.238554  9513 consensus_queue.cc:237] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.245920  9128 catalog_manager.cc:5697] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.247108  9130 catalog_manager.cc:5697] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.347518  9568 raft_consensus.cc:993] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: : Instructing follower 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.347994  9566 raft_consensus.cc:1081] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer 809eae370c384ccdaf3804b2e179afae to start an election
I20260709 12:26:19.349401  9307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
 from {username='slave'} at 127.0.0.1:35146
I20260709 12:26:19.349988  9307 raft_consensus.cc:493] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.350303  9307 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.357519  9307 raft_consensus.cc:515] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.359225  9307 leader_election.cc:290] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.360031  9232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:19.360534  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fadd903d234da7b4aafac97d13ae48" candidate_uuid: "809eae370c384ccdaf3804b2e179afae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.360698  9232 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.361096  9382 raft_consensus.cc:3055] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.361395  9382 raft_consensus.cc:740] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.362126  9382 consensus_queue.cc:260] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.363296  9382 raft_consensus.cc:3060] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.367669  9232 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:19.368923  9273 leader_election.cc:304] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:19.369721  9513 raft_consensus.cc:2804] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.370085  9382 raft_consensus.cc:2468] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 809eae370c384ccdaf3804b2e179afae in term 2.
I20260709 12:26:19.371029  9513 raft_consensus.cc:697] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Leader. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:19.372020  9513 consensus_queue.cc:237] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.373080  9566 consensus_queue.cc:1048] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.381008  9568 raft_consensus.cc:993] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: : Instructing follower cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.381439  9568 raft_consensus.cc:1081] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Signalling peer cc5f07c44fb345f79a613769f670f73b to start an election
I20260709 12:26:19.381201  9130 catalog_manager.cc:5697] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to 809eae370c384ccdaf3804b2e179afae (127.29.143.194). New cstate: current_term: 2 leader_uuid: "809eae370c384ccdaf3804b2e179afae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.388447  9232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
 from {username='slave'} at 127.0.0.1:32934
I20260709 12:26:19.389052  9567 consensus_queue.cc:1048] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:19.392040  9232 raft_consensus.cc:493] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.392529  9232 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.399611  9232 raft_consensus.cc:515] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.401816  9232 leader_election.cc:290] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Requested vote from peers 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377), e953690054e2496da0781506a7d20ea7 (127.29.143.195:39167)
I20260709 12:26:19.402454  9307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:19.403132  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9da5f42c7654c93a0ae4f3856a26e24" candidate_uuid: "cc5f07c44fb345f79a613769f670f73b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e953690054e2496da0781506a7d20ea7"
I20260709 12:26:19.403662  9307 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.403812  9382 raft_consensus.cc:3055] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.404330  9382 raft_consensus.cc:740] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:19.404932  9382 consensus_queue.cc:260] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.405800  9382 raft_consensus.cc:3060] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.408831  9307 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.409934  9197 leader_election.cc:304] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, cc5f07c44fb345f79a613769f670f73b; no voters: 
I20260709 12:26:19.411420  9527 raft_consensus.cc:2804] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.411599  9382 raft_consensus.cc:2468] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc5f07c44fb345f79a613769f670f73b in term 2.
I20260709 12:26:19.411942  9527 raft_consensus.cc:697] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Leader. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:19.412775  9527 consensus_queue.cc:237] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:19.420580  9128 catalog_manager.cc:5697] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b reported cstate change: term changed from 1 to 2, leader changed from e953690054e2496da0781506a7d20ea7 (127.29.143.195) to cc5f07c44fb345f79a613769f670f73b (127.29.143.193). New cstate: current_term: 2 leader_uuid: "cc5f07c44fb345f79a613769f670f73b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.476454  9307 raft_consensus.cc:1275] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.477716  9527 consensus_queue.cc:1048] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.487079  9382 raft_consensus.cc:1275] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.488858  9604 consensus_queue.cc:1048] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.629909  9382 raft_consensus.cc:1275] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.631244  9513 consensus_queue.cc:1048] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.638760  9232 raft_consensus.cc:3060] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.645705  9232 raft_consensus.cc:1275] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.647078  9537 consensus_queue.cc:1048] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.686172  9307 raft_consensus.cc:1275] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.687398  9567 consensus_queue.cc:1048] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.694543  9232 raft_consensus.cc:1275] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.696002  9567 consensus_queue.cc:1048] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.714862  9382 raft_consensus.cc:1275] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.715974  9604 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.725637  9307 raft_consensus.cc:1275] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.725629  9232 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.727439  9604 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.734325  9232 raft_consensus.cc:1275] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.735764  9537 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.743505  9382 raft_consensus.cc:1275] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.744956  9513 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.907704  9381 raft_consensus.cc:1275] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.909157  9604 consensus_queue.cc:1048] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.909484  9232 raft_consensus.cc:1275] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.910969  9513 consensus_queue.cc:1048] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.918287  9307 raft_consensus.cc:1275] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Refusing update from remote peer cc5f07c44fb345f79a613769f670f73b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.922616  9381 raft_consensus.cc:1275] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Refusing update from remote peer 809eae370c384ccdaf3804b2e179afae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.922653  9604 consensus_queue.cc:1048] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:19.930243  9537 consensus_queue.cc:1048] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.911803  9128 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52136:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:21.943619  9128 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52136:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:21.986088 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:26:22.063524  9634 log.cc:927] Time spent T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
W20260709 12:26:22.230149  9633 log.cc:927] Time spent T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:22.284379  9660 tablet.cc:1724] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.285142  9661 tablet.cc:1724] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:22.291014  9273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:34603, user_credentials={real_user=slave}} blocked reactor thread for 92520.6us
I20260709 12:26:22.304085  9666 tablet.cc:1724] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:22.292104  9649 log.cc:927] Time spent T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 12:26:22.333159  9231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:39220
W20260709 12:26:22.368043  9652 log.cc:927] Time spent T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
W20260709 12:26:22.374476  9645 log.cc:927] Time spent T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 12:26:22.385396  9665 tablet.cc:1724] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.399108  9670 tablet.cc:1724] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.374722  9231 raft_consensus.cc:606] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:22.417085  9672 tablet.cc:1724] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.436358  9673 tablet.cc:1724] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:22.459447  9408 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1304ab8074d74f63a99d72214db07ac0)
I20260709 12:26:22.472607  9609 raft_consensus.cc:993] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:22.473397  9609 raft_consensus.cc:1081] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:22.475342  9674 tablet.cc:1724] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:22.468927  9408 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1304ab8074d74f63a99d72214db07ac0)
W20260709 12:26:22.477779  9408 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1304ab8074d74f63a99d72214db07ac0)
I20260709 12:26:22.498529  9679 tablet.cc:1724] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.516687  9377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38032
I20260709 12:26:22.517542  9377 raft_consensus.cc:493] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.518030  9377 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.518736  9672 tablet.cc:1724] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.519120  9680 tablet.cc:1724] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.520073  9674 tablet.cc:1724] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.546942  9676 tablet.cc:1724] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.551692  9665 tablet.cc:1724] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.552899  9661 tablet.cc:1724] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.489430  9675 tablet.cc:1724] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.557194  9660 tablet.cc:1724] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.572073  9675 tablet.cc:1724] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:22.573798  9271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.195:39167, user_credentials={real_user=slave}} blocked reactor thread for 250542us
I20260709 12:26:22.580166  9672 tablet.cc:1724] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.582906  9666 tablet.cc:1724] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.570962  9377 raft_consensus.cc:515] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.604560  9679 tablet.cc:1724] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.605438  9377 leader_election.cc:290] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:22.606056  9229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:22.606870  9229 raft_consensus.cc:3055] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:22.607203  9229 raft_consensus.cc:740] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:22.608667  9229 consensus_queue.cc:260] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.610028  9229 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.625151  9670 tablet.cc:1724] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.631358  9675 tablet.cc:1724] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.633800  9674 tablet.cc:1724] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.637751  9676 tablet.cc:1724] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.639269  9305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cd00f581ee450597da4de9e7796dbf" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:22.642869  9305 raft_consensus.cc:3060] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.666880  9305 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:22.691892  9229 raft_consensus.cc:2468] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:22.695815  9347 leader_election.cc:304] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:22.683432  9666 tablet.cc:1724] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.706557  9676 tablet.cc:1724] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:22.696992  9683 raft_consensus.cc:2804] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.720521  9683 raft_consensus.cc:697] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:22.721549  9683 consensus_queue.cc:237] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.724471  9305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:56148
I20260709 12:26:22.725129  9305 raft_consensus.cc:606] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:22.735576  9668 raft_consensus.cc:993] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:22.736058  9668 raft_consensus.cc:1081] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:22.739041 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:26:22.739691 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.746186  9379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38016
I20260709 12:26:22.746910  9379 raft_consensus.cc:493] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.747332  9379 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.752070  9305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd"
dest_uuid: "809eae370c384ccdaf3804b2e179afae"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:56148
I20260709 12:26:22.752892  9305 raft_consensus.cc:606] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:22.756752  9229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349"
dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
mode: GRACEFUL
new_leader_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:39220
I20260709 12:26:22.757196  9379 raft_consensus.cc:515] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.757591  9229 raft_consensus.cc:606] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Received request to transfer leadership to TS e953690054e2496da0781506a7d20ea7
I20260709 12:26:22.759655  9379 leader_election.cc:290] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:22.761260 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:22.761917 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.761983  9229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:22.762660  9229 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.763185  9130 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: soft_deleted_table [id=586bc3a1dabd4411b31a0034e2818a7e] alter complete (version 1)
I20260709 12:26:22.764602  9305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0f7d6d4ac064ebd8062ec3ebf290401" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:22.765257  9305 raft_consensus.cc:3055] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:22.765620  9305 raft_consensus.cc:740] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:22.766464  9305 consensus_queue.cc:260] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.768191  9305 raft_consensus.cc:3060] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.774325  9229 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:22.779259  9347 leader_election.cc:304] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:22.780249  9683 raft_consensus.cc:2804] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.780793  9683 raft_consensus.cc:697] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:22.781201  9129 catalog_manager.cc:5697] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 2 to 3, leader changed from cc5f07c44fb345f79a613769f670f73b (127.29.143.193) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.781942  9683 consensus_queue.cc:237] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:22.787343  9305 raft_consensus.cc:2468] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:22.801069  9129 catalog_manager.cc:5697] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 2 to 3, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.998099  9669 raft_consensus.cc:993] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:22.998744  9681 raft_consensus.cc:1081] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:23.000164  9379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38016
I20260709 12:26:23.000636  9379 raft_consensus.cc:493] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.000942  9379 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.007423  9379 raft_consensus.cc:515] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.009012  9379 leader_election.cc:290] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:23.009936  9229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:23.010143  9305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1515a52128c045438f5000a759a9dcfd" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:23.010716  9229 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.010799  9305 raft_consensus.cc:3055] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.011261  9305 raft_consensus.cc:740] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 809eae370c384ccdaf3804b2e179afae, State: Running, Role: LEADER
I20260709 12:26:23.012001  9305 consensus_queue.cc:260] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.012996  9305 raft_consensus.cc:3060] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.017649  9229 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:23.018970  9347 leader_election.cc:304] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5f07c44fb345f79a613769f670f73b, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:23.019773  9305 raft_consensus.cc:2468] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:23.019860  9683 raft_consensus.cc:2804] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.020453  9683 raft_consensus.cc:697] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:23.021315  9683 consensus_queue.cc:237] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.029196  9129 catalog_manager.cc:5697] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 2 to 3, leader changed from 809eae370c384ccdaf3804b2e179afae (127.29.143.194) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.094223  9690 raft_consensus.cc:993] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: : Instructing follower e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:23.094833  9613 raft_consensus.cc:1081] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Signalling peer e953690054e2496da0781506a7d20ea7 to start an election
I20260709 12:26:23.096220  9377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349"
dest_uuid: "e953690054e2496da0781506a7d20ea7"
 from {username='slave'} at 127.0.0.1:38032
I20260709 12:26:23.096796  9377 raft_consensus.cc:493] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.097167  9377 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.103503  9377 raft_consensus.cc:515] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.105360  9377 leader_election.cc:290] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Requested vote from peers cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603), 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377)
I20260709 12:26:23.106084  9229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc5f07c44fb345f79a613769f670f73b"
I20260709 12:26:23.106290  9305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c510de9f64d343bba79dcf34bfec0349" candidate_uuid: "e953690054e2496da0781506a7d20ea7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "809eae370c384ccdaf3804b2e179afae"
I20260709 12:26:23.106676  9229 raft_consensus.cc:3055] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.106923  9305 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.107146  9229 raft_consensus.cc:740] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc5f07c44fb345f79a613769f670f73b, State: Running, Role: LEADER
I20260709 12:26:23.108184  9229 consensus_queue.cc:260] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.109184  9229 raft_consensus.cc:3060] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.112401  9305 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:23.113729  9346 leader_election.cc:304] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 809eae370c384ccdaf3804b2e179afae, e953690054e2496da0781506a7d20ea7; no voters: 
I20260709 12:26:23.114349  9229 raft_consensus.cc:2468] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e953690054e2496da0781506a7d20ea7 in term 3.
I20260709 12:26:23.114524  9683 raft_consensus.cc:2804] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.115036  9683 raft_consensus.cc:697] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Becoming Leader. State: Replica: e953690054e2496da0781506a7d20ea7, State: Running, Role: LEADER
I20260709 12:26:23.115990  9683 consensus_queue.cc:237] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } }
I20260709 12:26:23.127272  9129 catalog_manager.cc:5697] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 reported cstate change: term changed from 2 to 3, leader changed from cc5f07c44fb345f79a613769f670f73b (127.29.143.193) to e953690054e2496da0781506a7d20ea7 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "e953690054e2496da0781506a7d20ea7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e953690054e2496da0781506a7d20ea7" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.135437  9229 raft_consensus.cc:1275] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.136961  9683 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.146939  9305 raft_consensus.cc:1275] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.148319  9683 consensus_queue.cc:1048] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.346943  9229 raft_consensus.cc:1275] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.348106  9683 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.355428  9305 raft_consensus.cc:1275] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.360486  9683 consensus_queue.cc:1048] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.508102  9305 raft_consensus.cc:1275] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:23.509193  9663 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.517642  9230 raft_consensus.cc:1275] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:23.519145  9663 consensus_queue.cc:1048] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.596304  9230 raft_consensus.cc:1275] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:23.597710  9663 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5f07c44fb345f79a613769f670f73b" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 34603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.607841  9305 raft_consensus.cc:1275] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Refusing update from remote peer e953690054e2496da0781506a7d20ea7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:23.609154  9663 consensus_queue.cc:1048] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "809eae370c384ccdaf3804b2e179afae" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.763180 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:23.768322 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:23.768756 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.773821 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:23.774200 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.775202 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:24.780478 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:24.781037 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.786546 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:24.786972 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.788002 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:25.794320 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:25.794781 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.800448 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:25.800923 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.801923 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:26.807368 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:26.807890 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.812891 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:26.813313 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:27.814249 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:27.820494 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:27.820917 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.825954 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:27.826406 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.827374 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:28.833371 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:28.833861 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.840020 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:28.840467 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:29.841567 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:29.847580 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:29.848177 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:29.855049 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:29.855620 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.856606 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:30.863526 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:30.864053 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.869385 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:30.869761 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.871217 30271 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:26:31.881028 30271 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:26:31.881527 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.891211 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:31.891642 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.956095 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
I20260709 12:26:33.016578 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:33.017827 30271 tablet_replica.cc:333] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.020316 30271 raft_consensus.cc:2243] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:26:33.021731  9273 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 12:26:33.022413 30271 raft_consensus.cc:2272] T d9da5f42c7654c93a0ae4f3856a26e24 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.026844 30271 tablet_replica.cc:333] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.028656 30271 raft_consensus.cc:2243] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.029735 30271 raft_consensus.cc:2272] T a0f7d6d4ac064ebd8062ec3ebf290401 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.033653 30271 tablet_replica.cc:333] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.034417 30271 raft_consensus.cc:2243] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:33.034530  9273 consensus_peers.cc:597] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.035255 30271 raft_consensus.cc:2272] T d53bf31240204d32bd529ecd089e5840 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.038352 30271 tablet_replica.cc:333] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.039167 30271 raft_consensus.cc:2243] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.039783 30271 raft_consensus.cc:2272] T 0f2896cefefa41338f3cd4248489bd20 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.042358 30271 tablet_replica.cc:333] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.043035 30271 raft_consensus.cc:2243] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.043659 30271 raft_consensus.cc:2272] T ad776107cf654948bb53a05343b58b1c P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.046324 30271 tablet_replica.cc:333] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.047107 30271 raft_consensus.cc:2243] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.047647 30271 raft_consensus.cc:2272] T c510de9f64d343bba79dcf34bfec0349 P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.050278 30271 tablet_replica.cc:333] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.050961 30271 raft_consensus.cc:2243] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.051743 30271 raft_consensus.cc:2272] T b6395c1d872c410087bd9a42adb65496 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.055622 30271 tablet_replica.cc:333] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.056541 30271 raft_consensus.cc:2243] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.057309 30271 raft_consensus.cc:2272] T 88fadd903d234da7b4aafac97d13ae48 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.060566 30271 tablet_replica.cc:333] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.061185 30271 raft_consensus.cc:2243] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.061756 30271 raft_consensus.cc:2272] T e23638187f0a48f591e5ad5af6b8fe8a P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.064277 30271 tablet_replica.cc:333] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.064834 30271 raft_consensus.cc:2243] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.065485 30271 raft_consensus.cc:2272] T 82cd00f581ee450597da4de9e7796dbf P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.068120 30271 tablet_replica.cc:333] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.068764 30271 raft_consensus.cc:2243] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.069564 30271 raft_consensus.cc:2272] T 1515a52128c045438f5000a759a9dcfd P cc5f07c44fb345f79a613769f670f73b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.073035 30271 tablet_replica.cc:333] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.073640 30271 raft_consensus.cc:2243] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.074586 30271 raft_consensus.cc:2272] T b2cefb989e64476285ef0e61a4376aa0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.077368 30271 tablet_replica.cc:333] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.078007 30271 raft_consensus.cc:2243] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.078568 30271 raft_consensus.cc:2272] T c3cd052e8b3c420b881b7952d47e0519 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.080060  9273 consensus_peers.cc:597] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.081167 30271 tablet_replica.cc:333] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.081784 30271 raft_consensus.cc:2243] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.082711 30271 raft_consensus.cc:2272] T e1a134e609ce4844964075005d9a0d95 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.085175 30271 tablet_replica.cc:333] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.085754 30271 raft_consensus.cc:2243] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.086306 30271 raft_consensus.cc:2272] T d2cb291f50e7422aad35b2739ffdf003 P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.088927 30271 tablet_replica.cc:333] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.089488 30271 raft_consensus.cc:2243] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.090420 30271 raft_consensus.cc:2272] T b837185f01b947538676d920ce6a697d P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.093019 30271 tablet_replica.cc:333] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.093585 30271 raft_consensus.cc:2243] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.094447 30271 raft_consensus.cc:2272] T 1304ab8074d74f63a99d72214db07ac0 P cc5f07c44fb345f79a613769f670f73b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.096903 30271 tablet_replica.cc:333] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b: stopping tablet replica
I20260709 12:26:33.097456 30271 raft_consensus.cc:2243] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.098362 30271 raft_consensus.cc:2272] T 6836e524bdb543f28e5a00f8c21076bd P cc5f07c44fb345f79a613769f670f73b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.145663  9347 consensus_peers.cc:597] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.147728 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
I20260709 12:26:33.198199 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
W20260709 12:26:33.223634  9273 consensus_peers.cc:597] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.230348  9347 consensus_peers.cc:597] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.248199 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:33.249778  9347 consensus_peers.cc:597] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.250101 30271 tablet_replica.cc:333] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.251348 30271 raft_consensus.cc:2243] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.251981 30271 raft_consensus.cc:2272] T d9da5f42c7654c93a0ae4f3856a26e24 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.254256 30271 tablet_replica.cc:333] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.254904 30271 raft_consensus.cc:2243] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.255455 30271 raft_consensus.cc:2272] T d53bf31240204d32bd529ecd089e5840 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.257858 30271 tablet_replica.cc:333] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.258641 30271 raft_consensus.cc:2243] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.259209 30271 raft_consensus.cc:2272] T a0f7d6d4ac064ebd8062ec3ebf290401 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.261511 30271 tablet_replica.cc:333] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.262091 30271 raft_consensus.cc:2243] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.262661 30271 raft_consensus.cc:2272] T 82cd00f581ee450597da4de9e7796dbf P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.264876 30271 tablet_replica.cc:333] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.265489 30271 raft_consensus.cc:2243] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.265965 30271 raft_consensus.cc:2272] T 6836e524bdb543f28e5a00f8c21076bd P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.268193 30271 tablet_replica.cc:333] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.268803 30271 raft_consensus.cc:2243] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.269336 30271 raft_consensus.cc:2272] T 1304ab8074d74f63a99d72214db07ac0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.271664 30271 tablet_replica.cc:333] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.272192 30271 raft_consensus.cc:2243] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.273092 30271 raft_consensus.cc:2272] T 88fadd903d234da7b4aafac97d13ae48 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.275319 30271 tablet_replica.cc:333] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.275909 30271 raft_consensus.cc:2243] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.276757 30271 raft_consensus.cc:2272] T e23638187f0a48f591e5ad5af6b8fe8a P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.279271 30271 tablet_replica.cc:333] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.279857 30271 raft_consensus.cc:2243] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.280776 30271 raft_consensus.cc:2272] T 0f2896cefefa41338f3cd4248489bd20 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.283011 30271 tablet_replica.cc:333] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.283594 30271 raft_consensus.cc:2243] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.284489 30271 raft_consensus.cc:2272] T b6395c1d872c410087bd9a42adb65496 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.286615 30271 tablet_replica.cc:333] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.287181 30271 raft_consensus.cc:2243] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.287693 30271 raft_consensus.cc:2272] T c510de9f64d343bba79dcf34bfec0349 P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.289790 30271 tablet_replica.cc:333] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.290293 30271 raft_consensus.cc:2243] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.291235 30271 raft_consensus.cc:2272] T ad776107cf654948bb53a05343b58b1c P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.293483 30271 tablet_replica.cc:333] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.294005 30271 raft_consensus.cc:2243] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.294468 30271 raft_consensus.cc:2272] T 1515a52128c045438f5000a759a9dcfd P 809eae370c384ccdaf3804b2e179afae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.296686 30271 tablet_replica.cc:333] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.297216 30271 raft_consensus.cc:2243] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.298091 30271 raft_consensus.cc:2272] T c3cd052e8b3c420b881b7952d47e0519 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.300433 30271 tablet_replica.cc:333] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.300972 30271 raft_consensus.cc:2243] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.301442 30271 raft_consensus.cc:2272] T b2cefb989e64476285ef0e61a4376aa0 P 809eae370c384ccdaf3804b2e179afae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.303840 30271 tablet_replica.cc:333] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.304388 30271 raft_consensus.cc:2243] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.304908 30271 raft_consensus.cc:2272] T e1a134e609ce4844964075005d9a0d95 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.307051 30271 tablet_replica.cc:333] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.307618 30271 raft_consensus.cc:2243] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.308073 30271 raft_consensus.cc:2272] T d2cb291f50e7422aad35b2739ffdf003 P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.310287 30271 tablet_replica.cc:333] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae: stopping tablet replica
I20260709 12:26:33.310809 30271 raft_consensus.cc:2243] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.311249 30271 raft_consensus.cc:2272] T b837185f01b947538676d920ce6a697d P 809eae370c384ccdaf3804b2e179afae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:33.342509  9347 consensus_peers.cc:597] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.344245 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
W20260709 12:26:33.374898  9346 consensus_peers.cc:597] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 -> Peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Couldn't send request to peer 809eae370c384ccdaf3804b2e179afae. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:38377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.387265 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
W20260709 12:26:33.393837  9346 consensus_peers.cc:597] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 -> Peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Couldn't send request to peer 809eae370c384ccdaf3804b2e179afae. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:38377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.413417  9347 consensus_peers.cc:597] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.422098  9347 consensus_peers.cc:597] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 -> Peer cc5f07c44fb345f79a613769f670f73b (127.29.143.193:34603): Couldn't send request to peer cc5f07c44fb345f79a613769f670f73b. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:34603: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:33.425671  9346 consensus_peers.cc:597] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 -> Peer 809eae370c384ccdaf3804b2e179afae (127.29.143.194:38377): Couldn't send request to peer 809eae370c384ccdaf3804b2e179afae. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:38377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:33.427510 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:33.428193 30271 tablet_replica.cc:333] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.428841 30271 raft_consensus.cc:2243] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.429656 30271 raft_consensus.cc:2272] T a0f7d6d4ac064ebd8062ec3ebf290401 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.431792 30271 tablet_replica.cc:333] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.432461 30271 raft_consensus.cc:2243] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.432986 30271 raft_consensus.cc:2272] T d9da5f42c7654c93a0ae4f3856a26e24 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.435062 30271 tablet_replica.cc:333] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.435591 30271 raft_consensus.cc:2243] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.436450 30271 raft_consensus.cc:2272] T d53bf31240204d32bd529ecd089e5840 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.438777 30271 tablet_replica.cc:333] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.439373 30271 raft_consensus.cc:2243] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.439870 30271 raft_consensus.cc:2272] T 0f2896cefefa41338f3cd4248489bd20 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.441932 30271 tablet_replica.cc:333] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.442473 30271 raft_consensus.cc:2243] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.443492 30271 raft_consensus.cc:2272] T 82cd00f581ee450597da4de9e7796dbf P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.445555 30271 tablet_replica.cc:333] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.446069 30271 raft_consensus.cc:2243] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.446550 30271 raft_consensus.cc:2272] T ad776107cf654948bb53a05343b58b1c P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.448576 30271 tablet_replica.cc:333] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.449108 30271 raft_consensus.cc:2243] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.450029 30271 raft_consensus.cc:2272] T c510de9f64d343bba79dcf34bfec0349 P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.452064 30271 tablet_replica.cc:333] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.452593 30271 raft_consensus.cc:2243] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.453071 30271 raft_consensus.cc:2272] T b6395c1d872c410087bd9a42adb65496 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.455323 30271 tablet_replica.cc:333] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.456019 30271 raft_consensus.cc:2243] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.456496 30271 raft_consensus.cc:2272] T 6836e524bdb543f28e5a00f8c21076bd P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.458695 30271 tablet_replica.cc:333] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.459242 30271 raft_consensus.cc:2243] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.459764 30271 raft_consensus.cc:2272] T 1304ab8074d74f63a99d72214db07ac0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.461722 30271 tablet_replica.cc:333] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.462234 30271 raft_consensus.cc:2243] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.462757 30271 raft_consensus.cc:2272] T 88fadd903d234da7b4aafac97d13ae48 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.464725 30271 tablet_replica.cc:333] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.465233 30271 raft_consensus.cc:2243] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.465700 30271 raft_consensus.cc:2272] T e23638187f0a48f591e5ad5af6b8fe8a P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.467669 30271 tablet_replica.cc:333] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.468204 30271 raft_consensus.cc:2243] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.469003 30271 raft_consensus.cc:2272] T 1515a52128c045438f5000a759a9dcfd P e953690054e2496da0781506a7d20ea7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.470907 30271 tablet_replica.cc:333] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.471401 30271 raft_consensus.cc:2243] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.471818 30271 raft_consensus.cc:2272] T c3cd052e8b3c420b881b7952d47e0519 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.473752 30271 tablet_replica.cc:333] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.474267 30271 raft_consensus.cc:2243] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.474720 30271 raft_consensus.cc:2272] T b2cefb989e64476285ef0e61a4376aa0 P e953690054e2496da0781506a7d20ea7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.476593 30271 tablet_replica.cc:333] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.477101 30271 raft_consensus.cc:2243] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.477586 30271 raft_consensus.cc:2272] T e1a134e609ce4844964075005d9a0d95 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.479509 30271 tablet_replica.cc:333] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.479993 30271 raft_consensus.cc:2243] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.480814 30271 raft_consensus.cc:2272] T d2cb291f50e7422aad35b2739ffdf003 P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.482668 30271 tablet_replica.cc:333] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7: stopping tablet replica
I20260709 12:26:33.483151 30271 raft_consensus.cc:2243] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.483595 30271 raft_consensus.cc:2272] T b837185f01b947538676d920ce6a697d P e953690054e2496da0781506a7d20ea7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.524188 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:26:33.562479 30271 master.cc:562] Master@127.29.143.254:43029 shutting down...
I20260709 12:26:33.586786 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:33.587457 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.587801 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8d698368f7824df69076b56f72b6536f: stopping tablet replica
I20260709 12:26:33.608906 30271 master.cc:584] Master@127.29.143.254:43029 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21134 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:26:33.663285 30271 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.143.254:41379
I20260709 12:26:33.664508 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:33.670480  9726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:33.670830  9725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:33.671069  9728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:33.671782 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:33.672783 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:33.673012 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:33.673206 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599993673176 us; error 0 us; skew 500 ppm
I20260709 12:26:33.673755 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:33.676210 30271 webserver.cc:533] Webserver started at http://127.29.143.254:45191/ using document root <none> and password file <none>
I20260709 12:26:33.676700 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:33.676888 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:33.677174 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:33.678296 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/master-0-root/instance:
uuid: "af6779b42cda454599952fdbda0afc7d"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.683043 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:33.686281  9733 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:33.687109 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:33.687400 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/master-0-root
uuid: "af6779b42cda454599952fdbda0afc7d"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.687687 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:33.704034 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:33.705622 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:33.744725 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.254:41379
I20260709 12:26:33.744925  9784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.254:41379 every 8 connection(s)
I20260709 12:26:33.748530  9785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:33.760346  9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: Bootstrap starting.
I20260709 12:26:33.765328  9785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:33.769590  9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: No bootstrap required, opened a new log
I20260709 12:26:33.771914  9785 raft_consensus.cc:359] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER }
I20260709 12:26:33.772375  9785 raft_consensus.cc:385] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:33.772591  9785 raft_consensus.cc:740] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6779b42cda454599952fdbda0afc7d, State: Initialized, Role: FOLLOWER
I20260709 12:26:33.773283  9785 consensus_queue.cc:260] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER }
I20260709 12:26:33.773762  9785 raft_consensus.cc:399] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:33.773986  9785 raft_consensus.cc:493] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:33.774294  9785 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:33.779065  9785 raft_consensus.cc:515] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER }
I20260709 12:26:33.779623  9785 leader_election.cc:304] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af6779b42cda454599952fdbda0afc7d; no voters: 
I20260709 12:26:33.780802  9785 leader_election.cc:290] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:33.781164  9788 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:33.782572  9788 raft_consensus.cc:697] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 1 LEADER]: Becoming Leader. State: Replica: af6779b42cda454599952fdbda0afc7d, State: Running, Role: LEADER
I20260709 12:26:33.783303  9788 consensus_queue.cc:237] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER }
I20260709 12:26:33.783803  9785 sys_catalog.cc:565] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:33.788287  9789 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af6779b42cda454599952fdbda0afc7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER } }
I20260709 12:26:33.789340  9789 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:33.789234  9790 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader af6779b42cda454599952fdbda0afc7d. Latest consensus state: current_term: 1 leader_uuid: "af6779b42cda454599952fdbda0afc7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af6779b42cda454599952fdbda0afc7d" member_type: VOTER } }
I20260709 12:26:33.790205  9790 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:33.792538  9796 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:33.798050  9796 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:33.800545 30271 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:33.808002  9796 catalog_manager.cc:1383] Generated new cluster ID: 23e476646c434d5eacfb7ccb0ea36566
I20260709 12:26:33.808334  9796 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:33.841323  9796 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:33.842744  9796 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:33.858074  9796 catalog_manager.cc:6070] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: Generated new TSK 0
I20260709 12:26:33.858865  9796 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:33.871534 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:33.877686  9806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:33.878736  9807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:33.881137 30271 server_base.cc:1061] running on GCE node
W20260709 12:26:33.881347  9809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:33.882318 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:33.882503 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:33.882629 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599993882618 us; error 0 us; skew 500 ppm
I20260709 12:26:33.883188 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:33.885864 30271 webserver.cc:533] Webserver started at http://127.29.143.193:37537/ using document root <none> and password file <none>
I20260709 12:26:33.886315 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:33.886472 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:33.886755 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:33.887888 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-0-root/instance:
uuid: "3fad6e5099a144da91d785bdbaef1e05"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.892918 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:33.896659  9814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:33.897526 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:33.897859 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-0-root
uuid: "3fad6e5099a144da91d785bdbaef1e05"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.898128 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:33.907943 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:33.909221 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:33.910763 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:33.913141 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:33.913314 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:33.913730 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:33.913889 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:33.954736 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.193:37791
I20260709 12:26:33.954909  9876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.193:37791 every 8 connection(s)
I20260709 12:26:33.959908 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:33.967469  9881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:33.967929  9882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:33.970491  9884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:33.971138 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:33.972746 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:33.973026 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:33.973245 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599993973226 us; error 0 us; skew 500 ppm
I20260709 12:26:33.973826 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:33.975576  9877 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41379
I20260709 12:26:33.975960  9877 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:33.976766 30271 webserver.cc:533] Webserver started at http://127.29.143.194:46851/ using document root <none> and password file <none>
I20260709 12:26:33.976938  9877 heartbeater.cc:507] Master 127.29.143.254:41379 requested a full tablet report, sending...
I20260709 12:26:33.977507 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:33.977764 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:33.978119 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:33.979269  9750 ts_manager.cc:194] Registered new tserver with Master: 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791)
I20260709 12:26:33.979463 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-1-root/instance:
uuid: "a04374fb84b843a89010eb5726660aef"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.981137  9750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34532
I20260709 12:26:33.984634 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:33.988688  9889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:33.989472 30271 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:33.989787 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-1-root
uuid: "a04374fb84b843a89010eb5726660aef"
format_stamp: "Formatted at 2026-07-09 12:26:33 on dist-test-slave-9k85"
I20260709 12:26:33.990036 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:34.011660 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:34.012867 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:34.014345 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:34.016556 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:34.016734 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:34.017002 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:34.017220 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:34.061088 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.194:38653
I20260709 12:26:34.061157  9951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.194:38653 every 8 connection(s)
I20260709 12:26:34.066376 30271 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:34.074223  9955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:34.075870  9956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:34.079097  9958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:34.079968 30271 server_base.cc:1061] running on GCE node
I20260709 12:26:34.081207 30271 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:34.081550 30271 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:34.081781 30271 hybrid_clock.cc:648] HybridClock initialized: now 1783599994081749 us; error 0 us; skew 500 ppm
I20260709 12:26:34.081795  9952 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41379
I20260709 12:26:34.082374  9952 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:34.082479 30271 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:34.083236  9952 heartbeater.cc:507] Master 127.29.143.254:41379 requested a full tablet report, sending...
I20260709 12:26:34.085749 30271 webserver.cc:533] Webserver started at http://127.29.143.195:33971/ using document root <none> and password file <none>
I20260709 12:26:34.086187  9750 ts_manager.cc:194] Registered new tserver with Master: a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.086459 30271 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:34.086799 30271 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:34.087126 30271 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:34.088142  9750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34542
I20260709 12:26:34.088759 30271 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-2-root/instance:
uuid: "682a1c00ab064499a57bc01dd23e1e90"
format_stamp: "Formatted at 2026-07-09 12:26:34 on dist-test-slave-9k85"
I20260709 12:26:34.093827 30271 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:34.098052  9963 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:34.099438 30271 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:34.099857 30271 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-2-root
uuid: "682a1c00ab064499a57bc01dd23e1e90"
format_stamp: "Formatted at 2026-07-09 12:26:34 on dist-test-slave-9k85"
I20260709 12:26:34.100128 30271 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskZHYRUh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599620637805-30271-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:34.120669 30271 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:34.121826 30271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:34.123803 30271 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:34.126549 30271 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:34.126762 30271 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:34.127084 30271 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:34.127226 30271 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:34.169152 30271 rpc_server.cc:307] RPC server started. Bound to: 127.29.143.195:35041
I20260709 12:26:34.169245 10025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.143.195:35041 every 8 connection(s)
I20260709 12:26:34.184795 10026 heartbeater.cc:344] Connected to a master server at 127.29.143.254:41379
I20260709 12:26:34.185367 10026 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:34.186179 10026 heartbeater.cc:507] Master 127.29.143.254:41379 requested a full tablet report, sending...
I20260709 12:26:34.188479  9750 ts_manager.cc:194] Registered new tserver with Master: 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.188974 30271 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016474613s
I20260709 12:26:34.190135  9750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34554
I20260709 12:26:34.216811  9750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34570:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:34.219619  9750 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:34.295907  9916 tablet_service.cc:1511] Processing CreateTablet for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:34.297438  9916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.295919  9917 tablet_service.cc:1511] Processing CreateTablet for tablet ca3347edf7964d228e26b13f4abf6a9b (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:34.300506  9917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3347edf7964d228e26b13f4abf6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.300848  9915 tablet_service.cc:1511] Processing CreateTablet for tablet 8d289c1362c24e2d9779e260ac87adc0 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:34.302948  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d289c1362c24e2d9779e260ac87adc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.306370  9914 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0720b968964c1d97550949b47591b3 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:34.308198  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0720b968964c1d97550949b47591b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.310133  9913 tablet_service.cc:1511] Processing CreateTablet for tablet aa3742289dc5453a9fe82b497f976d56 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:34.311473  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3742289dc5453a9fe82b497f976d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.314725  9912 tablet_service.cc:1511] Processing CreateTablet for tablet 73ade1159a544ffc9ed007c73fc1f142 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:34.316161  9912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ade1159a544ffc9ed007c73fc1f142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.319568  9842 tablet_service.cc:1511] Processing CreateTablet for tablet ca3347edf7964d228e26b13f4abf6a9b (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:34.320979  9842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3347edf7964d228e26b13f4abf6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.321830  9911 tablet_service.cc:1511] Processing CreateTablet for tablet c42e4667e13b40f29a58d57399731bcf (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:34.323678  9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42e4667e13b40f29a58d57399731bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.329524  9909 tablet_service.cc:1511] Processing CreateTablet for tablet 088b74a10d0143498b23216ea9e28e98 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:34.330942  9909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088b74a10d0143498b23216ea9e28e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.334137  9841 tablet_service.cc:1511] Processing CreateTablet for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:34.325659  9910 tablet_service.cc:1511] Processing CreateTablet for tablet 56d6c35f0da543cd956a7d3573661d05 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:34.335793  9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d6c35f0da543cd956a7d3573661d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.336767  9840 tablet_service.cc:1511] Processing CreateTablet for tablet 8d289c1362c24e2d9779e260ac87adc0 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:34.339098  9839 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0720b968964c1d97550949b47591b3 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:34.342396  9838 tablet_service.cc:1511] Processing CreateTablet for tablet aa3742289dc5453a9fe82b497f976d56 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:34.345456  9837 tablet_service.cc:1511] Processing CreateTablet for tablet 73ade1159a544ffc9ed007c73fc1f142 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:34.348254  9836 tablet_service.cc:1511] Processing CreateTablet for tablet c42e4667e13b40f29a58d57399731bcf (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:34.350884  9835 tablet_service.cc:1511] Processing CreateTablet for tablet 56d6c35f0da543cd956a7d3573661d05 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:34.353462  9834 tablet_service.cc:1511] Processing CreateTablet for tablet 088b74a10d0143498b23216ea9e28e98 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:34.355067  9841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.359261  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d289c1362c24e2d9779e260ac87adc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.371286  9839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0720b968964c1d97550949b47591b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.375178  9834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088b74a10d0143498b23216ea9e28e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.383209  9836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42e4667e13b40f29a58d57399731bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.385367  9835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d6c35f0da543cd956a7d3573661d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.389889  9837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ade1159a544ffc9ed007c73fc1f142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.391868  9838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3742289dc5453a9fe82b497f976d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.415400 10041 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.419292  9991 tablet_service.cc:1511] Processing CreateTablet for tablet ca3347edf7964d228e26b13f4abf6a9b (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:34.420725  9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3347edf7964d228e26b13f4abf6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.424961  9990 tablet_service.cc:1511] Processing CreateTablet for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:34.428457  9989 tablet_service.cc:1511] Processing CreateTablet for tablet 8d289c1362c24e2d9779e260ac87adc0 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:34.430630  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d289c1362c24e2d9779e260ac87adc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.451057  9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d6eb6dd14b4ad98630c7a2ba5ab276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.434204  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0720b968964c1d97550949b47591b3 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:34.453347  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0720b968964c1d97550949b47591b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.432411  9987 tablet_service.cc:1511] Processing CreateTablet for tablet aa3742289dc5453a9fe82b497f976d56 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:34.474041  9987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3742289dc5453a9fe82b497f976d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.438488  9986 tablet_service.cc:1511] Processing CreateTablet for tablet 73ade1159a544ffc9ed007c73fc1f142 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:34.450661 10041 tablet_bootstrap.cc:654] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.440721  9984 tablet_service.cc:1511] Processing CreateTablet for tablet 56d6c35f0da543cd956a7d3573661d05 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:34.482750  9984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d6c35f0da543cd956a7d3573661d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.440439  9983 tablet_service.cc:1511] Processing CreateTablet for tablet 088b74a10d0143498b23216ea9e28e98 (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:34.487517  9983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088b74a10d0143498b23216ea9e28e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.499619 10043 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.437306  9985 tablet_service.cc:1511] Processing CreateTablet for tablet c42e4667e13b40f29a58d57399731bcf (DEFAULT_TABLE table=test-workload [id=757e016994fb4d4ca03d5c33a464b355]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:34.514891  9986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ade1159a544ffc9ed007c73fc1f142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.521762 10043 tablet_bootstrap.cc:654] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.531071  9985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42e4667e13b40f29a58d57399731bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:34.531510 10042 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.532454 10041 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.532979 10041 ts_tablet_manager.cc:1403] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.004s
I20260709 12:26:34.538125 10041 raft_consensus.cc:359] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.539238 10041 raft_consensus.cc:385] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.539582 10041 raft_consensus.cc:740] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.540650 10041 consensus_queue.cc:260] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.541270 10043 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.541952 10043 ts_tablet_manager.cc:1403] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 12:26:34.545184 10043 raft_consensus.cc:359] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.545931 10043 raft_consensus.cc:385] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.546481 10043 raft_consensus.cc:740] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.547310 10043 consensus_queue.cc:260] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.555881 10026 heartbeater.cc:499] Master 127.29.143.254:41379 was elected leader, sending a full tablet report...
I20260709 12:26:34.556805 10043 ts_tablet_manager.cc:1434] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.006s
I20260709 12:26:34.558085 10043 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.564404 10043 tablet_bootstrap.cc:654] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.567055 10042 tablet_bootstrap.cc:654] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.591872  9952 heartbeater.cc:499] Master 127.29.143.254:41379 was elected leader, sending a full tablet report...
I20260709 12:26:34.593114 10041 ts_tablet_manager.cc:1434] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.060s	user 0.015s	sys 0.041s
I20260709 12:26:34.594187 10041 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.600183 10042 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.600821 10042 ts_tablet_manager.cc:1403] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.000s
I20260709 12:26:34.600953 10041 tablet_bootstrap.cc:654] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.604138 10043 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.604733 10043 ts_tablet_manager.cc:1403] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.018s
I20260709 12:26:34.610778 10042 raft_consensus.cc:359] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.611536 10042 raft_consensus.cc:385] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.611831 10042 raft_consensus.cc:740] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.612515 10042 consensus_queue.cc:260] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.613220 10041 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.613729 10041 ts_tablet_manager.cc:1403] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 12:26:34.613809 10043 raft_consensus.cc:359] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.614583 10043 raft_consensus.cc:385] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.614902 10043 raft_consensus.cc:740] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.615892  9877 heartbeater.cc:499] Master 127.29.143.254:41379 was elected leader, sending a full tablet report...
I20260709 12:26:34.615823 10043 consensus_queue.cc:260] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.616710 10041 raft_consensus.cc:359] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.617427 10041 raft_consensus.cc:385] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.617712 10041 raft_consensus.cc:740] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.619020 10043 ts_tablet_manager.cc:1434] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:26:34.618587 10041 consensus_queue.cc:260] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.620038 10043 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.620867 10041 ts_tablet_manager.cc:1434] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:26:34.621853 10041 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.626483 10043 tablet_bootstrap.cc:654] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.627635 10042 ts_tablet_manager.cc:1434] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:26:34.628321 10041 tablet_bootstrap.cc:654] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.628827 10042 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.635540 10042 tablet_bootstrap.cc:654] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.642444 10041 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.642943 10041 ts_tablet_manager.cc:1403] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 12:26:34.645821 10041 raft_consensus.cc:359] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.646361 10041 raft_consensus.cc:385] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.646552 10041 raft_consensus.cc:740] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.647372 10041 consensus_queue.cc:260] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.649204 10043 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.649304 10041 ts_tablet_manager.cc:1434] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:34.649797 10043 ts_tablet_manager.cc:1403] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.006s
I20260709 12:26:34.650439 10041 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.652828 10043 raft_consensus.cc:359] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.653563 10043 raft_consensus.cc:385] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.653865 10043 raft_consensus.cc:740] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.656487 10042 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.657043 10042 ts_tablet_manager.cc:1403] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 12:26:34.657400 10041 tablet_bootstrap.cc:654] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.659943 10042 raft_consensus.cc:359] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.660693 10042 raft_consensus.cc:385] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.659036 10043 consensus_queue.cc:260] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.660980 10042 raft_consensus.cc:740] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.663586 10043 ts_tablet_manager.cc:1434] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:26:34.663947 10042 consensus_queue.cc:260] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.664595 10043 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.664963 10041 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.665452 10041 ts_tablet_manager.cc:1403] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:26:34.668264 10041 raft_consensus.cc:359] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.669029 10041 raft_consensus.cc:385] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.669341 10041 raft_consensus.cc:740] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.670200 10041 consensus_queue.cc:260] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.671761 10043 tablet_bootstrap.cc:654] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.672441 10041 ts_tablet_manager.cc:1434] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:34.673549 10041 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.679028 10042 ts_tablet_manager.cc:1434] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:26:34.681991 10041 tablet_bootstrap.cc:654] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.685997 10042 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
W20260709 12:26:34.686342 10027 tablet.cc:2406] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:34.688726 10043 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.689309 10043 ts_tablet_manager.cc:1403] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.009s
I20260709 12:26:34.690519 10041 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.691078 10041 ts_tablet_manager.cc:1403] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:26:34.692488 10042 tablet_bootstrap.cc:654] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.692642 10043 raft_consensus.cc:359] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.693439 10043 raft_consensus.cc:385] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.693766 10043 raft_consensus.cc:740] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.694211 10041 raft_consensus.cc:359] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.694977 10041 raft_consensus.cc:385] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.694548 10043 consensus_queue.cc:260] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.695390 10041 raft_consensus.cc:740] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.696192 10041 consensus_queue.cc:260] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.698402 10041 ts_tablet_manager.cc:1434] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:34.699038 10043 ts_tablet_manager.cc:1434] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:26:34.699458 10041 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.700138 10043 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.706786 10041 tablet_bootstrap.cc:654] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.707026 10043 tablet_bootstrap.cc:654] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.712080 10042 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.712601 10042 ts_tablet_manager.cc:1403] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 12:26:34.716147 10042 raft_consensus.cc:359] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.716765 10042 raft_consensus.cc:385] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.717025 10042 raft_consensus.cc:740] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.717685 10042 consensus_queue.cc:260] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.719848 10042 ts_tablet_manager.cc:1434] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:34.720853 10042 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.721752 10041 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.722324 10041 ts_tablet_manager.cc:1403] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 12:26:34.723440 10043 tablet_bootstrap.cc:492] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.723975 10043 ts_tablet_manager.cc:1403] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:26:34.725382 10041 raft_consensus.cc:359] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.726141 10041 raft_consensus.cc:385] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.726430 10041 raft_consensus.cc:740] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.727300 10042 tablet_bootstrap.cc:654] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.727449 10041 consensus_queue.cc:260] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.728713 10046 raft_consensus.cc:493] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.729176 10046 raft_consensus.cc:515] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.729717 10041 ts_tablet_manager.cc:1434] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:34.726904 10043 raft_consensus.cc:359] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.730790 10041 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.730875 10043 raft_consensus.cc:385] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.731375 10043 raft_consensus.cc:740] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.732416 10043 consensus_queue.cc:260] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.735423 10047 raft_consensus.cc:493] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.735906 10047 raft_consensus.cc:515] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.737385 10041 tablet_bootstrap.cc:654] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.740447 10047 leader_election.cc:290] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.744939 10043 ts_tablet_manager.cc:1434] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 12:26:34.752218 10046 leader_election.cc:290] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.753952 10043 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.770336  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
W20260709 12:26:34.772199  9890 leader_election.cc:343] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.772590 10043 tablet_bootstrap.cc:654] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.781206 10042 tablet_bootstrap.cc:492] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.781972 10042 ts_tablet_manager.cc:1403] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.013s
I20260709 12:26:34.785442 10041 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.786119 10041 ts_tablet_manager.cc:1403] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.003s
I20260709 12:26:34.785655 10042 raft_consensus.cc:359] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.786629 10042 raft_consensus.cc:385] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.787043 10042 raft_consensus.cc:740] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.787895 10042 consensus_queue.cc:260] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.789249 10041 raft_consensus.cc:359] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.790004 10041 raft_consensus.cc:385] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.790287 10041 raft_consensus.cc:740] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.794844 10042 ts_tablet_manager.cc:1434] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:26:34.796211 10042 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.795825 10041 consensus_queue.cc:260] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
W20260709 12:26:34.799381  9798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:34.801517 10041 ts_tablet_manager.cc:1434] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:26:34.804126 10042 tablet_bootstrap.cc:654] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.806818 10041 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.820253 10051 raft_consensus.cc:493] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.820891 10051 raft_consensus.cc:515] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.823243  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:34.824018  9927 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:34.825717 10043 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.827905 10041 tablet_bootstrap.cc:654] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.828032 10043 ts_tablet_manager.cc:1403] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.039s
I20260709 12:26:34.828300  9965 leader_election.cc:304] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:34.829499 10063 raft_consensus.cc:2804] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.825595 10042 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.830009 10063 raft_consensus.cc:493] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.832183 10063 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.833392 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
W20260709 12:26:34.835158  9892 leader_election.cc:343] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.835609  9892 leader_election.cc:304] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a04374fb84b843a89010eb5726660aef; no voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:34.836884 10061 raft_consensus.cc:2749] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:34.826934 10051 leader_election.cc:290] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.832175 10042 ts_tablet_manager.cc:1403] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.000s
I20260709 12:26:34.842119 10043 raft_consensus.cc:359] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.842739 10042 raft_consensus.cc:359] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.848861 10042 raft_consensus.cc:385] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.849320 10042 raft_consensus.cc:740] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.843302 10043 raft_consensus.cc:385] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.850883 10043 raft_consensus.cc:740] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.851936 10043 consensus_queue.cc:260] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.850368 10063 raft_consensus.cc:515] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.855072 10043 ts_tablet_manager.cc:1434] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:26:34.856431 10043 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.860039  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:34.860679  9927 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.850343 10042 consensus_queue.cc:260] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.863559 10042 ts_tablet_manager.cc:1434] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:26:34.864893 10042 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.869234  9927 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:34.870584  9965 leader_election.cc:304] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:34.870904 10063 leader_election.cc:290] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.871541 10063 raft_consensus.cc:2804] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:34.873920  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:34.875595  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:34.875859 10043 tablet_bootstrap.cc:654] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.876467 10063 raft_consensus.cc:697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:34.876677 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:34.878139 10051 raft_consensus.cc:493] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.878623 10051 raft_consensus.cc:515] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.880707 10051 leader_election.cc:290] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.881652 10047 raft_consensus.cc:493] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.882669 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
W20260709 12:26:34.883055  9817 leader_election.cc:343] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.882145 10047 raft_consensus.cc:515] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.883700 10042 tablet_bootstrap.cc:654] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.883776 10041 tablet_bootstrap.cc:492] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.884485 10041 ts_tablet_manager.cc:1403] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.033s
I20260709 12:26:34.885284 10047 leader_election.cc:290] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.883356 10001 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:34.885957 10061 raft_consensus.cc:493] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.888365 10061 raft_consensus.cc:515] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.889088  9817 leader_election.cc:304] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:34.889410 10041 raft_consensus.cc:359] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.890003 10051 raft_consensus.cc:2804] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.890374 10041 raft_consensus.cc:385] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.890430 10051 raft_consensus.cc:493] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.890833 10041 raft_consensus.cc:740] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.890996 10051 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.891227 10061 leader_election.cc:290] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.894114 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:34.895352 10001 raft_consensus.cc:2468] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:34.892764 10041 consensus_queue.cc:260] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.894207  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:34.897266  9892 leader_election.cc:304] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
W20260709 12:26:34.897456  9964 leader_election.cc:343] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:34.898442  9964 leader_election.cc:343] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.898801 10046 raft_consensus.cc:2804] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:34.898967  9890 leader_election.cc:343] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.899428 10046 raft_consensus.cc:493] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.899534  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:34.899950 10046 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.877398 10063 consensus_queue.cc:237] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.902711 10047 raft_consensus.cc:493] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.903198 10047 raft_consensus.cc:515] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.905333 10047 leader_election.cc:290] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.907425  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:34.908118  9926 raft_consensus.cc:2468] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:34.909288  9965 leader_election.cc:304] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:34.910038 10047 raft_consensus.cc:2804] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.910368 10047 raft_consensus.cc:493] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.910648 10047 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.912331 10041 ts_tablet_manager.cc:1434] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:26:34.913540 10041 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:34.915359  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
W20260709 12:26:34.917018  9964 leader_election.cc:343] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.917870  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:34.918533  9926 raft_consensus.cc:2468] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:34.918958  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:34.919677  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:34.920351  9925 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:34.920501 10046 raft_consensus.cc:515] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
W20260709 12:26:34.921120  9964 leader_election.cc:343] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.922444  9927 raft_consensus.cc:2393] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 682a1c00ab064499a57bc01dd23e1e90 in current term 1: Already voted for candidate a04374fb84b843a89010eb5726660aef in this term.
I20260709 12:26:34.924067  9816 leader_election.cc:304] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:34.924672 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:34.928781 10001 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.925599  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:34.925849  9965 leader_election.cc:304] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90; no voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef
I20260709 12:26:34.930665 10047 raft_consensus.cc:515] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.934276 10046 leader_election.cc:290] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
W20260709 12:26:34.939038  9890 leader_election.cc:343] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:34.940167 10047 leader_election.cc:290] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:34.940467 10043 tablet_bootstrap.cc:492] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:34.935922 10042 tablet_bootstrap.cc:492] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:34.940941 10043 ts_tablet_manager.cc:1403] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.005s
I20260709 12:26:34.941200 10042 ts_tablet_manager.cc:1403] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.017s
I20260709 12:26:34.932921 10041 tablet_bootstrap.cc:654] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.927831 10051 raft_consensus.cc:515] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.944097 10043 raft_consensus.cc:359] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.944948 10043 raft_consensus.cc:385] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.945235 10043 raft_consensus.cc:740] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.946044 10043 consensus_queue.cc:260] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.945968  9748 catalog_manager.cc:5697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.949030 10001 raft_consensus.cc:2468] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:34.948742 10042 raft_consensus.cc:359] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.949590 10047 raft_consensus.cc:2749] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:34.949736 10042 raft_consensus.cc:385] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.950232 10042 raft_consensus.cc:740] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.951218 10042 consensus_queue.cc:260] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.952881 10051 leader_election.cc:290] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.953552 10051 raft_consensus.cc:2804] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.953931 10051 raft_consensus.cc:493] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.954365 10051 raft_consensus.cc:3060] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.954475 10041 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:34.955405 10043 ts_tablet_manager.cc:1434] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:34.955652 10041 ts_tablet_manager.cc:1403] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 12:26:34.956688 10043 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:34.958210  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:34.959973 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:34.960700 10000 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.964150 10042 ts_tablet_manager.cc:1434] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:26:34.965157 10042 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:34.970547 10046 raft_consensus.cc:493] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.970738 10041 raft_consensus.cc:359] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.971156 10046 raft_consensus.cc:515] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:34.972044 10042 tablet_bootstrap.cc:654] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.973455 10046 leader_election.cc:290] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:34.974982  9927 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:34.975863 10043 tablet_bootstrap.cc:654] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:34.976009  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:34.976701  9852 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:34.971561 10041 raft_consensus.cc:385] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:34.978107  9890 leader_election.cc:304] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:34.979405  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:34.974519 10000 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:34.979595 10046 raft_consensus.cc:2804] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:34.980145  9999 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:34.981827  9817 leader_election.cc:304] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:34.983076  9892 leader_election.cc:304] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:34.980180 10046 raft_consensus.cc:493] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.984923 10061 raft_consensus.cc:2804] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:34.978580 10041 raft_consensus.cc:740] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:34.987808 10046 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.001431 10079 raft_consensus.cc:493] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.007033 10079 raft_consensus.cc:515] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.002981 10082 raft_consensus.cc:493] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.013165 10082 raft_consensus.cc:515] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.015056 10041 consensus_queue.cc:260] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.017213  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:35.017763 10079 leader_election.cc:290] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791)
I20260709 12:26:35.012472 10078 raft_consensus.cc:2804] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.018215  9999 raft_consensus.cc:2468] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
W20260709 12:26:35.010198  9816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.143.194:38653, user_credentials={real_user=slave}} blocked reactor thread for 86396.2us
I20260709 12:26:35.021029  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.021713  9925 raft_consensus.cc:2468] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:35.021054  9817 leader_election.cc:304] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:35.024361  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.024957  9925 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.025121 10091 raft_consensus.cc:2804] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:35.025592 10043 tablet_bootstrap.cc:492] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:35.025688 10091 raft_consensus.cc:493] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.026182 10043 ts_tablet_manager.cc:1403] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.070s	user 0.036s	sys 0.006s
I20260709 12:26:35.026314 10091 raft_consensus.cc:3060] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.028391  9965 leader_election.cc:304] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.019835 10046 raft_consensus.cc:515] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.030978 10047 raft_consensus.cc:2804] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:35.031502 10047 raft_consensus.cc:493] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.031924 10047 raft_consensus.cc:3060] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.032027  9852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.033869  9852 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.035853 10043 raft_consensus.cc:359] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.036556 10043 raft_consensus.cc:385] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:35.036803 10043 raft_consensus.cc:740] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:35.037381 10061 raft_consensus.cc:697] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:35.038112 10089 raft_consensus.cc:493] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.038383 10061 consensus_queue.cc:237] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.038628 10089 raft_consensus.cc:515] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.041028 10089 leader_election.cc:290] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.042351  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:35.043263  9851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:35.044034  9851 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:35.032716 10041 ts_tablet_manager.cc:1434] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:26:35.048143 10046 leader_election.cc:290] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.049269 10079 raft_consensus.cc:493] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.046365  9927 raft_consensus.cc:2468] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:35.049853 10079 raft_consensus.cc:515] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.050817 10043 consensus_queue.cc:260] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.051111 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.051674  9890 leader_election.cc:304] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.051873 10000 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.052614 10088 raft_consensus.cc:2804] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:35.052986 10088 raft_consensus.cc:493] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.053334 10088 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.053465 10043 ts_tablet_manager.cc:1434] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:26:35.054517 10043 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:35.055001  9965 leader_election.cc:304] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.056051  9999 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:35.056365 10042 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:35.062224 10042 ts_tablet_manager.cc:1403] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.097s	user 0.034s	sys 0.032s
I20260709 12:26:35.057909 10063 raft_consensus.cc:2804] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.063815  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.064486  9926 raft_consensus.cc:2468] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:35.065646  9965 leader_election.cc:304] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.066250 10042 raft_consensus.cc:359] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.061147 10091 raft_consensus.cc:515] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.069671 10078 raft_consensus.cc:697] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.071547 10047 raft_consensus.cc:515] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.072641 10078 consensus_queue.cc:237] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.066771  9852 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:35.067759  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.074643 10000 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:35.075166  9927 raft_consensus.cc:2468] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:35.075892 10091 leader_election.cc:290] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.076010  9892 leader_election.cc:304] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.069721 10042 raft_consensus.cc:385] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:35.076936 10046 raft_consensus.cc:2804] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.077085 10047 leader_election.cc:290] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791)
I20260709 12:26:35.077212 10042 raft_consensus.cc:740] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:35.077515 10046 raft_consensus.cc:697] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:35.069089  9851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.078416 10046 consensus_queue.cc:237] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
W20260709 12:26:35.079066  9964 leader_election.cc:343] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:35.070004  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:35.079757  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.080466  9850 raft_consensus.cc:2393] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 682a1c00ab064499a57bc01dd23e1e90 in current term 1: Already voted for candidate 3fad6e5099a144da91d785bdbaef1e05 in this term.
I20260709 12:26:35.080884  9925 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:35.070914  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:35.060267 10043 tablet_bootstrap.cc:654] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:35.070755 10063 raft_consensus.cc:697] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:35.002081 10051 raft_consensus.cc:515] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.083711  9849 raft_consensus.cc:2393] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 682a1c00ab064499a57bc01dd23e1e90 in current term 1: Already voted for candidate 3fad6e5099a144da91d785bdbaef1e05 in this term.
I20260709 12:26:35.083724 10063 consensus_queue.cc:237] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.085930  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.086663  9927 raft_consensus.cc:3060] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.087064  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.061949 10088 raft_consensus.cc:515] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.057595 10079 leader_election.cc:290] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:35.068531 10093 raft_consensus.cc:2804] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:35.089746 10093 raft_consensus.cc:493] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.089442  9965 leader_election.cc:304] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90; no voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.090200 10093 raft_consensus.cc:3060] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.090824 10079 raft_consensus.cc:2749] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:35.073906 10082 leader_election.cc:290] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.093645 10051 leader_election.cc:290] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.078089 10042 consensus_queue.cc:260] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.102548 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.103204 10001 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.103788 10042 ts_tablet_manager.cc:1434] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 12:26:35.105149 10042 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:35.095098  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.111949  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.112641  9849 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.110420 10001 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:35.097344  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.098512 10093 raft_consensus.cc:515] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.114665 10042 tablet_bootstrap.cc:654] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:35.124274 10093 leader_election.cc:290] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:35.120369  9892 leader_election.cc:304] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.126046 10061 raft_consensus.cc:2804] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.127616 10061 raft_consensus.cc:697] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:35.128568 10061 consensus_queue.cc:237] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.130229  9927 raft_consensus.cc:2468] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:35.131605  9999 raft_consensus.cc:2393] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fad6e5099a144da91d785bdbaef1e05 in current term 1: Already voted for candidate 682a1c00ab064499a57bc01dd23e1e90 in this term.
I20260709 12:26:35.099232 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3347edf7964d228e26b13f4abf6a9b" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.100296  9748 catalog_manager.cc:5697] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 0 to 1, leader changed from <none> to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 1 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.135936 10000 raft_consensus.cc:2393] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fad6e5099a144da91d785bdbaef1e05 in current term 1: Already voted for candidate 682a1c00ab064499a57bc01dd23e1e90 in this term.
I20260709 12:26:35.136721  9749 catalog_manager.cc:5697] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.122692 10088 leader_election.cc:290] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.122591  9925 raft_consensus.cc:3060] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.122256  9849 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:35.149091  9748 catalog_manager.cc:5697] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.152974 10043 tablet_bootstrap.cc:492] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:35.151419  9816 leader_election.cc:304] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:35.153469 10043 ts_tablet_manager.cc:1403] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.012s
I20260709 12:26:35.153734 10078 raft_consensus.cc:2804] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.154017  9925 raft_consensus.cc:2468] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:35.154299 10078 raft_consensus.cc:697] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.155400  9816 leader_election.cc:304] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:35.155273 10078 consensus_queue.cc:237] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.151419  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.156474  9927 raft_consensus.cc:2393] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 682a1c00ab064499a57bc01dd23e1e90 in current term 1: Already voted for candidate 3fad6e5099a144da91d785bdbaef1e05 in this term.
I20260709 12:26:35.157248 10042 tablet_bootstrap.cc:492] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:35.157805 10042 ts_tablet_manager.cc:1403] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.008s
I20260709 12:26:35.156857 10043 raft_consensus.cc:359] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.158413 10043 raft_consensus.cc:385] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:35.158766 10043 raft_consensus.cc:740] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:35.160481 10082 raft_consensus.cc:2804] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.161185 10082 raft_consensus.cc:697] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.159597 10043 consensus_queue.cc:260] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.162104 10082 consensus_queue.cc:237] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.163430 10042 raft_consensus.cc:359] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.164181 10042 raft_consensus.cc:385] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:35.164476 10042 raft_consensus.cc:740] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:35.163906  9749 catalog_manager.cc:5697] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 0 to 1, leader changed from <none> to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 1 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.165158 10042 consensus_queue.cc:260] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.167062  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d289c1362c24e2d9779e260ac87adc0" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.167496 10043 ts_tablet_manager.cc:1434] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 12:26:35.168429  9964 leader_election.cc:304] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90; no voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.169649 10063 raft_consensus.cc:2749] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:35.169960 10042 ts_tablet_manager.cc:1434] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:26:35.171003 10042 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:35.165779  9749 catalog_manager.cc:5697] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 0 to 1, leader changed from <none> to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 1 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.162060 10078 raft_consensus.cc:493] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.178822 10042 tablet_bootstrap.cc:654] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:35.178260 10078 raft_consensus.cc:515] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.183614 10078 leader_election.cc:290] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.183970  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.184782 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:35.185779 10000 raft_consensus.cc:2393] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fad6e5099a144da91d785bdbaef1e05 in current term 1: Already voted for candidate a04374fb84b843a89010eb5726660aef in this term.
I20260709 12:26:35.187116  9817 leader_election.cc:304] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05; no voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.188796 10078 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.192423 10042 tablet_bootstrap.cc:492] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:35.192983 10042 ts_tablet_manager.cc:1403] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:26:35.194757  9748 catalog_manager.cc:5697] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.195809 10042 raft_consensus.cc:359] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.196573 10042 raft_consensus.cc:385] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:35.196923 10042 raft_consensus.cc:740] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:35.196623  9748 catalog_manager.cc:5697] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.197659 10042 consensus_queue.cc:260] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.198004 10078 raft_consensus.cc:2749] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:35.199432 10042 ts_tablet_manager.cc:1434] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:26:35.434578 10063 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.444609  9849 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.454763 10093 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.482645 10082 raft_consensus.cc:493] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.483206 10082 raft_consensus.cc:515] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.484856 10082 leader_election.cc:290] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.485863 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:35.485755  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.486723 10000 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:35.486845  9927 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:35.487735  9817 leader_election.cc:304] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:35.488389 10082 raft_consensus.cc:2804] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:35.488730 10082 raft_consensus.cc:493] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.489013 10082 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.494234 10082 raft_consensus.cc:515] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.495954 10082 leader_election.cc:290] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.496675  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.496970 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.497193  9927 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.497557 10000 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.498745 10082 raft_consensus.cc:493] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.499236 10082 raft_consensus.cc:515] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.501642 10082 leader_election.cc:290] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.502444  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:35.503235  9925 raft_consensus.cc:2393] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fad6e5099a144da91d785bdbaef1e05 in current term 1: Already voted for candidate 682a1c00ab064499a57bc01dd23e1e90 in this term.
I20260709 12:26:35.503240  9927 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:35.504458  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:35.504752 10000 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:35.504833  9816 leader_election.cc:304] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.505615  9817 leader_election.cc:304] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05; no voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.505900 10082 raft_consensus.cc:2804] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:35.506393 10078 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:35.506470 10082 raft_consensus.cc:697] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.507464 10082 consensus_queue.cc:237] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.513067 10078 raft_consensus.cc:2749] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:35.515439 10061 consensus_queue.cc:1048] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.515549  9748 catalog_manager.cc:5697] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.523770 10093 consensus_queue.cc:1048] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.524355 10078 consensus_queue.cc:1048] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.539426 10063 consensus_queue.cc:1048] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.550863 10061 consensus_queue.cc:1048] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.551739 10046 consensus_queue.cc:1048] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.557166 10078 consensus_queue.cc:1048] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.563181 10078 consensus_queue.cc:1048] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.586743 10091 consensus_queue.cc:1048] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.589574 10086 consensus_queue.cc:1048] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.686177 10082 consensus_queue.cc:1048] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.692874 10086 consensus_queue.cc:1048] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:35.698427 10091 consensus_queue.cc:1048] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.711243 10046 consensus_queue.cc:1048] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:35.754815 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
mode: GRACEFUL
new_leader_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:35.755424 10001 raft_consensus.cc:606] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Received request to transfer leadership to TS 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:35.771911  9927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0720b968964c1d97550949b47591b3"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
mode: GRACEFUL
new_leader_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:26:35.772444  9927 raft_consensus.cc:606] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Received request to transfer leadership to TS 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:35.786962  9849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:53630
I20260709 12:26:35.787556  9849 raft_consensus.cc:606] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.793125  9849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:53630
I20260709 12:26:35.793797  9849 raft_consensus.cc:606] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.802183 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:35.802812 10001 raft_consensus.cc:606] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:35.808279  9927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
mode: GRACEFUL
new_leader_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:26:35.808836  9927 raft_consensus.cc:606] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Received request to transfer leadership to TS 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:35.937709 10091 raft_consensus.cc:993] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:35.938163 10091 raft_consensus.cc:1081] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:35.939745  9927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54438
I20260709 12:26:35.940277  9927 raft_consensus.cc:493] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:35.940582  9927 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.945787  9927 raft_consensus.cc:515] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.947614  9927 leader_election.cc:290] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.948613  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:35.948709 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3742289dc5453a9fe82b497f976d56" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.949343  9849 raft_consensus.cc:3055] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:35.949399 10001 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.949662  9849 raft_consensus.cc:740] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.950520  9849 consensus_queue.cc:260] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.951586  9849 raft_consensus.cc:3060] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.955178 10001 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:35.956398  9892 leader_election.cc:304] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.957113 10046 raft_consensus.cc:2804] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.957580 10046 raft_consensus.cc:697] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:35.957374  9849 raft_consensus.cc:2468] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:35.958519 10046 consensus_queue.cc:237] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.965512  9749 catalog_manager.cc:5697] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.969791 10079 raft_consensus.cc:993] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: : Instructing follower 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:35.970366 10093 raft_consensus.cc:1081] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Signalling peer 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:35.972059  9849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:53618
I20260709 12:26:35.972604  9849 raft_consensus.cc:493] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:35.973031  9849 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.979229  9849 raft_consensus.cc:515] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.981042  9849 leader_election.cc:290] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:35.982307  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:35.982789 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:35.983021  9927 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.983398 10000 raft_consensus.cc:3055] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:35.983741 10000 raft_consensus.cc:740] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:35.984562 10000 consensus_queue.cc:260] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:35.985800 10000 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.990494  9927 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:35.991909  9816 leader_election.cc:304] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:35.992697 10091 raft_consensus.cc:2804] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.993131 10091 raft_consensus.cc:697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:35.993294 10000 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:35.993953 10091 consensus_queue.cc:237] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.000630  9749 catalog_manager.cc:5697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 1 to 2, leader changed from 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195) to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.030264 10061 raft_consensus.cc:993] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: : Instructing follower 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:36.030758 10046 raft_consensus.cc:1081] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Signalling peer 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:36.032248 10000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:51866
I20260709 12:26:36.032737 10000 raft_consensus.cc:493] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:36.033042 10000 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.040321 10000 raft_consensus.cc:515] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.042225 10000 leader_election.cc:290] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:36.042973  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:36.043412  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088b74a10d0143498b23216ea9e28e98" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:36.043752  9849 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.044044  9927 raft_consensus.cc:3055] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.044394  9927 raft_consensus.cc:740] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:36.045224  9927 consensus_queue.cc:260] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.046367  9927 raft_consensus.cc:3060] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.051240 10063 raft_consensus.cc:993] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:36.051767 10063 raft_consensus.cc:1081] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:36.053380  9925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54436
I20260709 12:26:36.053979  9925 raft_consensus.cc:493] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:36.054338  9925 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.055246  9849 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 2.
I20260709 12:26:36.056564  9964 leader_election.cc:304] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:36.056684 10091 consensus_queue.cc:1048] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:36.057591 10093 raft_consensus.cc:2804] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.058208 10093 raft_consensus.cc:697] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:36.059093 10093 consensus_queue.cc:237] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.060664  9927 raft_consensus.cc:2468] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 2.
I20260709 12:26:36.063694  9925 raft_consensus.cc:515] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.066574  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:36.066812  9925 leader_election.cc:290] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:36.067296  9849 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.069473  9749 catalog_manager.cc:5697] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 1 to 2, leader changed from a04374fb84b843a89010eb5726660aef (127.29.143.194) to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.068127 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d6c35f0da543cd956a7d3573661d05" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:36.072255 10000 raft_consensus.cc:3055] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.072647 10000 raft_consensus.cc:740] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:36.073626 10000 consensus_queue.cc:260] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.074976 10000 raft_consensus.cc:3060] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.075210 10082 consensus_queue.cc:1048] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:36.076013  9849 raft_consensus.cc:2468] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:36.079793  9890 leader_election.cc:304] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:36.080600 10088 raft_consensus.cc:2804] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.081079 10088 raft_consensus.cc:697] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:36.081885 10088 consensus_queue.cc:237] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.083983 10000 raft_consensus.cc:2468] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:36.090198 10078 raft_consensus.cc:993] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:36.090667 10082 raft_consensus.cc:1081] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:36.092343  9927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54438
I20260709 12:26:36.092921  9927 raft_consensus.cc:493] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:36.093333  9927 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.098614  9927 raft_consensus.cc:515] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.100936  9927 leader_election.cc:290] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:36.101266  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:36.101545 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ade1159a544ffc9ed007c73fc1f142" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:36.101950  9849 raft_consensus.cc:3055] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.102209 10000 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.102480  9849 raft_consensus.cc:740] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:36.103504  9849 consensus_queue.cc:260] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.104784  9849 raft_consensus.cc:3060] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.104342  9750 catalog_manager.cc:5697] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.108672 10000 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:36.109908  9892 leader_election.cc:304] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:36.110548 10088 raft_consensus.cc:2804] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.110929  9849 raft_consensus.cc:2468] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:36.111070 10088 raft_consensus.cc:697] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:36.112035 10088 consensus_queue.cc:237] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.118769  9750 catalog_manager.cc:5697] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.172932 10061 raft_consensus.cc:993] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: : Instructing follower 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:36.173480 10061 raft_consensus.cc:1081] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Signalling peer 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:36.175534  9849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e0720b968964c1d97550949b47591b3"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:26:36.176129  9849 raft_consensus.cc:493] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:36.176517  9849 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.182893  9849 raft_consensus.cc:515] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.184546  9849 leader_election.cc:290] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:36.185493  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:36.185679 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0720b968964c1d97550949b47591b3" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:36.186164  9927 raft_consensus.cc:3055] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:36.186496 10000 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.186604  9927 raft_consensus.cc:740] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:36.187597  9927 consensus_queue.cc:260] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.188583  9927 raft_consensus.cc:3060] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.192426 10000 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:36.193606  9817 leader_election.cc:304] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:36.194336 10082 raft_consensus.cc:2804] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.194440  9927 raft_consensus.cc:2468] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:36.194854 10082 raft_consensus.cc:697] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:36.195787 10082 consensus_queue.cc:237] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:36.201859  9749 catalog_manager.cc:5697] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 1 to 2, leader changed from a04374fb84b843a89010eb5726660aef (127.29.143.194) to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.416814  9849 raft_consensus.cc:1275] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.418138 10061 consensus_queue.cc:1048] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.425884 10000 raft_consensus.cc:1275] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.428376 10088 consensus_queue.cc:1048] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.468128 10000 raft_consensus.cc:1275] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.469483 10088 consensus_queue.cc:1048] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.477464  9849 raft_consensus.cc:1275] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.479094 10061 consensus_queue.cc:1048] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.524952  9927 raft_consensus.cc:1275] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.524952 10000 raft_consensus.cc:1275] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.526985 10082 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.527619 10078 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.547050 10000 raft_consensus.cc:1275] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.548523 10061 consensus_queue.cc:1048] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.556268  9849 raft_consensus.cc:1275] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.557801 10046 consensus_queue.cc:1048] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.594816  9849 raft_consensus.cc:1275] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.596076 10093 consensus_queue.cc:1048] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.604403  9925 raft_consensus.cc:1275] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.605892 10132 consensus_queue.cc:1048] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.674937  9925 raft_consensus.cc:1275] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.676105 10082 consensus_queue.cc:1048] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.683403 10000 raft_consensus.cc:1275] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.684911 10051 consensus_queue.cc:1048] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:38.841591  9750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40682:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:38.843928  9750 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:38.894773  9841 tablet_service.cc:1511] Processing CreateTablet for tablet 3e914d5dc0444baab0a072b2dc4ad318 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:38.896139  9841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e914d5dc0444baab0a072b2dc4ad318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.895797  9914 tablet_service.cc:1511] Processing CreateTablet for tablet 3e914d5dc0444baab0a072b2dc4ad318 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:38.897244  9986 tablet_service.cc:1511] Processing CreateTablet for tablet 3e914d5dc0444baab0a072b2dc4ad318 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:38.898298  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e914d5dc0444baab0a072b2dc4ad318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.899749  9835 tablet_service.cc:1511] Processing CreateTablet for tablet 186b4a29c21f4b32b97d5dc7fac59801 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:38.900987  9835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b4a29c21f4b32b97d5dc7fac59801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.902135  9837 tablet_service.cc:1511] Processing CreateTablet for tablet ea84be4c8d3a4fc6978a5ada9af04e2d (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:38.903395  9837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea84be4c8d3a4fc6978a5ada9af04e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.905038  9917 tablet_service.cc:1511] Processing CreateTablet for tablet 186b4a29c21f4b32b97d5dc7fac59801 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:38.906507  9917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b4a29c21f4b32b97d5dc7fac59801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.907799  9909 tablet_service.cc:1511] Processing CreateTablet for tablet ea84be4c8d3a4fc6978a5ada9af04e2d (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:38.909014  9909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea84be4c8d3a4fc6978a5ada9af04e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.898543  9986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e914d5dc0444baab0a072b2dc4ad318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.913250  9915 tablet_service.cc:1511] Processing CreateTablet for tablet b3e9ce2552fa43b18d66b80be18cbbf7 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:38.913335  9912 tablet_service.cc:1511] Processing CreateTablet for tablet 2194e9d053844d0eafd154acbf13bf52 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:38.914176  9836 tablet_service.cc:1511] Processing CreateTablet for tablet b3e9ce2552fa43b18d66b80be18cbbf7 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:38.915493  9836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e9ce2552fa43b18d66b80be18cbbf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.916188  9838 tablet_service.cc:1511] Processing CreateTablet for tablet 2194e9d053844d0eafd154acbf13bf52 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:38.917385  9839 tablet_service.cc:1511] Processing CreateTablet for tablet b873e30e0f2749e382a5f1c988fe1587 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:38.914577  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e9ce2552fa43b18d66b80be18cbbf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.920274  9916 tablet_service.cc:1511] Processing CreateTablet for tablet b873e30e0f2749e382a5f1c988fe1587 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:38.921511  9916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b873e30e0f2749e382a5f1c988fe1587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.922993  9912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2194e9d053844d0eafd154acbf13bf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.924678  9838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2194e9d053844d0eafd154acbf13bf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.924360  9910 tablet_service.cc:1511] Processing CreateTablet for tablet 48908b0bd8dd4154b1d16e485ac7aa79 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:38.926257  9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48908b0bd8dd4154b1d16e485ac7aa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.926662  9839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b873e30e0f2749e382a5f1c988fe1587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.928201  9840 tablet_service.cc:1511] Processing CreateTablet for tablet 48908b0bd8dd4154b1d16e485ac7aa79 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:38.930049  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48908b0bd8dd4154b1d16e485ac7aa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.937111  9834 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb210f3bce443399cbae2e23867a136 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:38.938521  9834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb210f3bce443399cbae2e23867a136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.952404  9913 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb210f3bce443399cbae2e23867a136 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:38.953923  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb210f3bce443399cbae2e23867a136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.952453  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 186b4a29c21f4b32b97d5dc7fac59801 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:38.955062  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b4a29c21f4b32b97d5dc7fac59801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.956245  9842 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c46be19084f1dbb42ddb2c901e498 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:38.957587  9842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c46be19084f1dbb42ddb2c901e498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.958978  9989 tablet_service.cc:1511] Processing CreateTablet for tablet ea84be4c8d3a4fc6978a5ada9af04e2d (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:38.960434  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea84be4c8d3a4fc6978a5ada9af04e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.964586  9985 tablet_service.cc:1511] Processing CreateTablet for tablet b3e9ce2552fa43b18d66b80be18cbbf7 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:38.965970  9985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e9ce2552fa43b18d66b80be18cbbf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.976190  9911 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c46be19084f1dbb42ddb2c901e498 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:38.985836  9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c46be19084f1dbb42ddb2c901e498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.997000  9987 tablet_service.cc:1511] Processing CreateTablet for tablet b873e30e0f2749e382a5f1c988fe1587 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:38.997200  9984 tablet_service.cc:1511] Processing CreateTablet for tablet 48908b0bd8dd4154b1d16e485ac7aa79 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:38.997279  9983 tablet_service.cc:1511] Processing CreateTablet for tablet 2194e9d053844d0eafd154acbf13bf52 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:38.998522  9987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b873e30e0f2749e382a5f1c988fe1587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.000092  9983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2194e9d053844d0eafd154acbf13bf52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.002388  9984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48908b0bd8dd4154b1d16e485ac7aa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.012085  9990 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb210f3bce443399cbae2e23867a136 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:39.012965  9991 tablet_service.cc:1511] Processing CreateTablet for tablet ad6c46be19084f1dbb42ddb2c901e498 (DEFAULT_TABLE table=soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:39.013844  9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb210f3bce443399cbae2e23867a136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.014516  9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6c46be19084f1dbb42ddb2c901e498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.087435 10147 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.100756 10148 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.111457 10147 tablet_bootstrap.cc:654] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.111696 10149 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.114305 10148 tablet_bootstrap.cc:654] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.123111 10147 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.123631 10147 ts_tablet_manager.cc:1403] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 12:26:39.126523 10147 raft_consensus.cc:359] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.127310 10147 raft_consensus.cc:385] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.127591 10147 raft_consensus.cc:740] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.127977 10149 tablet_bootstrap.cc:654] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.128587 10148 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.128324 10147 consensus_queue.cc:260] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.138375 10147 ts_tablet_manager.cc:1434] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.014s	user 0.014s	sys 0.000s
I20260709 12:26:39.139020 10149 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.139499 10147 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.139560 10149 ts_tablet_manager.cc:1403] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 12:26:39.142855 10149 raft_consensus.cc:359] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.143769 10149 raft_consensus.cc:385] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.144068 10149 raft_consensus.cc:740] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.144860 10149 consensus_queue.cc:260] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.146517 10147 tablet_bootstrap.cc:654] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.147442 10149 ts_tablet_manager.cc:1434] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:39.143908 10148 ts_tablet_manager.cc:1403] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.002s
I20260709 12:26:39.148629 10149 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.151193 10148 raft_consensus.cc:359] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.151906 10148 raft_consensus.cc:385] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.152207 10148 raft_consensus.cc:740] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.152920 10148 consensus_queue.cc:260] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.157723 10149 tablet_bootstrap.cc:654] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.159432 10148 ts_tablet_manager.cc:1434] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:39.160527 10148 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.164551 10147 tablet_bootstrap.cc:492] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.164770 10149 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.165144 10147 ts_tablet_manager.cc:1403] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.015s
I20260709 12:26:39.165258 10149 ts_tablet_manager.cc:1403] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 12:26:39.166891 10148 tablet_bootstrap.cc:654] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.169042 10149 raft_consensus.cc:359] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.170253 10149 raft_consensus.cc:385] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.170053 10147 raft_consensus.cc:359] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.170612 10149 raft_consensus.cc:740] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.171000 10147 raft_consensus.cc:385] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.171305 10147 raft_consensus.cc:740] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.171469 10149 consensus_queue.cc:260] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.172147 10147 consensus_queue.cc:260] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.174059 10149 ts_tablet_manager.cc:1434] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:39.175022 10147 ts_tablet_manager.cc:1434] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:26:39.175632 10148 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.176174 10148 ts_tablet_manager.cc:1403] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 12:26:39.179167 10148 raft_consensus.cc:359] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.179843 10148 raft_consensus.cc:385] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.180143 10148 raft_consensus.cc:740] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.180800 10148 consensus_queue.cc:260] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.182654 10147 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.183015 10148 ts_tablet_manager.cc:1434] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:39.184005 10148 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.175107 10149 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.189368 10147 tablet_bootstrap.cc:654] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.197925 10149 tablet_bootstrap.cc:654] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.199802 10134 raft_consensus.cc:493] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.200495 10134 raft_consensus.cc:515] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.204882 10134 leader_election.cc:290] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.205737  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:39.208069  9849 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.206300  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.209110  9927 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.209247  9964 leader_election.cc:304] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.210785 10134 raft_consensus.cc:2804] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.211192 10134 raft_consensus.cc:493] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.213816 10148 tablet_bootstrap.cc:654] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.211645 10134 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.224670 10134 raft_consensus.cc:515] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.227183 10148 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.227720 10148 ts_tablet_manager.cc:1403] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 12:26:39.229895  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.230109 10149 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.230566  9927 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.230830 10149 ts_tablet_manager.cc:1403] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.005s
I20260709 12:26:39.235010  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:39.235481  9849 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.235275 10149 raft_consensus.cc:359] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.236425 10149 raft_consensus.cc:385] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.236809 10149 raft_consensus.cc:740] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.239984  9927 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.240959 10134 leader_election.cc:290] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.241418  9965 leader_election.cc:304] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.237783 10149 consensus_queue.cc:260] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.242432 10134 raft_consensus.cc:2804] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.243453  9849 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.244339 10148 raft_consensus.cc:359] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.245126 10148 raft_consensus.cc:385] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.245479 10148 raft_consensus.cc:740] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.246585 10149 ts_tablet_manager.cc:1434] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:26:39.246281 10148 consensus_queue.cc:260] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.247646 10149 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.248701 10148 ts_tablet_manager.cc:1434] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:39.246801 10134 raft_consensus.cc:697] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:39.251633 10134 consensus_queue.cc:237] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.253592 10147 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.249727 10148 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.255210 10147 ts_tablet_manager.cc:1403] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.073s	user 0.032s	sys 0.023s
I20260709 12:26:39.258386 10147 raft_consensus.cc:359] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.259219 10147 raft_consensus.cc:385] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.259541 10147 raft_consensus.cc:740] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.260401 10147 consensus_queue.cc:260] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.261194 10148 tablet_bootstrap.cc:654] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.263202 10147 ts_tablet_manager.cc:1434] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:39.254853 10149 tablet_bootstrap.cc:654] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.264372 10147 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.279345 10148 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.278100 10149 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.279877 10147 tablet_bootstrap.cc:654] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.279911 10148 ts_tablet_manager.cc:1403] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:26:39.280260 10149 ts_tablet_manager.cc:1403] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.011s
I20260709 12:26:39.283932 10149 raft_consensus.cc:359] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.284571 10148 raft_consensus.cc:359] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.285459 10148 raft_consensus.cc:385] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.285792 10148 raft_consensus.cc:740] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.284993 10149 raft_consensus.cc:385] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.286809 10149 raft_consensus.cc:740] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.285784  9747 catalog_manager.cc:5697] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.287544 10149 consensus_queue.cc:260] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.289430 10149 ts_tablet_manager.cc:1434] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:26:39.290433 10149 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.286582 10148 consensus_queue.cc:260] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.294281 10148 ts_tablet_manager.cc:1434] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 12:26:39.298403 10149 tablet_bootstrap.cc:654] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.300635 10148 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.306449 10148 tablet_bootstrap.cc:654] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.311997 10147 tablet_bootstrap.cc:492] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.313148 10147 ts_tablet_manager.cc:1403] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.020s
I20260709 12:26:39.313848 10148 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.314388 10148 ts_tablet_manager.cc:1403] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.007s
I20260709 12:26:39.317337 10147 raft_consensus.cc:359] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.318529 10147 raft_consensus.cc:385] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.319017 10147 raft_consensus.cc:740] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.320076 10147 consensus_queue.cc:260] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.320202 10148 raft_consensus.cc:359] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.321089 10148 raft_consensus.cc:385] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.321420 10148 raft_consensus.cc:740] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.322165 10149 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.322156 10148 consensus_queue.cc:260] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.322783 10149 ts_tablet_manager.cc:1403] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 12:26:39.324626 10148 ts_tablet_manager.cc:1434] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:39.325188 10147 ts_tablet_manager.cc:1434] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:26:39.326226 10147 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.325927 10149 raft_consensus.cc:359] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.326669 10149 raft_consensus.cc:385] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.327031 10149 raft_consensus.cc:740] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.327919 10149 consensus_queue.cc:260] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.328948 10134 raft_consensus.cc:493] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.329504 10134 raft_consensus.cc:515] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.330555 10149 ts_tablet_manager.cc:1434] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:39.331629 10149 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.331816 10134 leader_election.cc:290] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.335986  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.338658  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:39.338490 10148 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
W20260709 12:26:39.340519  9964 leader_election.cc:343] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.341203  9927 raft_consensus.cc:2468] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.342769  9965 leader_election.cc:304] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:39.343894 10161 raft_consensus.cc:2804] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.344319 10161 raft_consensus.cc:493] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.344666 10161 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.352643 10147 tablet_bootstrap.cc:654] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.355130 10149 tablet_bootstrap.cc:654] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.356285 10161 raft_consensus.cc:515] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.360745  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:39.363715 10148 tablet_bootstrap.cc:654] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:39.365214  9964 leader_election.cc:343] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.365271 10136 raft_consensus.cc:493] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.366505 10136 raft_consensus.cc:515] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.377095 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea84be4c8d3a4fc6978a5ada9af04e2d" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.377775 10000 raft_consensus.cc:2468] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.379047  9817 leader_election.cc:304] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.380184 10152 raft_consensus.cc:2804] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.380564 10152 raft_consensus.cc:493] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.380864 10152 raft_consensus.cc:3060] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.384395  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea84be4c8d3a4fc6978a5ada9af04e2d" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.385460  9927 raft_consensus.cc:2468] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.391451 10136 leader_election.cc:290] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.396878  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.397946  9927 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.410821 10161 leader_election.cc:290] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.410615 10152 raft_consensus.cc:515] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.419759  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea84be4c8d3a4fc6978a5ada9af04e2d" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.420621  9925 raft_consensus.cc:3060] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.433419 10147 tablet_bootstrap.cc:492] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.433665 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea84be4c8d3a4fc6978a5ada9af04e2d" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:39.434024 10147 ts_tablet_manager.cc:1403] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.051s
I20260709 12:26:39.434238 10000 raft_consensus.cc:3060] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.437155 10147 raft_consensus.cc:359] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.437922 10147 raft_consensus.cc:385] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.438210 10147 raft_consensus.cc:740] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.438959 10147 consensus_queue.cc:260] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.441205 10147 ts_tablet_manager.cc:1434] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:39.442162 10147 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.446643 10000 raft_consensus.cc:2468] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.448103  9817 leader_election.cc:304] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.448596 10147 tablet_bootstrap.cc:654] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.449126 10136 raft_consensus.cc:2804] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.455547  9927 raft_consensus.cc:2468] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.459939  9965 leader_election.cc:304] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:39.456727 10152 leader_election.cc:290] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.461128 10161 raft_consensus.cc:2804] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.461238 10149 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.461231 10147 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.461712 10161 raft_consensus.cc:697] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:39.462028 10149 ts_tablet_manager.cc:1403] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.131s	user 0.051s	sys 0.045s
I20260709 12:26:39.462028 10147 ts_tablet_manager.cc:1403] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:26:39.466037 10149 raft_consensus.cc:359] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.466831 10149 raft_consensus.cc:385] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.467113 10149 raft_consensus.cc:740] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.467161 10147 raft_consensus.cc:359] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.467911 10147 raft_consensus.cc:385] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.468339 10147 raft_consensus.cc:740] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.467953 10149 consensus_queue.cc:260] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.464927 10161 consensus_queue.cc:237] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.470629 10149 ts_tablet_manager.cc:1434] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:26:39.469103 10147 consensus_queue.cc:260] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.471773 10149 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.472885 10147 ts_tablet_manager.cc:1434] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:39.474011 10147 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.479101 10149 tablet_bootstrap.cc:654] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.481412 10147 tablet_bootstrap.cc:654] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.483466 10152 raft_consensus.cc:493] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.484453 10152 raft_consensus.cc:515] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.488396  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
W20260709 12:26:39.490446  9816 leader_election.cc:343] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a04374fb84b843a89010eb5726660aef (127.29.143.194:38653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.491176 10149 tablet_bootstrap.cc:492] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.491900 10149 ts_tablet_manager.cc:1403] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 12:26:39.492197 10147 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.492799 10147 ts_tablet_manager.cc:1403] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:26:39.493068 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
W20260709 12:26:39.494572  9817 leader_election.cc:343] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.492911 10152 leader_election.cc:290] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.495040  9817 leader_election.cc:304] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05; no voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef
I20260709 12:26:39.495961 10147 raft_consensus.cc:359] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.496738 10147 raft_consensus.cc:385] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.497046 10147 raft_consensus.cc:740] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.497785 10147 consensus_queue.cc:260] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.498802 10149 raft_consensus.cc:359] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.499850 10149 raft_consensus.cc:385] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.500415 10149 raft_consensus.cc:740] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.501786 10149 consensus_queue.cc:260] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.505015 10149 ts_tablet_manager.cc:1434] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:39.515057 10149 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.524085 10149 tablet_bootstrap.cc:654] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.533887  9925 raft_consensus.cc:2468] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.536775 10149 tablet_bootstrap.cc:492] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.537644 10149 ts_tablet_manager.cc:1403] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:26:39.539038 10177 raft_consensus.cc:2749] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.540426 10180 raft_consensus.cc:493] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.540871 10180 raft_consensus.cc:515] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.541198 10149 raft_consensus.cc:359] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.541877 10149 raft_consensus.cc:385] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.542163 10149 raft_consensus.cc:740] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.543094 10149 consensus_queue.cc:260] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.544818 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.545470 10000 raft_consensus.cc:2468] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.545558 10149 ts_tablet_manager.cc:1434] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:39.546728 10149 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Bootstrap starting.
I20260709 12:26:39.546667  9817 leader_election.cc:304] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.547137 10147 ts_tablet_manager.cc:1434] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.054s	user 0.022s	sys 0.019s
I20260709 12:26:39.547848 10176 raft_consensus.cc:2804] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.548171 10147 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.548247 10176 raft_consensus.cc:493] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.549712 10176 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.552673 10149 tablet_bootstrap.cc:654] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.552271  9747 catalog_manager.cc:5697] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.554805 10180 leader_election.cc:290] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.556777 10147 tablet_bootstrap.cc:654] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.557888 10176 raft_consensus.cc:515] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.560834 10136 raft_consensus.cc:697] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:39.561336 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:39.563658 10000 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.564431 10136 consensus_queue.cc:237] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.569218 10147 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.569638 10147 ts_tablet_manager.cc:1403] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
W20260709 12:26:39.561271  9816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.194:38653, user_credentials={real_user=slave}} blocked reactor thread for 58746us
I20260709 12:26:39.566642 10149 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: No bootstrap required, opened a new log
I20260709 12:26:39.570334 10149 ts_tablet_manager.cc:1403] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:26:39.571157  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.572407 10147 raft_consensus.cc:359] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.572093  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.572916 10149 raft_consensus.cc:359] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.573544 10149 raft_consensus.cc:385] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.573808 10149 raft_consensus.cc:740] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.570616 10000 raft_consensus.cc:2468] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.574472 10149 consensus_queue.cc:260] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
W20260709 12:26:39.574919  9816 leader_election.cc:343] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a04374fb84b843a89010eb5726660aef (127.29.143.194:38653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.575745 10147 raft_consensus.cc:385] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.576031 10147 raft_consensus.cc:740] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.576607 10149 ts_tablet_manager.cc:1434] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:26:39.566802 10148 tablet_bootstrap.cc:492] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.576648 10147 consensus_queue.cc:260] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.577355 10148 ts_tablet_manager.cc:1403] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.240s	user 0.032s	sys 0.134s
I20260709 12:26:39.578890 10147 ts_tablet_manager.cc:1434] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:26:39.579798 10147 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Bootstrap starting.
I20260709 12:26:39.580268 10148 raft_consensus.cc:359] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.580950 10148 raft_consensus.cc:385] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.581257 10148 raft_consensus.cc:740] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.581048  9817 leader_election.cc:304] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: a04374fb84b843a89010eb5726660aef
I20260709 12:26:39.582116 10177 raft_consensus.cc:2804] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.582003 10148 consensus_queue.cc:260] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.582631 10177 raft_consensus.cc:697] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:39.561906 10176 leader_election.cc:290] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.583787 10177 consensus_queue.cc:237] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.590821 10147 tablet_bootstrap.cc:654] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.584914 10148 ts_tablet_manager.cc:1434] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:39.593618 10148 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.595643  9748 catalog_manager.cc:5697] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.598176 10177 raft_consensus.cc:493] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.598668 10177 raft_consensus.cc:515] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.601656  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.602305  9925 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.603699  9816 leader_election.cc:304] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.604408 10148 tablet_bootstrap.cc:654] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.605895 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.606506 10000 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.607770 10177 leader_election.cc:290] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.608567 10177 raft_consensus.cc:2804] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.608884 10177 raft_consensus.cc:493] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.609211 10177 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.614630 10178 raft_consensus.cc:493] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.615183 10178 raft_consensus.cc:515] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.614477 10161 raft_consensus.cc:493] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.616204 10161 raft_consensus.cc:515] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.617398 10178 leader_election.cc:290] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.619521  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:39.620201  9849 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:39.618506 10161 leader_election.cc:290] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.622354  9890 leader_election.cc:304] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.623633 10147 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: No bootstrap required, opened a new log
I20260709 12:26:39.624346 10147 ts_tablet_manager.cc:1403] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.009s
I20260709 12:26:39.624305  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
W20260709 12:26:39.625860  9964 leader_election.cc:343] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.626869 10178 raft_consensus.cc:2804] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.626003 10177 raft_consensus.cc:515] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.627321 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.627624 10147 raft_consensus.cc:359] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.623731  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.628399 10147 raft_consensus.cc:385] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.628834 10147 raft_consensus.cc:740] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.629133 10148 tablet_bootstrap.cc:492] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.629658 10148 ts_tablet_manager.cc:1403] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.005s
I20260709 12:26:39.629515 10147 consensus_queue.cc:260] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
W20260709 12:26:39.630003  9965 leader_election.cc:343] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a04374fb84b843a89010eb5726660aef (127.29.143.194:38653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.630465  9965 leader_election.cc:304] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90; no voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef
I20260709 12:26:39.631749 10161 raft_consensus.cc:493] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.628206 10000 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 0.
I20260709 12:26:39.631929 10147 ts_tablet_manager.cc:1434] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:39.632203 10161 raft_consensus.cc:515] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.637923 10161 leader_election.cc:290] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.637748  9747 catalog_manager.cc:5697] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.638445  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:39.632476 10178 raft_consensus.cc:493] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.639353  9849 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.632349 10134 raft_consensus.cc:2749] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.640758  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.641603  9964 leader_election.cc:304] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.642168 10177 leader_election.cc:290] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.643368 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:39.639375 10178 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.643808  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.644006 10000 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.644604  9927 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.649391 10134 consensus_queue.cc:1048] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.632706 10148 raft_consensus.cc:359] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.651283  9927 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.651664 10148 raft_consensus.cc:385] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.651979 10148 raft_consensus.cc:740] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.652020 10000 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.652433  9816 leader_election.cc:304] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.652832 10148 consensus_queue.cc:260] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.643651 10161 raft_consensus.cc:2804] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.653646 10176 raft_consensus.cc:2804] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.653836  9925 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.654223 10176 raft_consensus.cc:697] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:39.655114 10178 raft_consensus.cc:515] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.655956 10134 raft_consensus.cc:493] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.655153 10176 consensus_queue.cc:237] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.656522 10134 raft_consensus.cc:515] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.659049 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:39.659614  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:39.653942 10161 raft_consensus.cc:493] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.660616  9850 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.661113 10161 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.659869 10001 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.664767 10134 leader_election.cc:290] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.666190 10148 ts_tablet_manager.cc:1434] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:26:39.667809 10148 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.669188  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.670001  9925 raft_consensus.cc:2468] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.673206 10161 raft_consensus.cc:515] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.673584  9965 leader_election.cc:304] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.674494 10134 raft_consensus.cc:2804] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.674878 10134 raft_consensus.cc:493] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.675189 10134 raft_consensus.cc:3060] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.675344 10148 tablet_bootstrap.cc:654] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.659086 10178 leader_election.cc:290] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.683262  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05" is_pre_election: true
I20260709 12:26:39.682432 10134 raft_consensus.cc:515] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.684391  9848 raft_consensus.cc:2468] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 0.
I20260709 12:26:39.689970  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.696285  9925 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.697786  9927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.691416  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6c46be19084f1dbb42ddb2c901e498" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:39.698395  9927 raft_consensus.cc:3060] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.690582  9851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:39.701710  9851 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.698760  9848 raft_consensus.cc:3060] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.690047 10134 leader_election.cc:290] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.687930 10161 leader_election.cc:290] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:39.693063 10001 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:39.709612  9892 leader_election.cc:304] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:39.700903  9850 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 1.
I20260709 12:26:39.710990 10178 raft_consensus.cc:2804] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.712695 10178 raft_consensus.cc:697] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:39.713944 10178 consensus_queue.cc:237] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.734048 10161 consensus_queue.cc:1048] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:39.739403  9747 catalog_manager.cc:5697] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.759951  9748 catalog_manager.cc:5697] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 0 to 1, leader changed from <none> to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 1 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.763906  9851 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.766345  9964 leader_election.cc:304] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.767357 10190 raft_consensus.cc:2804] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.768110 10190 raft_consensus.cc:697] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:39.769061 10190 consensus_queue.cc:237] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.772837  9848 raft_consensus.cc:2468] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.775151  9925 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.776175  9964 leader_election.cc:304] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.776942  9927 raft_consensus.cc:2468] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 1.
I20260709 12:26:39.779083 10134 raft_consensus.cc:2804] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.790565 10148 tablet_bootstrap.cc:492] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.791160 10148 ts_tablet_manager.cc:1403] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.124s	user 0.026s	sys 0.082s
I20260709 12:26:39.794400 10134 raft_consensus.cc:697] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:39.795723 10134 consensus_queue.cc:237] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.799751 10148 raft_consensus.cc:359] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.800766 10148 raft_consensus.cc:385] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.801311 10148 raft_consensus.cc:740] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.802279 10148 consensus_queue.cc:260] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.805150 10148 ts_tablet_manager.cc:1434] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:39.806396 10148 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: Bootstrap starting.
I20260709 12:26:39.815050  9748 catalog_manager.cc:5697] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.823194 10148 tablet_bootstrap.cc:654] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.827668 10148 tablet_bootstrap.cc:492] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: No bootstrap required, opened a new log
I20260709 12:26:39.828070 10148 ts_tablet_manager.cc:1403] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:26:39.829421  9748 catalog_manager.cc:5697] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 1 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.830055 10148 raft_consensus.cc:359] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.830667 10148 raft_consensus.cc:385] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.830885 10148 raft_consensus.cc:740] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.831616 10148 consensus_queue.cc:260] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.833572 10148 ts_tablet_manager.cc:1434] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
W20260709 12:26:39.857503  9798 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:39.864670 10176 raft_consensus.cc:493] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.865229 10176 raft_consensus.cc:515] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.867023 10176 leader_election.cc:290] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.867717  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.867986 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.868517  9926 raft_consensus.cc:2393] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fad6e5099a144da91d785bdbaef1e05 in current term 1: Already voted for candidate 682a1c00ab064499a57bc01dd23e1e90 in this term.
I20260709 12:26:39.869460  9816 leader_election.cc:304] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05; no voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef
I20260709 12:26:39.870093 10176 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.875063 10176 raft_consensus.cc:2749] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.954319 10190 consensus_queue.cc:1048] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.966814 10134 consensus_queue.cc:1048] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.969457 10176 raft_consensus.cc:493] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.970017 10176 raft_consensus.cc:515] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.972091 10176 leader_election.cc:290] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.973121 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90" is_pre_election: true
I20260709 12:26:39.973357  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef" is_pre_election: true
I20260709 12:26:39.973852 10001 raft_consensus.cc:2468] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.973914  9925 raft_consensus.cc:2468] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 0.
I20260709 12:26:39.974993  9817 leader_election.cc:304] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.975736 10176 raft_consensus.cc:2804] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.976079 10176 raft_consensus.cc:493] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.976366 10176 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.983210 10176 raft_consensus.cc:515] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:39.986497 10176 leader_election.cc:290] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:39.986486  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:39.987085 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:39.987318  9926 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.987586 10001 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.993994 10001 raft_consensus.cc:2468] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.995177  9817 leader_election.cc:304] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:39.995235  9926 raft_consensus.cc:2468] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 1.
I20260709 12:26:39.996146 10176 raft_consensus.cc:2804] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.996726 10176 raft_consensus.cc:697] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:39.997888 10176 consensus_queue.cc:237] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.006371  9748 catalog_manager.cc:5697] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 1 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.039537 10176 consensus_queue.cc:1048] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.045125  9926 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:40.059871 10176 consensus_queue.cc:1048] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:40.074338 10136 consensus_queue.cc:1048] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.079216 10136 consensus_queue.cc:1048] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.134594 10136 consensus_queue.cc:1048] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.140877 10136 consensus_queue.cc:1048] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.163898 10000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
mode: GRACEFUL
new_leader_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:40.164484 10000 raft_consensus.cc:606] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Received request to transfer leadership to TS 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:40.172135 10000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
mode: GRACEFUL
new_leader_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:40.172796 10000 raft_consensus.cc:606] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Received request to transfer leadership to TS 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:40.177443 10178 consensus_queue.cc:1048] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.183035  9926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
mode: GRACEFUL
new_leader_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:26:40.183629  9926 raft_consensus.cc:606] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Received request to transfer leadership to TS 3fad6e5099a144da91d785bdbaef1e05
I20260709 12:26:40.189755 10001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:40.189968 10205 consensus_queue.cc:1048] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.190481 10001 raft_consensus.cc:606] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:40.201650 10046 raft_consensus.cc:993] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: : Instructing follower 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.201864  9848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:53630
I20260709 12:26:40.202133 10046 raft_consensus.cc:1081] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Signalling peer 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.202502  9848 raft_consensus.cc:606] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:40.204326  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:53608
I20260709 12:26:40.204883  9848 raft_consensus.cc:493] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.205250  9848 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.208000  9851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:53630
I20260709 12:26:40.208546  9851 raft_consensus.cc:606] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:40.212385  9848 raft_consensus.cc:515] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.213845  9851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:53630
I20260709 12:26:40.214176  9848 leader_election.cc:290] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.214521  9851 raft_consensus.cc:606] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Received request to transfer leadership to TS a04374fb84b843a89010eb5726660aef
I20260709 12:26:40.215140  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:40.215235 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e9ce2552fa43b18d66b80be18cbbf7" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.215695  9926 raft_consensus.cc:3055] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.215794 10000 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.215948  9926 raft_consensus.cc:740] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:40.216614  9926 consensus_queue.cc:260] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.217531  9926 raft_consensus.cc:3060] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.221091 10000 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.222244  9817 leader_election.cc:304] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:40.223517 10136 raft_consensus.cc:2804] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.223937  9926 raft_consensus.cc:2468] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.224074 10136 raft_consensus.cc:697] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.225270 10136 consensus_queue.cc:237] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.233628  9749 catalog_manager.cc:5697] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 1 to 2, leader changed from a04374fb84b843a89010eb5726660aef (127.29.143.194) to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.234934 10161 consensus_queue.cc:1048] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.235672 10134 consensus_queue.cc:1048] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.244172 10134 raft_consensus.cc:993] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: : Instructing follower 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.244643 10134 raft_consensus.cc:1081] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Signalling peer 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.247604  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:53618
I20260709 12:26:40.248171  9848 raft_consensus.cc:493] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.248566  9848 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.256332  9848 raft_consensus.cc:515] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.257366  9851 raft_consensus.cc:1240] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Rejecting Update request from peer 682a1c00ab064499a57bc01dd23e1e90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.262071 10159 consensus_queue.cc:1059] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:40.262854 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.263453 10159 raft_consensus.cc:3055] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.263616  9848 leader_election.cc:290] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.263808 10159 raft_consensus.cc:740] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:40.264662 10159 consensus_queue.cc:260] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.265503 10159 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.268151  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b4a29c21f4b32b97d5dc7fac59801" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:40.268710  9926 raft_consensus.cc:3060] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.274938  9926 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.276561  9816 leader_election.cc:304] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:40.277371 10136 raft_consensus.cc:2804] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.277838 10136 raft_consensus.cc:697] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.278328 10000 raft_consensus.cc:2468] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.278965 10136 consensus_queue.cc:237] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.286478  9750 catalog_manager.cc:5697] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 1 to 2, leader changed from 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195) to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.339697 10159 consensus_queue.cc:1048] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.350193 10134 consensus_queue.cc:1048] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.362514 10159 raft_consensus.cc:993] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: : Instructing follower 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.363034 10134 raft_consensus.cc:1081] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Signalling peer 3fad6e5099a144da91d785bdbaef1e05 to start an election
I20260709 12:26:40.364605  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
 from {username='slave'} at 127.0.0.1:53618
I20260709 12:26:40.365168  9848 raft_consensus.cc:493] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.365499  9848 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.371348  9848 raft_consensus.cc:515] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.372995  9848 leader_election.cc:290] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Requested vote from peers a04374fb84b843a89010eb5726660aef (127.29.143.194:38653), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.373623  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:40.374117 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e914d5dc0444baab0a072b2dc4ad318" candidate_uuid: "3fad6e5099a144da91d785bdbaef1e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.374289  9926 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.374738 10000 raft_consensus.cc:3055] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.375083 10000 raft_consensus.cc:740] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:40.375810 10000 consensus_queue.cc:260] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.376679 10000 raft_consensus.cc:3060] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.379508  9926 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.380515  9816 leader_election.cc:304] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:40.381183 10136 raft_consensus.cc:2804] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.381269 10000 raft_consensus.cc:2468] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fad6e5099a144da91d785bdbaef1e05 in term 2.
I20260709 12:26:40.381613 10136 raft_consensus.cc:697] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Leader. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.382443 10136 consensus_queue.cc:237] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.388739  9749 catalog_manager.cc:5697] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 reported cstate change: term changed from 1 to 2, leader changed from 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195) to 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193). New cstate: current_term: 2 leader_uuid: "3fad6e5099a144da91d785bdbaef1e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.489822 10136 consensus_queue.cc:1048] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.496901 10177 raft_consensus.cc:993] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.497496 10180 raft_consensus.cc:1081] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.499646  9925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54438
I20260709 12:26:40.500772  9925 raft_consensus.cc:493] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.501173  9925 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.505419 10136 consensus_queue.cc:1048] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:40.508005  9925 raft_consensus.cc:515] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.511008  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:40.511404 10001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48908b0bd8dd4154b1d16e485ac7aa79" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.511621  9848 raft_consensus.cc:3055] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.511987  9848 raft_consensus.cc:740] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.512779  9848 consensus_queue.cc:260] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.513696  9848 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.515971  9925 leader_election.cc:290] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.521365  9848 raft_consensus.cc:2468] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.522662  9890 leader_election.cc:304] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:40.523445 10205 raft_consensus.cc:2804] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.523939 10205 raft_consensus.cc:697] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:40.524765 10205 consensus_queue.cc:237] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.531806  9750 catalog_manager.cc:5697] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.540297 10159 raft_consensus.cc:993] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.540784 10159 raft_consensus.cc:1081] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.542574  9925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54436
I20260709 12:26:40.543232  9925 raft_consensus.cc:493] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.543665  9925 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.549494  9925 raft_consensus.cc:515] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.551826  9925 leader_election.cc:290] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.553072  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:40.553002 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2194e9d053844d0eafd154acbf13bf52" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.553848  9848 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.553912 10000 raft_consensus.cc:3055] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.554323 10000 raft_consensus.cc:740] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:40.555238 10000 consensus_queue.cc:260] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.556385 10000 raft_consensus.cc:3060] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.561544  9848 raft_consensus.cc:2468] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.562911  9890 leader_election.cc:304] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:40.563618 10000 raft_consensus.cc:2468] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.563697 10205 raft_consensus.cc:2804] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.564276 10205 raft_consensus.cc:697] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:40.565243 10205 consensus_queue.cc:237] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.572050  9749 catalog_manager.cc:5697] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.577526 10177 raft_consensus.cc:993] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.578091 10177 raft_consensus.cc:1081] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.579806  9925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54438
I20260709 12:26:40.580430  9925 raft_consensus.cc:493] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.580755  9925 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.586244  9925 raft_consensus.cc:515] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.587977  9925 leader_election.cc:290] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.588793  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:40.588979 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb210f3bce443399cbae2e23867a136" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.589639 10000 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.589699  9848 raft_consensus.cc:3055] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.590101  9848 raft_consensus.cc:740] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.590934  9848 consensus_queue.cc:260] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.592192  9848 raft_consensus.cc:3060] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.596676 10000 raft_consensus.cc:2468] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.597826  9892 leader_election.cc:304] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:40.598539 10205 raft_consensus.cc:2804] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.599112 10205 raft_consensus.cc:697] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:40.599128  9848 raft_consensus.cc:2468] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.600076 10205 consensus_queue.cc:237] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.607226  9749 catalog_manager.cc:5697] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.634321  9925 raft_consensus.cc:1275] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.635612 10177 consensus_queue.cc:1048] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.642971 10000 raft_consensus.cc:1275] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.644310 10136 consensus_queue.cc:1048] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.722572 10136 raft_consensus.cc:993] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.723079 10177 raft_consensus.cc:1081] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Signalling peer a04374fb84b843a89010eb5726660aef to start an election
I20260709 12:26:40.724687  9925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
 from {username='slave'} at 127.0.0.1:54438
I20260709 12:26:40.725203  9925 raft_consensus.cc:493] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.725492  9925 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.731751  9925 raft_consensus.cc:515] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.733306  9925 leader_election.cc:290] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195:35041)
I20260709 12:26:40.734198  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:40.734403 10000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b873e30e0f2749e382a5f1c988fe1587" candidate_uuid: "a04374fb84b843a89010eb5726660aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
I20260709 12:26:40.734877  9848 raft_consensus.cc:3055] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.735037 10000 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.735203  9848 raft_consensus.cc:740] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:40.735953  9848 consensus_queue.cc:260] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.736872  9848 raft_consensus.cc:3060] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.741994 10000 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.743167  9892 leader_election.cc:304] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:40.743929 10205 raft_consensus.cc:2804] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.744756 10205 raft_consensus.cc:697] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Becoming Leader. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:40.745309  9848 raft_consensus.cc:2468] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a04374fb84b843a89010eb5726660aef in term 2.
I20260709 12:26:40.745666 10205 consensus_queue.cc:237] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:40.752420  9750 catalog_manager.cc:5697] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef reported cstate change: term changed from 1 to 2, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to a04374fb84b843a89010eb5726660aef (127.29.143.194). New cstate: current_term: 2 leader_uuid: "a04374fb84b843a89010eb5726660aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.769482 10000 raft_consensus.cc:1275] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.770669 10177 consensus_queue.cc:1048] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.779275  9925 raft_consensus.cc:1275] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.780821 10180 consensus_queue.cc:1048] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.912053  9925 raft_consensus.cc:1275] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.913477 10180 consensus_queue.cc:1048] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.923746 10000 raft_consensus.cc:1275] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer 3fad6e5099a144da91d785bdbaef1e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.925251 10180 consensus_queue.cc:1048] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.980055 10000 raft_consensus.cc:3060] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.983901  9848 raft_consensus.cc:1275] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.985247 10205 consensus_queue.cc:1048] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.985854 10000 raft_consensus.cc:1275] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.987059 10205 consensus_queue.cc:1048] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.041226 10000 raft_consensus.cc:1275] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.042843 10222 consensus_queue.cc:1048] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.050537  9848 raft_consensus.cc:1275] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.052006 10046 consensus_queue.cc:1048] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.107903 10000 raft_consensus.cc:1275] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.109160 10205 consensus_queue.cc:1048] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.117900  9848 raft_consensus.cc:1275] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.119483 10046 consensus_queue.cc:1048] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.169219 10000 raft_consensus.cc:1275] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.170709 10046 consensus_queue.cc:1048] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:41.184338  9848 raft_consensus.cc:1275] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer a04374fb84b843a89010eb5726660aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.185864 10205 consensus_queue.cc:1048] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.225483  9750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40682:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:43.250609  9750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40682:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:26:43.294813 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.512400 10261 tablet.cc:1724] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:43.537046 10248 log.cc:927] Time spent T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Append to log took a long time: real 0.085s	user 0.001s	sys 0.004s
W20260709 12:26:43.566730  9964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.143.193:37791, user_credentials={real_user=slave}} blocked reactor thread for 53457.6us
I20260709 12:26:43.575553 10275 tablet.cc:1724] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:43.614187 10271 log.cc:927] Time spent T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
W20260709 12:26:43.642645 10279 log.cc:927] Time spent T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 12:26:43.688107 10289 tablet.cc:1724] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.688335 10287 tablet.cc:1724] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.691447 10294 tablet.cc:1724] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:43.700127 10281 log.cc:927] Time spent T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Append to log took a long time: real 0.139s	user 0.006s	sys 0.000s
W20260709 12:26:43.700908 10273 log.cc:927] Time spent T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
W20260709 12:26:43.703528 10277 log.cc:927] Time spent T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
W20260709 12:26:43.707401 10283 log.cc:927] Time spent T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:43.699988 10288 tablet.cc:1724] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.738554 10298 tablet.cc:1724] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:43.739670 10282 log.cc:927] Time spent T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:26:43.751761  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276"
dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
mode: GRACEFUL
new_leader_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:58052
I20260709 12:26:43.752700  9850 raft_consensus.cc:606] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Received request to transfer leadership to TS 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:43.754817 10300 tablet.cc:1724] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.749363 10285 tablet.cc:1724] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.710007 10292 tablet.cc:1724] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.779908 10302 tablet.cc:1724] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.791568 10301 tablet.cc:1724] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.777318 10261 tablet.cc:1724] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.803175 10300 tablet.cc:1724] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.806416 10289 tablet.cc:1724] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.826097 10261 tablet.cc:1724] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.811655 10298 tablet.cc:1724] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.813424 10292 tablet.cc:1724] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.818814 10285 tablet.cc:1724] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.821496 10294 tablet.cc:1724] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.821323 10275 tablet.cc:1724] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.847975 10300 tablet.cc:1724] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.854832 10302 tablet.cc:1724] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.877955 10301 tablet.cc:1724] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.887131 10288 tablet.cc:1724] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.884550 10294 tablet.cc:1724] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.861536 10292 tablet.cc:1724] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:43.906121  9924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf"
dest_uuid: "a04374fb84b843a89010eb5726660aef"
mode: GRACEFUL
new_leader_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:51292
I20260709 12:26:43.906929  9924 raft_consensus.cc:606] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Received request to transfer leadership to TS 682a1c00ab064499a57bc01dd23e1e90
I20260709 12:26:43.908963 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:43.909610 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.917259  9749 catalog_manager.cc:6242] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: soft_deleted_table [id=f368afbfefde456b81c15a86e39458ee] alter complete (version 1)
I20260709 12:26:43.967671 10262 raft_consensus.cc:993] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: : Instructing follower 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:43.968245 10256 raft_consensus.cc:1081] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Signalling peer 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:43.969928  9993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:51882
I20260709 12:26:43.970500  9993 raft_consensus.cc:493] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.970890  9993 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.977502  9993 raft_consensus.cc:515] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:43.979727  9993 leader_election.cc:290] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 3 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:43.980739  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:43.980504  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d6eb6dd14b4ad98630c7a2ba5ab276" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:43.981375  9924 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.981498  9850 raft_consensus.cc:3055] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:43.981899  9850 raft_consensus.cc:740] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3fad6e5099a144da91d785bdbaef1e05, State: Running, Role: LEADER
I20260709 12:26:43.982908  9850 consensus_queue.cc:260] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:43.983966  9850 raft_consensus.cc:3060] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.988125  9924 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 3.
I20260709 12:26:43.989485  9965 leader_election.cc:304] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 682a1c00ab064499a57bc01dd23e1e90, a04374fb84b843a89010eb5726660aef; no voters: 
I20260709 12:26:43.990046  9850 raft_consensus.cc:2468] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 3.
I20260709 12:26:43.990476 10134 raft_consensus.cc:2804] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.991019 10134 raft_consensus.cc:697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 3 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:43.991912 10134 consensus_queue.cc:237] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:44.001330  9749 catalog_manager.cc:5697] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 2 to 3, leader changed from 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193) to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 3 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.033329 10222 raft_consensus.cc:993] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: : Instructing follower 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:44.033902 10259 raft_consensus.cc:1081] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Signalling peer 682a1c00ab064499a57bc01dd23e1e90 to start an election
I20260709 12:26:44.035326  9993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf"
dest_uuid: "682a1c00ab064499a57bc01dd23e1e90"
 from {username='slave'} at 127.0.0.1:51866
I20260709 12:26:44.035806  9993 raft_consensus.cc:493] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:44.036132  9993 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.041349  9993 raft_consensus.cc:515] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:44.043150  9993 leader_election.cc:290] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 2 election: Requested vote from peers 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791), a04374fb84b843a89010eb5726660aef (127.29.143.194:38653)
I20260709 12:26:44.044111  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fad6e5099a144da91d785bdbaef1e05"
I20260709 12:26:44.044289  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42e4667e13b40f29a58d57399731bcf" candidate_uuid: "682a1c00ab064499a57bc01dd23e1e90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a04374fb84b843a89010eb5726660aef"
I20260709 12:26:44.044757  9850 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.044876  9924 raft_consensus.cc:3055] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:44.045274  9924 raft_consensus.cc:740] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a04374fb84b843a89010eb5726660aef, State: Running, Role: LEADER
I20260709 12:26:44.046068  9924 consensus_queue.cc:260] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:44.047142  9924 raft_consensus.cc:3060] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.050522  9850 raft_consensus.cc:2468] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 2.
I20260709 12:26:44.051818  9964 leader_election.cc:304] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad6e5099a144da91d785bdbaef1e05, 682a1c00ab064499a57bc01dd23e1e90; no voters: 
I20260709 12:26:44.052145  9924 raft_consensus.cc:2468] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 682a1c00ab064499a57bc01dd23e1e90 in term 2.
I20260709 12:26:44.052738 10134 raft_consensus.cc:2804] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:44.053167 10134 raft_consensus.cc:697] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 2 LEADER]: Becoming Leader. State: Replica: 682a1c00ab064499a57bc01dd23e1e90, State: Running, Role: LEADER
I20260709 12:26:44.054011 10134 consensus_queue.cc:237] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } }
I20260709 12:26:44.060819  9749 catalog_manager.cc:5697] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 reported cstate change: term changed from 1 to 2, leader changed from a04374fb84b843a89010eb5726660aef (127.29.143.194) to 682a1c00ab064499a57bc01dd23e1e90 (127.29.143.195). New cstate: current_term: 2 leader_uuid: "682a1c00ab064499a57bc01dd23e1e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "682a1c00ab064499a57bc01dd23e1e90" member_type: VOTER last_known_addr { host: "127.29.143.195" port: 35041 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.479277  9922 raft_consensus.cc:1275] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:44.480727  9924 raft_consensus.cc:1275] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 3 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:44.480739 10134 consensus_queue.cc:1048] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:44.482391 10291 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a04374fb84b843a89010eb5726660aef" member_type: VOTER last_known_addr { host: "127.29.143.194" port: 38653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.494602  9850 raft_consensus.cc:1275] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:44.497478 10134 consensus_queue.cc:1048] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:44.498279  9850 raft_consensus.cc:1275] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 3 FOLLOWER]: Refusing update from remote peer 682a1c00ab064499a57bc01dd23e1e90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:44.504738 10314 consensus_queue.cc:1048] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad6e5099a144da91d785bdbaef1e05" member_type: VOTER last_known_addr { host: "127.29.143.193" port: 37791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.910830 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.916970 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:44.917562 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:45.918617 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.923732 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:45.924160 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.925199 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.930752 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:46.931198 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:47.932250 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.937251 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:47.937666 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:48.938738 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.943684 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:48.944140 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:49.945142 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.950152 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:49.950551 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:50.951610 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.957894 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:50.958384 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:51.959993 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:51.968336 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:51.968856 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:52.970026 30271 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.975150 30271 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:52.975543 30271 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:54.039892 30271 tablet_server.cc:179] TabletServer@127.29.143.193:0 shutting down...
W20260709 12:26:54.070729  9890 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:26:54.075351  9890 consensus_peers.cc:597] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef -> Peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Couldn't send request to peer 3fad6e5099a144da91d785bdbaef1e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.092907 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:54.093814 30271 tablet_replica.cc:333] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.095325 30271 raft_consensus.cc:2243] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.096331 30271 raft_consensus.cc:2272] T 48908b0bd8dd4154b1d16e485ac7aa79 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.100239 30271 tablet_replica.cc:333] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.100978 30271 raft_consensus.cc:2243] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.102321 30271 raft_consensus.cc:2272] T 186b4a29c21f4b32b97d5dc7fac59801 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.105916 30271 tablet_replica.cc:333] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.106751 30271 raft_consensus.cc:2243] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.107380 30271 raft_consensus.cc:2272] T b873e30e0f2749e382a5f1c988fe1587 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.110137 30271 tablet_replica.cc:333] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.110894 30271 raft_consensus.cc:2243] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.111883 30271 raft_consensus.cc:2272] T b3e9ce2552fa43b18d66b80be18cbbf7 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.115577 30271 tablet_replica.cc:333] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.116428 30271 raft_consensus.cc:2243] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.117168 30271 raft_consensus.cc:2272] T 2194e9d053844d0eafd154acbf13bf52 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.120805 30271 tablet_replica.cc:333] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.121465 30271 raft_consensus.cc:2243] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.122170 30271 raft_consensus.cc:2272] T 2bb210f3bce443399cbae2e23867a136 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.124972 30271 tablet_replica.cc:333] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.125571 30271 raft_consensus.cc:2243] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.126103 30271 raft_consensus.cc:2272] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 3fad6e5099a144da91d785bdbaef1e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.129235 30271 tablet_replica.cc:333] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.129894 30271 raft_consensus.cc:2243] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.130492 30271 raft_consensus.cc:2272] T 73ade1159a544ffc9ed007c73fc1f142 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.133423 30271 tablet_replica.cc:333] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.133973 30271 raft_consensus.cc:2243] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.134480 30271 raft_consensus.cc:2272] T 56d6c35f0da543cd956a7d3573661d05 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.136865 30271 tablet_replica.cc:333] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.137439 30271 raft_consensus.cc:2243] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.137936 30271 raft_consensus.cc:2272] T c42e4667e13b40f29a58d57399731bcf P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.140322 30271 tablet_replica.cc:333] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.140880 30271 raft_consensus.cc:2243] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.141386 30271 raft_consensus.cc:2272] T aa3742289dc5453a9fe82b497f976d56 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.143803 30271 tablet_replica.cc:333] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.144430 30271 raft_consensus.cc:2243] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.145617 30271 raft_consensus.cc:2272] T ea84be4c8d3a4fc6978a5ada9af04e2d P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:54.147440  9890 consensus_peers.cc:597] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef -> Peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Couldn't send request to peer 3fad6e5099a144da91d785bdbaef1e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.148559 30271 tablet_replica.cc:333] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.149134 30271 raft_consensus.cc:2243] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.149971 30271 raft_consensus.cc:2272] T 4e0720b968964c1d97550949b47591b3 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.152395 30271 tablet_replica.cc:333] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.152863 30271 raft_consensus.cc:2243] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.153672 30271 raft_consensus.cc:2272] T 8d289c1362c24e2d9779e260ac87adc0 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.155927 30271 tablet_replica.cc:333] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.156425 30271 raft_consensus.cc:2243] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.156927 30271 raft_consensus.cc:2272] T ad6c46be19084f1dbb42ddb2c901e498 P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.159251 30271 tablet_replica.cc:333] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.159716 30271 raft_consensus.cc:2243] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.160560 30271 raft_consensus.cc:2272] T ca3347edf7964d228e26b13f4abf6a9b P 3fad6e5099a144da91d785bdbaef1e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.162824 30271 tablet_replica.cc:333] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.163268 30271 raft_consensus.cc:2243] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.164119 30271 raft_consensus.cc:2272] T 3e914d5dc0444baab0a072b2dc4ad318 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.166245 30271 tablet_replica.cc:333] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05: stopping tablet replica
I20260709 12:26:54.166712 30271 raft_consensus.cc:2243] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.167168 30271 raft_consensus.cc:2272] T 088b74a10d0143498b23216ea9e28e98 P 3fad6e5099a144da91d785bdbaef1e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.216362 30271 tablet_server.cc:196] TabletServer@127.29.143.193:0 shutdown complete.
W20260709 12:26:54.238027  9964 consensus_peers.cc:597] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 -> Peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Couldn't send request to peer 3fad6e5099a144da91d785bdbaef1e05. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:37791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.265337 30271 tablet_server.cc:179] TabletServer@127.29.143.194:0 shutting down...
I20260709 12:26:54.299398 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:54.300236 30271 tablet_replica.cc:333] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.301502 30271 raft_consensus.cc:2243] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.302634 30271 raft_consensus.cc:2272] T 48908b0bd8dd4154b1d16e485ac7aa79 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.305034 30271 tablet_replica.cc:333] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.305658 30271 raft_consensus.cc:2243] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.306135 30271 raft_consensus.cc:2272] T 186b4a29c21f4b32b97d5dc7fac59801 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.308713 30271 tablet_replica.cc:333] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.309273 30271 raft_consensus.cc:2243] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.310137 30271 raft_consensus.cc:2272] T 2194e9d053844d0eafd154acbf13bf52 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.312690 30271 tablet_replica.cc:333] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.313288 30271 raft_consensus.cc:2243] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.313800 30271 raft_consensus.cc:2272] T b3e9ce2552fa43b18d66b80be18cbbf7 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.316824 30271 tablet_replica.cc:333] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.317420 30271 raft_consensus.cc:2243] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.318609 30271 raft_consensus.cc:2272] T b873e30e0f2749e382a5f1c988fe1587 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.321009 30271 tablet_replica.cc:333] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.321573 30271 raft_consensus.cc:2243] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.322026 30271 raft_consensus.cc:2272] T ea84be4c8d3a4fc6978a5ada9af04e2d P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.324167 30271 tablet_replica.cc:333] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.324652 30271 raft_consensus.cc:2243] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.325048 30271 raft_consensus.cc:2272] T 4e0720b968964c1d97550949b47591b3 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.327927 30271 tablet_replica.cc:333] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.328718 30271 raft_consensus.cc:2243] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.329440 30271 raft_consensus.cc:2272] T ad6c46be19084f1dbb42ddb2c901e498 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:54.331100  9964 consensus_peers.cc:597] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 -> Peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Couldn't send request to peer 3fad6e5099a144da91d785bdbaef1e05. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:37791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.332378 30271 tablet_replica.cc:333] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.332978 30271 raft_consensus.cc:2243] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.333462 30271 raft_consensus.cc:2272] T ca3347edf7964d228e26b13f4abf6a9b P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.335804 30271 tablet_replica.cc:333] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.336408 30271 raft_consensus.cc:2243] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.336881 30271 raft_consensus.cc:2272] T 8d289c1362c24e2d9779e260ac87adc0 P a04374fb84b843a89010eb5726660aef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.339354 30271 tablet_replica.cc:333] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.339928 30271 raft_consensus.cc:2243] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.340417 30271 raft_consensus.cc:2272] T 3e914d5dc0444baab0a072b2dc4ad318 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.342599 30271 tablet_replica.cc:333] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.343228 30271 raft_consensus.cc:2243] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.343685 30271 raft_consensus.cc:2272] T 088b74a10d0143498b23216ea9e28e98 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.345911 30271 tablet_replica.cc:333] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.346437 30271 raft_consensus.cc:2243] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.347865 30271 raft_consensus.cc:2272] T 73ade1159a544ffc9ed007c73fc1f142 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.350456 30271 tablet_replica.cc:333] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.351019 30271 raft_consensus.cc:2243] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.351465 30271 raft_consensus.cc:2272] T c42e4667e13b40f29a58d57399731bcf P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.353581 30271 tablet_replica.cc:333] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.354031 30271 raft_consensus.cc:2243] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.354913 30271 raft_consensus.cc:2272] T 56d6c35f0da543cd956a7d3573661d05 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.357070 30271 tablet_replica.cc:333] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.357586 30271 raft_consensus.cc:2243] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.358412 30271 raft_consensus.cc:2272] T aa3742289dc5453a9fe82b497f976d56 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.360922 30271 tablet_replica.cc:333] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.361392 30271 raft_consensus.cc:2243] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.362185 30271 raft_consensus.cc:2272] T 2bb210f3bce443399cbae2e23867a136 P a04374fb84b843a89010eb5726660aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.364429 30271 tablet_replica.cc:333] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef: stopping tablet replica
I20260709 12:26:54.364897 30271 raft_consensus.cc:2243] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.365341 30271 raft_consensus.cc:2272] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P a04374fb84b843a89010eb5726660aef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.411156 30271 tablet_server.cc:196] TabletServer@127.29.143.194:0 shutdown complete.
W20260709 12:26:54.431857  9965 consensus_peers.cc:597] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 -> Peer a04374fb84b843a89010eb5726660aef (127.29.143.194:38653): Couldn't send request to peer a04374fb84b843a89010eb5726660aef. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:38653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.451872 30271 tablet_server.cc:179] TabletServer@127.29.143.195:0 shutting down...
W20260709 12:26:54.470801  9964 consensus_peers.cc:597] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 -> Peer 3fad6e5099a144da91d785bdbaef1e05 (127.29.143.193:37791): Couldn't send request to peer 3fad6e5099a144da91d785bdbaef1e05. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.193:37791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.484535 30271 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:54.485476 30271 tablet_replica.cc:333] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.486222 30271 raft_consensus.cc:2243] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.486974 30271 raft_consensus.cc:2272] T b873e30e0f2749e382a5f1c988fe1587 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.489759 30271 tablet_replica.cc:333] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.490407 30271 raft_consensus.cc:2243] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.491001 30271 raft_consensus.cc:2272] T b3e9ce2552fa43b18d66b80be18cbbf7 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.493319 30271 tablet_replica.cc:333] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.494007 30271 raft_consensus.cc:2243] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.494565 30271 raft_consensus.cc:2272] T 48908b0bd8dd4154b1d16e485ac7aa79 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.497099 30271 tablet_replica.cc:333] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.497731 30271 raft_consensus.cc:2243] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.498272 30271 raft_consensus.cc:2272] T 2194e9d053844d0eafd154acbf13bf52 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.500658 30271 tablet_replica.cc:333] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.501274 30271 raft_consensus.cc:2243] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.502017 30271 raft_consensus.cc:2272] T 186b4a29c21f4b32b97d5dc7fac59801 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.504334 30271 tablet_replica.cc:333] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.504974 30271 raft_consensus.cc:2243] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.505527 30271 raft_consensus.cc:2272] T 73ade1159a544ffc9ed007c73fc1f142 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.507911 30271 tablet_replica.cc:333] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.508530 30271 raft_consensus.cc:2243] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.509064 30271 raft_consensus.cc:2272] T ea84be4c8d3a4fc6978a5ada9af04e2d P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.511656 30271 tablet_replica.cc:333] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.512328 30271 raft_consensus.cc:2243] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.513027 30271 raft_consensus.cc:2272] T 4e0720b968964c1d97550949b47591b3 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.516377 30271 tablet_replica.cc:333] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
W20260709 12:26:54.516496  9965 consensus_peers.cc:597] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 -> Peer a04374fb84b843a89010eb5726660aef (127.29.143.194:38653): Couldn't send request to peer a04374fb84b843a89010eb5726660aef. Status: Network error: Client connection negotiation failed: client connection to 127.29.143.194:38653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:54.517124 30271 raft_consensus.cc:2243] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.517737 30271 raft_consensus.cc:2272] T 8d289c1362c24e2d9779e260ac87adc0 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.520174 30271 tablet_replica.cc:333] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.520758 30271 raft_consensus.cc:2243] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.521251 30271 raft_consensus.cc:2272] T aa3742289dc5453a9fe82b497f976d56 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.523622 30271 tablet_replica.cc:333] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.524225 30271 raft_consensus.cc:2243] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.524830 30271 raft_consensus.cc:2272] T 3e914d5dc0444baab0a072b2dc4ad318 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.527221 30271 tablet_replica.cc:333] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.527846 30271 raft_consensus.cc:2243] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.528777 30271 raft_consensus.cc:2272] T 088b74a10d0143498b23216ea9e28e98 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.531149 30271 tablet_replica.cc:333] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.531765 30271 raft_consensus.cc:2243] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.532594 30271 raft_consensus.cc:2272] T c42e4667e13b40f29a58d57399731bcf P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.534854 30271 tablet_replica.cc:333] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.535487 30271 raft_consensus.cc:2243] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.535954 30271 raft_consensus.cc:2272] T 56d6c35f0da543cd956a7d3573661d05 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.538293 30271 tablet_replica.cc:333] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.538893 30271 raft_consensus.cc:2243] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.539440 30271 raft_consensus.cc:2272] T 2bb210f3bce443399cbae2e23867a136 P 682a1c00ab064499a57bc01dd23e1e90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.541689 30271 tablet_replica.cc:333] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.542222 30271 raft_consensus.cc:2243] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.543190 30271 raft_consensus.cc:2272] T 34d6eb6dd14b4ad98630c7a2ba5ab276 P 682a1c00ab064499a57bc01dd23e1e90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.545593 30271 tablet_replica.cc:333] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.546170 30271 raft_consensus.cc:2243] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.547086 30271 raft_consensus.cc:2272] T ad6c46be19084f1dbb42ddb2c901e498 P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.549327 30271 tablet_replica.cc:333] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90: stopping tablet replica
I20260709 12:26:54.549835 30271 raft_consensus.cc:2243] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:54.550297 30271 raft_consensus.cc:2272] T ca3347edf7964d228e26b13f4abf6a9b P 682a1c00ab064499a57bc01dd23e1e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.593672 30271 tablet_server.cc:196] TabletServer@127.29.143.195:0 shutdown complete.
I20260709 12:26:54.631707 30271 master.cc:562] Master@127.29.143.254:41379 shutting down...
I20260709 12:26:54.654559 30271 raft_consensus.cc:2243] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:54.655224 30271 raft_consensus.cc:2272] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:54.655522 30271 tablet_replica.cc:333] T 00000000000000000000000000000000 P af6779b42cda454599952fdbda0afc7d: stopping tablet replica
I20260709 12:26:54.675964 30271 master.cc:584] Master@127.29.143.254:41379 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21067 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42201 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (393918 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:26:54.733616 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2248 messages since previous log ~32 seconds ago
I20260709 12:26:54.733853 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2248 messages since previous log ~32 seconds ago
I20260709 12:26:54.734059 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2247 messages since previous log ~32 seconds ago
I20260709 12:26:54.734301 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:26:54.734525 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:26:54.735095 30271 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~213 seconds ago
I20260709 12:26:54.735363 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~213 seconds ago
I20260709 12:26:54.735584 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 2 messages since previous log ~213 seconds ago
I20260709 12:26:54.735756 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~191 seconds ago
I20260709 12:26:54.736090 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 12:26:54.736416 30271 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
